Exceeded Bandwidth

Get help with technical problems and keep up to date with any changes to the forum.
Post Reply
User avatar
Nicola
Site Admin
Site Admin
Posts: 1073
Joined: Sun May 09, 2004 5:35 pm

Exceeded Bandwidth

Post by Nicola » Thu Jun 25, 2020 8:36 pm

It's happened again. We increased our bandwidth to 75GB a couple of months ago. 'Real' people use a max 13GB per month. The rest is bots/spiders etc. Yesterday one bot used 54GB. Every time it happens I ban the offending IP addresses/bots whatever. I don't know what else to do to be honest. If anyone has any ideas please let me know. The webhosts have allowed us 48hrs and then we will probably be offline again until the start of the month. Thankfully that's not far away.

Macavity
Moderator
Moderator
Posts: 6121
Joined: Tue May 10, 2005 10:29 am

Re: Exceeded Bandwidth

Post by Macavity » Fri Jun 26, 2020 6:46 am

All I can think of is to switch off the registration process towards the end of each month, but I'll ask around. Is there less bot activity if more of the forums are 'hidden'?

best

mac

User avatar
Nicola
Site Admin
Site Admin
Posts: 1073
Joined: Sun May 09, 2004 5:35 pm

Re: Exceeded Bandwidth

Post by Nicola » Fri Jun 26, 2020 7:43 pm

I'm not sure about the hidden forums. The bots crawl the whole PG site which is quite large. I had considered stopping registrations. Thanks for having a think about it!

Macavity
Moderator
Moderator
Posts: 6121
Joined: Tue May 10, 2005 10:29 am

Re: Exceeded Bandwidth

Post by Macavity » Thu Jul 02, 2020 9:37 am

I had this response on another forum:
I don't know... but one would think so, given that access is denied to human browsers, the same should apply to bots and spiders, unless they can copy or read passwords but in that case one would expect to see some evidence on the 'hidden' boards.

I went and checked, and yes, posts in The Commons from this year are averaging roughly 5000 views while only one post in the Founders Forum - from Jan 2018 - has more than 100 views, the rest are lower, realistically so.
The 'founders' group on this site have hidden forums, the viewing hits are much lower on these hidden forums. I presume the same is true of the moderators' forum on PG?

Personally, I think the 'Poetry Discussion' forum would benefit from being hidden since contemorary poetry could be quoted and discussed without copyright concerns.

hope that helps some

mac

Post Reply