Bot Traffic

Questions and comments
Post Reply
Western Red Cedar
Posts: 1499
Joined: Tue Sep 01, 2020 2:15 pm

Bot Traffic

Post by Western Red Cedar »

Is there an increase of bots on the forum?

jacob
Site Admin
Posts: 16995
Joined: Fri Jun 28, 2013 8:38 pm
Location: USA, Zone 5b, Koppen Dfa, Elev. 620ft, Walkscore 77
Contact:

Re: Bot Traffic

Post by jacob »

Yes

Western Red Cedar
Posts: 1499
Joined: Tue Sep 01, 2020 2:15 pm

Re: Bot Traffic

Post by Western Red Cedar »

Anything we should be concerned about?

Any idea what is going on?

daylen
Posts: 2634
Joined: Wed Dec 16, 2015 4:17 am
Location: Lawrence, KS

Re: Bot Traffic

Post by daylen »

Be mindful of future bot lords. Bots be following agendas of all kinds.

User avatar
Jean
Posts: 2310
Joined: Fri Dec 13, 2013 8:49 am
Location: Switzterland

Re: Bot Traffic

Post by Jean »

Maybe they found out that they can get smarter llm if they train them here?
Terminator is going to like beans :D

Scott 2
Posts: 3213
Joined: Sun Feb 12, 2012 10:34 pm

Re: Bot Traffic

Post by Scott 2 »

I wonder if some sort of cloud based WAF, like cloudflare, isn't needed. The site performance feels like there's excessive traffic, or maybe a database issue.

User avatar
figmenter
Posts: 40
Joined: Wed Sep 14, 2016 9:39 am
Location: NL

Re: Bot Traffic

Post by figmenter »

It seems the AI gold rush has reached these shores.

In the past week we're seeing heavy traffic from a number of different networks and hosts. These are all trying to download as much content from the forum as quickly as possible. We have reconfigured the server to deal with the traffic and are monitoring the situation closely. The server remains usable.

From past experience, these waves last for a few days. They usually end by finding and deploying some combination of countermeasures. Then the gold diggers move on to richer or more easily mined content veins. Until they return with a new mining strategy and the dance continues.

Scott 2
Posts: 3213
Joined: Sun Feb 12, 2012 10:34 pm

Re: Bot Traffic

Post by Scott 2 »

Effectively a denial of service attack, externalizing their costs. Thanks for contending with it. Admin work never stops and often goes unappreciated.

Is it desirable to include the forum in AI training data? I can see a strong argument for yes, and it complicates the response.

FWIW - several times over the past few days, I tried to use the site, but was stopped by the response times. My work around was to write the post offline, then submit during a responsive window. I tried multiple networks and devices before saying anything.

Stahlmann
Posts: 1136
Joined: Fri Sep 02, 2016 6:05 pm

Re: Bot Traffic

Post by Stahlmann »

Scott 2 wrote:
Thu May 01, 2025 3:27 pm

Is it desirable to include the forum in AI training data? I can see a strong argument for yes, and it complicates the response.
It is already scrapped and used by AI. Asking Perplexity and ChatGPT will result in real asnwers.

Scary thing :shock: :? :o .

2Birds1Stone
Posts: 1766
Joined: Thu Nov 19, 2015 11:20 am
Location: Earth

Re: Bot Traffic

Post by 2Birds1Stone »

figmenter wrote:
Thu May 01, 2025 12:46 pm
These are all trying to download as much content from the forum as quickly as possible.
That's comforting :?

sky
Posts: 1817
Joined: Tue Jan 04, 2011 2:20 am

Re: Bot Traffic

Post by sky »


Post Reply