Send an answer to a topic: Site/Ad Issues
walter.
It's taking forever when opening the pages, even after enabling bot filter. And only a few minutes available for the website.
dhill_cb7
Can’t on this morning. Waited a few minutes for thesite to load. Enabled bot filter and now I am getting 500 internal server errors.
antp
I made some minor changes to slow a little the site for non logged in users, and disabled the stats page for these too (as it is quite heavy), that will already help a little for unidentified bots (until one creates an account...)
I'll try to also make a better filter for bots in the next days, but I can't do miracles
I'll try to also make a better filter for bots in the next days, but I can't do miracles
antp
I added a bunch of the fake browser IDs to the list of bots, hoping among these there isn't one of a real browser
(well, some are, but old outdated versions, most likely).
But even with that, these are so aggressive that I don't know if the site can work without the bot filter when they are scraping it. Maybe for some like that I should add a permanent filter then, I'll try to do that in the next days. Hoping that they don't start using real current browser IDs (instead of some that are just similar).
If someone gets blocked because identified as a bot, please open https://ksle1.antp.be/user-agent.php and give the ID that is returned for your browser.
(well, some are, but old outdated versions, most likely).But even with that, these are so aggressive that I don't know if the site can work without the bot filter when they are scraping it. Maybe for some like that I should add a permanent filter then, I'll try to do that in the next days. Hoping that they don't start using real current browser IDs (instead of some that are just similar).
If someone gets blocked because identified as a bot, please open https://ksle1.antp.be/user-agent.php and give the ID that is returned for your browser.
Baube
500 Internal Server Error on the main site . Happened twice today ( don't remember the time for the 1st one , 8:54 PM ( Baube's time ) for the second one
night cub
I've enabled the bot block a couple times already today
antp
It is heavy loaded, some requests work some don't. A site on a single server like here is not made for thousands of bot requests per second
Maybe I should at some point consider using Cloudflare services.
Enabling the bot filter may help a little, but since some of these new bots are not filtered by it, it won't solve all issues.
Maybe I should at some point consider using Cloudflare services.
Enabling the bot filter may help a little, but since some of these new bots are not filtered by it, it won't solve all issues.
dsl
I had same as Walter above for a few minutes about that time - frozen blank screen with "500 Internal Server Error"
Now it's happening again ....
Now it's happening again ....
dhill_cb7
500 internal server error.
Guess we are still down.
Guess we are still down.
antp
Either we had tens of thousands of extra visitors, or there are some new bots using random IPs and browser-like user agent, so very difficult to filter out...