Forum Upgrade

[Theo Gottwald]

I did some Forum Upgrades with my provider so we should not have these nasty problems the Forum mades lastly. The large amount of bots reading our forum constantly makes a lot of traffic to my provider so it looks like  forum that is heavily frequented.
Ok, lets see if that helps.

[Charles Pegge]

Yes, much better
it was hard to get any web pages, even at night.

[Theo Gottwald]

The problem are not the normal users.
We have meanwhile hundreds and even thousands of KI's "researching stuff" reading our Forums, see screnshot below ("online 141 guests" "Most online today 341" ...).

This is just this one Forum additionally we have the Museums-Forums at the same server.
They add up even more traffic.

If people are going whatever KI-Site asking them "Research something about how to program this and that" then these bots will find us and crawl our site.

I do not complain because even the new SindByte Version itself contains such a research Bot.

For example lets say you go to ChatGPT and ask something about Powerbasic and make a research.
CHatGPT will then start a bot and search the WEB for that - and where will it land?
What is currently the best resource with most of (Jose's) Code?

And the bots will find us and read all pages to get the needed information.
Which is intended to some degree the forum is set up to allow that.

However it leads to a breakdown of the allowed capacity from the provider regularly.
Maybe its even not enough and i will neeed to do more about it we will see.

This is just a screenshot from now you see that we have between 300 and 4000 "Spiders" and "Researchers crawling the forum at any time.

If you are just online, take a look at the very bottom of the forum then you see what i mean.



We have changed some allowances for unknown spiders. However my intention is not to block spiders and researches. I want to feed them instead.

[Theo Gottwald]

Looks like the more i do to keep the server performant, the more Crawlers come.

[Zlatko Vid]

THanks Theo ..now really respond better 

[Theo Gottwald]

Yes, I agree.
Its much better now. And the crawlers, bots and spiders also think that ....
In earlier years the internet was mostly for human users. You had a Forum and humans would read there.
Today humans go to ChatGPT- or Perplexity and ask there.
And the Spiders come here and read here.
We had a lot more humand readers in the starting years then spiders.
Now situation ihas changed. Few human readers, mostly spiders and crawlers.



Seeing the numbers tells us that the Internet of the future will change. Few sites may become large "Google-like" Startpages.
And they will look up the rest of the internat - as far as its politically correct.
If I make some more political posts i can distract at least some bot  from typical social networks, because they will not like it.
:-)