Weren't these "spiders" just bots, that index search results on regular web search engines? Or there's no more difference between artificial "intelligence" bots and "spiders"?
Currently I see these registered bots online:
Apple [Spider], Bing [Spider], ChatGPT [Bot], Claude [Spider], DuckAssist [Bot], Facebook [Bot], Feedly [Bot], Google [Spider], Google Docs [Bot], Google Other [Bot], Inoreader [RSS], NewsAI [Bot], Perplexity [Spider], Petal Search [Spider], Pinterest [Bot], Protopage [RSS], Qwant [Spider], WordPress [Bot], XenForo [Bot], Yandex [Spider]
These are far from "almost harmless": ChatGPT [Bot], Claude [Spider], DuckAssist [Bot], Facebook [Bot], Feedly [Bot], Google Docs [Bot], Google Other [Bot], NewsAI [Bot], Pinterest [Bot].
Those are strange, but nowadays every "peope (in singular)" (corporation) pushes a."i." sh33t: WordPress [Bot], XenForo [Bot].
Mostly like search results indexing bots: Apple [Spider], Bing [Spider], Google [Spider], Perplexity [Spider], Petal Search [Spider], Qwant [Spider], Yandex [Spider].
And writing of corporations ("people" - are you serious?!), they are not people or living things. They are legal fictions for non-living subjects. And this is not the worst...
SvarDOS fan :: artificial "intelligence" bots - not a fan at all :: say NO to systemd :: is freeware a lie, when human freedom is a fundamental lie? :: f00ck €u!