@Seirdy Not that Google would go for this, but maybe instead of search neutrality we need collective crawling? One co-op crawling body with neutral access terms for that data.
And perhaps this could be coupled with a push model instead of a pull model. Websites that want to be included in search can submit new or changed URLs once a day for the crawler to pick up.
Then search engines can optimize access to their pool of data without burdening sites.
This has been my daily thonk.
@Seirdy Geez. Stop following the development of something for a minute, and it is "suddenly" everywhere. 😆
A Fediverse instance for people interested in cooperative and collective projects.