science and music. and beer. and dogs.
- 0 Posts
- 3 Comments
Joined 3 years ago
Cake day: June 13th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
tate@lemmy.sdf.orgto
Technology@lemmy.world•Aggressive AI scrapers are making it kinda suck to run wikisEnglish
23·9 days agoI wonder if it would be possible to filter traffic by limiting the rate at which links can be followed after the initial connection.
I suppose one problem with that is it would also limit the crawlers you want, like search engine indexing. Maybe if enough sites were doing this it would generate some pressure on the AI companies to behave better.


…again?