When Search Eats the Web: A Model of Corpus Erosion Under Generative Extraction

4 pointsposted 11 hours ago
by sypsyp

1 Comments

sypsyp

11 hours ago

Generative search engines may be eating the web they depend on. Spoiler: beyond a critical extraction rate, the crawlable web collapses. Spoiler bis: competition makes it worse.

The paper adopts a game theoretical approach to proves it, then look at seven mechanisms that could keep the commons alive.