Former Twitter CEO Parag Agrawal launches Index to compensate creators in AI agent era
Parag Agarwal, former Twitter CEO has now unveiled Index, a platform from his AI startup Parallel Web systems which aims to tackle one of the most contentious issues in artificial intelligence. According to a report by Fortune, Agarwal claims the platform is designed to fairly compensate content creators when AI agents, rather than humans, consume their work. Agarwal’s vision to create on the idea that AI agents will soon use the web far more than humans, reshaping both technology and business models. Unlike human readers who click through individual pages, AI agents can pull from dozens of sources simultaneously to complete tasks. This shift has raised concerns among publishers, who fear losing control over their content and revenue streams.The Index platform introduced by Parallel Web systems promise to offer transparency by showing publishers how AI agents use this material and introduces a new compensation model based on Shapely value, which is a game theory concept that estimates each source’s contribution to an AI agent’s output. The more unique or valuable the source, the higher the payout.
Launch partners for Index
As per the report by Fortune, Index is launching with a wide range of partners including The Atlantic, Fortune, PR Newswire, and data providers like PitchBook, Enigma, RocketReach, and ZoomInfo. Independent creators such as Alex Heath’s Sources, Packy McCormick’s Not Boring, and Mario Gabriele’s The Generalist are also onboard.Praising initiative Nicholas Thompson told Fortune, “AI agents are becoming the next major interface for accessing information, but the economics of the web have not caught up with that reality. Parallel is tackling this by creating a dynamic and scalable model for recognizing and compensating publishers.”
A different approach from licensing deals
Agrawal argues that fixed-fee licensing deals like the ones signed by OpenAI with the Associated Press, Axel Springer, and News Corp will fail to work in the age of AI agents. Such deals risk leaving smaller publishers and startups out of the market. “If only a few large companies have access to premium content and no one else does, how will anyone compete?” Agrawal told Fortune. Index’s model instead ties compensation directly to the value of the agent’s work and the source’s contribution.The launch of Index comes at a time when legal battles are going on between AI companies and content owners. The New York Times sued OpenAI and Microsoft in 2023, alleging unauthorized use of millions of articles. Dow Jones and the New York Post have also filed suits against AI startup Perplexity. Authors have challenged AI firms over book usage, with Anthropic agreeing to a major settlement last year.
