In case you didn’t know, you can’t train an AI on content generated by another AI because it causes distortion that reduces the quality of the output. It is also very difficult to filter out AI text from human text in a database. This phenomenon is known as AI collapse.
So if you were to start using AI to generate comments and posts on Reddit, their database would be less useful for training AI and therefore the company wouldn’t be able to sell it for that purpose.
Reddit’s surely got a copy of the PushShift archives, it’ll have all the pre-sabotage versions of those comments.
The PS archives are publicly available. If either OpenAI or Google were to use it, they wouldn’t pay Reddit Inc. a single penny; and yet Google is paying it 60 million dollars do to do. This means that there’s content that they cannot retrieve through the PS archives that would still be valuable as LLM data.