All the data used to train the AI models was arguably stolen. Is it so surprising that the models may just be doing very good search over the entire present of human thinking?

I will say that of the people I know in pharma, they are not allowed to use Anthropic nor OpenAI directly. It's all AWS Bedrock access, whom they trust not to use the data. (Because they already trust AWS with all their data, and AWS is not putting out papers in their fields of work.)

https://archive.is/omUwZ

When LLM stands for "Likely lying, marketing".