If you run the same query 10 times, do you get roughly the same results or is there a lot of variance?

I found this useful, thanks! (just added a missing llm.txt and JSON-LD :))

Perhaps you can add a check for ai.txt as well? Not sure how it compares with just having a robots.txt, though.