Show HN: Llms.txt Generator – Turn websites into a text file to feed to any LLM

28 pointsposted a year ago
by ericciarla

7 Comments

throwaway314155

a year ago

For a simple solution, you can just right click->Save Page As.. and upload the resulting `.html` file into Claude/ChatGPT as an attachment. They're both more than capable of parsing the article content from the HTML without needing any pre-processing.

jondwillis

a year ago

Plain HTTP and passing an API key as a URL query parameter? Yikes!

IndieCoder

a year ago

I like the idea but Firecrawl and GPT4o is quite heavy. I use https://github.com/unclecode/crawl4ai in some projects, it works very well without these dependencies and is modular so you can use LLMs but do not have to :)

DrillShopper

a year ago

Thanks for facilitating even more widespread and frictionless copyright violations

e-clinton

a year ago

Wait till you hear about copy/paste

DrillShopper

a year ago

Not the same thing and not at the same scale

user

a year ago

[deleted]