Show HN: Raggy – A lightweight CLI tool for RAG over local documents

4 pointsposted 5 hours ago
by paulknysh

3 Comments

paulknysh

5 hours ago

A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally. Answer generation can run either via a local LLM or remotely using an API key. raggy supports most common document formats and handles images/scans automatically via OCR.

Built this for myself, curious if others may find it useful :)

olejorgenb

4 hours ago

Cool, how does it differ from other similar tools? If you tried some out? I'm looking to start using something like this, but it's a jungle of options out there.

paulknysh

4 hours ago

Haven't done a comparison with other tools, just wanted to build something I can fully customize -- including pipeline logic, models used, etc.