Faiss with sqlite for RAG

#ai #rag #llm #python

Want to use faiss for Local RAG? Okay, but where to store my chunks(metadata).
Solution: Connect faiss with sqlite(or any other sql).
How: Keep vectors in faiss, data in sqlite.

Benefits:

Use faiss for vector data(what it has been made for) and sqlite for normal data(what it has been made for).
Often, you already have a database. You might only need to create an additional table or columns.
You get support for full text search in most of the database engines: be it sqlite or postgres.

Of course, you can try pgvector, but using FAISS comes with its own advantages. Ultimately, it depends upon your use case.