RAG - how accurate can it get?
Hello, I have bulidt a RAG with the following setup: Google sheet whit urls I fill in. N8n fetches pages, turn them in to md, clean with a javascript, agent 1 cleans the text, agent 2 creates key words, topics and metadata, code for chunking, openai small embedding and then it upsert to Supabase. The end result is a database with relevant info. It has apox 100 urls embedded. The content is info regarding services from the city and different volunteer organizations. I use a sandwich and vector search setup with my chatbot. Some questions are answered perfectly, but some are just bad. So my questions are; How accurate should I expect the answers to be? Should I use different supabase tables for content and contact info? Should I use openai large og voyage in stead of openai small? I run a small non profit organization and are trying to make something that is helpfull for people searching for help, but I am struggeling..