hello. I'm getting a lot of help from this community. I am grateful for it.
I was using supabase vectorstore as my go-to for youtube transcripts, rag copying people and using it as a question and answer format.
However, I was having issues with it not indexing as the chunk count was over 2300 or so.
I'm using embedding large model (3072 dimensions) and I was using index accordingly, but I was searching well in vector db normally, but when the chunk count increased, I couldn't search.
I checked the query statement and it's fine, but just in case, I tried removing 1000 chunks and it worked fine.
I'm running 2 embedding tables in my supabase project, and there is also a bug that the search is not working for each table.
So I want to move them to another VectorDev instead of supabase. I want to use something that is free and has good metadata search (in my head, qdrant looks good).
What do you guys think?