I’m currently building a vector database with a large amount of JSON files I need to upload, but every time I upload around 20,000 entries the pine cone Victor store just stops working and the whole execution stops
It seems to me that the pinecone node has too much items stored inside itself so it does not work functionally anymore ( Maybe it’s a Memory thing I don’t know)
I wonder if it is possible for me to purge the items inside this particular node at the end of each Loop