How to Choose a Vector Database

Noé Achache of Theodo - Data & AI joins us to present How to Choose a Vector Database in 2023. Noé explores the evolving landscape of vector databases in the context of rising interest in LLMs and Generative AI. He offers a comparison of various vector databases, advising readers on choosing between integrated vector search tools like PGVector and knn search for existing databases versus dedicated vector databases such as Pinecone, Qdrant, Weaviate, Milvus, and ChromaDB, for cost and latency concerns. The discussion covers indexing algorithms, emphasizing HNSW and IVF, followed by an in-depth comparison of the vector databases. Finally, a practical example of using a vector database with DVC will be shown, to iterate on your vectors while using the same stack as in your production pipeline. At the end of the presentation, you should have more clarity on selecting the right vector database based on individual requirements and technical infrastructure. C.f. this article from Noé for a first taste of the talk: https://www.sicara.fr/blog-technique/... Link to slides: https://docs.google.com/presentation/... Additional content from Noé - TextBoxGan: G enerating text boxes to train OCRs with a GAN    • TextBoxGan: G enerating text boxes to trai...   Learn more about Sicara here: https://www.sicara.fr/en/ Try out the DVC Extension for VS Code here: https://marketplace.visualstudio.com/... To learn more about Iterative's open-source and SaaS tools please visit: 🧑🏽‍💻 Our free online course: https://learn.iterative.ai ✍🏼 Our docs: https://dvc.org/doc (Data Version Control, Pipelines, Experiments) https://cml.dev/doc (CI/CD for Machine Learning) https://mlem.ai/doc (Package and Serve your models) https://studio.iterative.ai (Team Collaboration, Experiments, Model Registry) Join the Community on our Discord server:   / discord   #dvc #machinelearning #datascience #generativeai