Awesome-Mirrors/cyber-security-resources
1
0
Fork 0
mirror of https://github.com/The-Art-of-Hacking/h4cker.git synced 2024-10-01 01:25:43 -04:00
Code Issues Packages Projects Releases Wiki Activity

Create vector_databases.md

Browse Source
This commit is contained in:
Omar Santos 2024-08-18 15:46:04 -04:00 committed by GitHub
parent e19bb09195
commit 196444efc5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 30 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

30
ai_research/ML_Fundamentals/vector_databases.md Normal file
View File

@ -0,0 +1,30 @@
# Introduction to Vector Databases
Vector databases are specialized systems designed to store, retrieve, and search high-dimensional vector embeddings efficiently. These databases are crucial for applications that require similarity searches, such as recommendation engines, image recognition, and natural language processing. Unlike traditional databases, vector databases handle complex relationships within data by focusing on vector proximity or similarity rather than exact matches[1][5].
### Examples of Vector Databases
1. **[FAISS (Facebook AI Similarity Search)](https://github.com/facebookresearch/faiss)**
- FAISS is a high-performance library optimized for dense vector similarity search and clustering. It uses techniques like quantization and partitioning to enhance search efficiency[1].
2. **[ChromaDB](https://www.trychroma.com/)**
- Chroma is an open-source embedding database that facilitates the creation of large language model (LLM) applications by allowing easy management of text documents and similarity searches[2].
3. **[Pinecone](https://www.pinecone.io/)**
- Pinecone is a managed vector database platform designed for high-dimensional data. It offers features like real-time data ingestion and low-latency search, making it suitable for large-scale machine learning applications[2][4].
4. **[MongoDB Atlas Vector Search](https://www.mongodb.com/products/platform/atlas-vector-search)**
- MongoDB Atlas integrates vector search capabilities with its core database, allowing for semantic search and generative AI applications. It provides a specialized vector index that can operate independently of the main database infrastructure[4][5].
5. **[Weaviate](https://weaviate.io/)**
- Weaviate is an open-source vector database that supports various AI applications, offering features like faceted search and integration with existing infrastructures[3].
6. **[Qdrant](https://qdrant.tech/)**
- Qdrant is a simple vector database known for its ease of use and a free-tier option. It is designed to handle vector data efficiently[3].
7. **[Milvus](https://milvus.io/)**
- Milvus is an open-source vector database capable of handling large-scale vector data with low latency, making it suitable for production environments[3].
These databases provide the infrastructure needed to support advanced AI and machine learning applications by enabling efficient vector storage and retrieval.
I have several examples of vector databases, RAG, RAG Fusion, RAPTOR, as well as an overview of Searchable Encryption, Homomorphic Encryption, and Multiparty Computation in AI implementations in my blog at https://becomingahacker.org