GURPREETKAURJETHRA/Medical-RAG-using-Bio-Mistral-7B
📦 Open Source ProjectGURPREETKAURJETHRA
A complete open-source RAG pipeline for medical queries using BioMistral 7B and Qdrant vector database.
This repository offers a comprehensive blueprint for building a domain-specific RAG application. By utilizing BioMistral 7B, the model is optimized for medical reasoning and knowledge retrieval. The architecture integrates PubMedBERT to ensure high-quality semantic search results from medical datasets. The system uses Qdrant as the vector storage engine, providing efficient indexing and retrieval capabilities. Orchestration is handled by LangChain, while Llama CPP enables efficient local inference of the LLM. The project is designed for production readiness, featuring a FastAPI-based REST API and Docker containerization, making it an excellent reference for developers looking to deploy privacy-focused, open-source medical AI solutions.
💡Highlights
- ├─BioMistral 7B medical LLM
- ├─PubMedBERT embedding model
- └─Qdrant self-hosted vector DB
🎯For
- ├─AI Engineers
- ├─Medical Researchers
- └─Healthcare Software Developers