A complete, production-ready LLMOps platform built with FastAPI. Features model deployment, RAG queries, vector search, professional web UI, and comprehensive monitoring.
git clone https://github.com/vijaykalore/vertexops.git
cd vertexops
python -m venv .venv
.venv\Scripts\activate # Windows
# source .venv/bin/activate # macOS/Linux
pip install -r requirements.txt
copy .env.example .env # Windows
### π³ Docker (Recommended)
```bash
# Clone and deploy with Docker
git clone https://github.com/vijaykalore/vertexops.git
cd vertexops
docker-compose up --build
Access at: http://localhost:8000
Deploy directly to your favorite platform:
# Clone the repository
git clone https://github.com/vijaykalore/vertexops.git
cd vertexops
# Setup virtual environment
python -m venv .venv
source .venv/bin/activate # Linux/Mac
# .\.venv\Scripts\activate # Windows
# Install dependencies
pip install -r requirements.txt
# Run the server
uvicorn vertexops.main:app --reload --host 127.0.0.1 --port 8083
π Full deployment guide: See DEPLOYMENT_GUIDE.md for detailed instructions
Note: the repository does not include binary screenshot image files. The screenshots/
directory previously referenced image assets that are not present in this repository. If you want to add screenshots for documentation or GitHub Pages, follow the steps in SCREENSHOTS.md
to generate and add them, then commit the image files under screenshots/
.
If you prefer not to include screenshots in the repo, you can host images externally and reference them from the README instead.
All endpoints require the x-api-key
header:
curl -X POST "http://127.0.0.1:8080/vector/add?id=doc1&text=VertexOps%20is%20awesome" \
-H "x-api-key: supersecret123"
curl -X POST "http://127.0.0.1:8080/models/deploy" \
-H "Content-Type: application/json" \
-H "x-api-key: supersecret123" \
-d '{"model_type": "custom", "config": {"version": "1.0"}}'
curl -X POST "http://127.0.0.1:8080/rag/query" \
-H "Content-Type: application/json" \
-H "x-api-key: supersecret123" \
-d '{"query": "What is VertexOps?", "top_k": 3}'
curl http://127.0.0.1:8080/metrics
docker build -t vertexops .
docker run -p 8080:8000 -e API_KEY=supersecret123 vertexops
docker-compose up -d
This MVP provides clear extension points for production use:
vertexops/
βββ π main.py # FastAPI application & routes
βββ π schemas.py # Pydantic models
βββ π auth.py # Authentication logic
βββ π€ model_service.py # Model deployment & fine-tuning
βββ ποΈ vector_store.py # In-memory vector storage
βββ π rag_service.py # RAG query processing
βββ π monitoring.py # Prometheus metrics
βββ π οΈ utils.py # Utility functions
- Fork the repository
- Create your feature branch (
git checkout -b feature/AmazingFeature
) - Commit your changes (
git commit -m 'Add some AmazingFeature'
) - Push to the branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
This project is licensed under the MIT License - see the LICENSE file for details.
β If this project helped you, please give it a star!