Cortex - Enterprise Intelligence Platform
Overview
Cortex is an enterprise-grade intelligence platform that unifies traditional Business Intelligence capabilities with cutting-edge AI services. It provides a comprehensive solution for data analytics, document processing, and AI-powered insights.
Architecture
text
+===============================================================================+
| CORTEX PLATFORM |
+===================================+==========================================+
| BI PLATFORM | AI PLATFORM |
| +-------------+ | +-------------+ |
| | Superset | | | Smart Router| |
| | :8088 | | | Agent | |
| +------+------+ | +------+------+ |
| | | | |
| +-----------+-----------+ | +------------+------------+ |
| | | | | | | | |
| v v v | v v v |
| Dashboards Dremio Reports | RAG Chat Summarize Data Quality |
| (KPIs) (Self-Svc) (PDF/DOCX) | (Doc Q&A) (Extract) (Profiling) |
+===================================+==========================================+
| DATA LAYER |
| +--------+ +--------+ +--------+ +--------+ +--------+ |
| | MinIO | |Postgres| | Redis | |ChromaDB| | Neo4j | |
| |(Lake) | | (DB) | |(Queue) | |(Vector)| |(Graph) | |
| +--------+ +--------+ +--------+ +--------+ +--------+ |
+==============================================================================+Key Features
BI Platform Services
- Dashboards - Interactive KPI dashboards with real-time data visualization
- Self-Service Analytics - Ad-hoc querying and data exploration via Dremio
- Report Builder - Template-based generation in HTML, PDF, DOCX formats
AI Platform Services
- Smart Router - Automatically classify documents into 100+ categories using LLM ensemble
- RAG Chat - Query documents with context-aware AI responses
- Summarization - Extract key points, entities, and action items
- Data Quality - Automated profiling, anomaly detection, and quality scoring
Tech Stack
- Frontend - React, Vite, TailwindCSS
- Backend - FastAPI, Python
- Data Lake - MinIO (Bronze/Silver/Gold medallion architecture)
- Databases - PostgreSQL, ChromaDB (vectors), Neo4j (graph)
- BI Tools - Apache Superset, Dremio
- AI/LLM - Ollama (Qwen, Gemma models)
- Infrastructure - Docker, Redis
Quick Start
bash
# Prerequisites: Docker, Ollama with models
ollama pull qwen2.5:14b
# Clone and start
git clone https://github.com/AlharbiAbdullah/cortex
cd cortex
docker-compose up --build -d
# Access the platform
# Frontend: http://localhost:3000
# Superset: http://localhost:8088
# Dremio: http://localhost:9047