freshcrate

Skin:/

Language:English/简体中文

Search for

Home > RAG & Memory > awesome-opensource-ai

awesome-opensource-ai

Curated list of the best truly open-source AI projects, models, tools, and infrastructure.

agents ai artificial-intelligence awesome awesome-list generative-ai llm machine-learning python rag

Why this rank:Strong adoptionRecent releaseHealthy release cadence

Description

Curated list of the best truly open-source AI projects, models, tools, and infrastructure.

README

Awesome Open Source AI

Awesome Open Source AI

A curated list of battle-tested, production-proven open-source AI models, libraries, infrastructure, and developer tools. Only elite-tier projects make this list. Updated April 19, 2026.

_{by Boring Dystopia Development}

🌱 Emerging • Explore the List • Submission Guidelines • License

📋 Contents

🧬 1. Core Frameworks & Libraries
🧠 2. Open Foundation Models
⚡ 3. Inference Engines & Serving
🤖 4. Agentic AI & Multi-Agent Systems
🔍 5. Retrieval-Augmented Generation (RAG) & Knowledge
🎨 6. Generative Media Tools
🛠️ 7. Training & Fine-tuning Ecosystem
📊 8. MLOps / LLMOps & Production
📈 9. Evaluation, Benchmarks & Datasets
🛡️ 10. AI Safety, Alignment & Interpretability
🧩 11. Specialized Domains
🖥️ 12. User Interfaces & Self-hosted Platforms
🧪 13. Developer Tools & Integrations
📚 14. Resources & Learning

🧬 1. Core Frameworks & Libraries

Core libraries and frameworks used to build, train, and run AI and machine learning systems.

Deep Learning Frameworks

oneDNN ONNX IREE
Rust ML Frameworks

Burn Candle (Hugging Face) linfa
Julia ML Frameworks

Flux.jl MLJ.jl ModelingToolkit.jl
NLP & Transformers

spaCy (Explosion AI) Transformers (Hugging Face) sentence-transformers tokenizers (Hugging Face) fairseq2
Data Processing & Manipulation

Pandas Polars cuDF Modin Dask NumPy SciPy NetworkX cuGraph Vaex Datashader Zarr NVIDIA DALI Narwhals Ibis skrub Oxen Pandera Snorkel DuckDB FiftyOne Label Studio Delta Lake Apache Airflow Apache Spark Apache Flink Apache Beam
Classical ML & Gradient Boosting
- scikit-learn XGBoost LightGBM CatBoost sktime StatsForecast MLForecast cuML SynapseML Darts PyTorch Forecasting
  Data Labeling & Annotation
  - Label Studio FiftyOne Doccano Snorkel OpenRefine
    AutoML & Hyperparameter Optimization
    - Optuna AutoGluon FLAML Katib (Kubeflow) AutoKeras
      Interactive ML Apps & Notebooks
      - Streamlit Gradio Marimo
        Model Training & Optimization Utilities
        
        Hugging Face Accelerate DeepSpeed Transformers FlashAttention xFormers PyTorch Lightning fastai PyTorch Ignite ONNX Runtime einops safetensors torchmetrics torchao SHAP skorch Composer NVIDIA Apex
        🧠 2. Open Foundation Models
        
        Pretrained language, multimodal, speech, and video models with publicly available weights.
        
        Large Language Models (Base + Chat)
        
        RWKV-7 "Goose" (BlinkDL) Qwen3.6-Plus (Alibaba) Gemma 4 (Google) Kimi K2 (Moonshot AI) Kimi K2.5 (Moonshot AI) Phi-4 (Microsoft) GLM-5 (Zhipu AI) OLMo 2 (Allen AI) Llama 4 (Meta) GPT-OSS (OpenAI) InternLM3 (Shanghai AI Lab) Mamba (State Space Models) Pythia (EleutherAI) T5 (Google) GPT-NeoX-20B (EleutherAI)
        Coding & Reasoning Models
        
        DeepSeek-Coder-V2 / R1-Coder Qwen3-Coder-Next (Alibaba)
        Multimodal Models (Vision + Language)
        
        MMaDA (Gen-Verse) Qwen3-VL (Alibaba) GLM-4.5V / GLM-4.1V-Thinking (Zhipu AI) MiniCPM-o 2.6 Gemma 4 (Google) Magma (Microsoft) OpenCLIP
        Speech & Audio Models (TTS, STT, Music)
        
        NVIDIA NeMo Speech FunASR Whisper (OpenAI → community forks) faster-whisper (SYSTRAN) OuteTTS / CosyVoice 2 Fish Speech / StyleTTS 2 MusicGen / AudioCraft (Meta) VibeVoice (Microsoft) Qwen3-TTS (Alibaba) Chatterbox (Resemble AI) Dia (Nari Labs) Voxtral TTS (Mistral) WhisperSpeech VoxCPM F5-TTS CosyVoice ChatTTS SpeechBrain
        Video & Animation Models
        
        Open-Sora (HPC-AI Tech) CogVideoX (Zhipu AI / community) Mochi 1 (Genmo)
        Image Generation Models
        
        Stable Diffusion XL
        Additional Vision-Language Models
        
        MiniCPM-V (OpenBMB)
        ⚡ 3. Inference Engines & Serving
        
        Inference runtimes, serving systems, and optimization tools for running models locally or in production.
        
        Local / On-device Inference
        
        llama.cpp Ollama MLX MLC-LLM WebLLM llama-cpp-python KoboldCpp RamaLama LiteRT-LM
        High-performance Serving & API Servers
        
        llm-d LMDeploy vLLM LMCache vLLM Production Stack nano-vLLM SGLang TensorRT-LLM Aphrodite Engine AIBrix Triton Inference Server mistral.rs KTransformers llamafile Xinference RTP-LLM (Alibaba) LitServe (Lightning AI) LightLLM TabbyAPI GPUStack One-API OpenLLM (BentoML) Higress (Alibaba) NVIDIA Dynamo
        Additional Inference Engines
        
        CTranslate2 PowerInfer
        Quantization, Distillation & Optimization
        
        GGUF bitsandbytes ExLlamaV2 Optimum
        🤖 4. Agentic AI & Multi-Agent Systems
        
        Frameworks and platforms for building agent-based systems and multi-agent workflows.
        
        Single-Agent Frameworks
        
        LangGraph CrewAI AutoGen (AG2) DSPy Semantic Kernel smolagents LangChain Neuron AI II-Agent (Intelligent Internet) Hermes Agent (NousResearch) Agno Upsonic VoltAgent PocketFlow Agent Development Kit (Google) PydanticAI Qwen-Agent
        Multi-Agent Orchestration
        
        MetaGPT ChatDev CAMEL Swarms Mastra Deer-Flow (ByteDance) OpenAI Agents SDK Paperclip AgentScope Microsoft Agent Framework Agency Swarm elizaOS Hive (Aden) Agent Squad (AWS Labs) DeepResearchAgent BeeAI Framework (IBM) AI Town
        Autonomous Coding Agents
        
        OpenHands (ex-OpenDevin) Goose OpenCode Aider Pi (badlogic) Mistral-Vibe (Mistral) Nanocoder (Nano-Collective) Gemini CLI (Google) Archon
        Domain-Specific Agents
        
        Composio Langflow Dify OWL (camel-ai/owl) AI-Scientist-v2 (SakanaAI) PraisonAI Agent-S (Simular AI) UI-TARS Desktop (ByteDance) Browser Use Steel Browser TradingAgents Parlant
        Agent Memory & State
        
        Letta (ex-MemGPT) Mem0 Hindsight
        🔍 5. Retrieval-Augmented Generation (RAG) & Knowledge
        
        Retrieval systems, vector databases, embedding models, and related tooling for RAG pipelines.
        
        Vector Databases & Search Engines
        
        Chroma Qdrant Weaviate Milvus Faiss LanceDB Vespa pgvector Quickwit Tantivy Manticore Search OpenSearch Marqo Vald Annoy sqlite-vec
        zvec
        Embedding Models
        
        BGE (FlagEmbedding) E5 (Microsoft) FastEmbed (Qdrant) EmbedAnything Text Embeddings Inference (Hugging Face)
        Embedding Benchmarks
        
        MTEB
        RAG Frameworks & Advanced Retrieval Tools
        
        LlamaIndex Haystack RAGFlow GraphRAG (Microsoft) Docling Unstructured MinerU Marker ColPali / ColQwen LightRAG RAG-Anything LangChain4j Kernel Memory (Microsoft) txtai Infinity FlashRAG DocsGPT llmware AutoFlow rerankers (Answer.AI) KAG (OpenSPG) Chonkie PageIndex (VectifyAI) Kotaemon (Cinnamon) Reader (Jina AI)
        Knowledge Graphs for RAG
        
        Graphiti
        Web Data Ingestion
        
        Crawl4AI Lightpanda Paperless-AI Firecrawl
        Document Conversion & Preprocessing
        
        MarkItDown (Microsoft) OmniParse DocETL (UC Berkeley)
        🎨 6. Generative Media Tools
        
        Open-source models and applications for image, video, audio, and 3D generation and editing.
        
        Image Generation & Editing
        
        ComfyUI Stable Diffusion WebUI Forge - Neo Fooocus Diffusers InvokeAI PowerPaint (OpenMMLab) SD.Next Qwen-Image (Alibaba) Upscayl Z-Image (Tongyi)
        Face Swap & Deepfake
        
        Deep-Live-Cam
        Portrait Animation
        
        EchoMimic (Ant Group)
        Video Generation
        
        Wan2.2 (Alibaba) HunyuanVideo (Tencent) SkyReels V2/V3 (Skywork) Mochi 1 (Genmo) LTX-Video (Lightricks) Stable Video Diffusion (Stability AI) Latte (Vchitect) Open-Sora-Plan (PKU-YuanGroup) Open-Sora (HPC-AI Tech) Helios (PKU-YuanGroup)
        Audio / Music / Voice Generation
        
        AudioCraft / MusicGen (Meta) ACE-Step 1.5 Fish Speech CosyVoice 2 OuteTTS Amphion Stable Audio Tools GPT-SoVITS Chatterbox F5-TTS
        3D & Creative Tools
        
        Hunyuan3D-2 (Tencent) Trellis (Microsoft) gsplat (3D Gaussian Splatting tools) LichtFeld-Studio OpenSplat
        
        🛠️ 7. Training & Fine-tuning Ecosystem
        
        Tools for model training, fine-tuning, synthetic data generation, and distributed training.
        
        Full Training Frameworks
        
        Oumi LLaMA-Factory Axolotl ms-swift Unsloth LitGPT LLM Foundry torchtune kohya_ss TRL (Transformers Reinforcement Learning) verl NeMo-RL OpenRLHF LMFlow XTuner Ludwig nanoGPT (Andrej Karpathy) TorchTitan (PyTorch) VeOmni (ByteDance) H2O LLM Studio TinyZero PRIME-RL slime rLLM EasyR1 simpleRL-reason
        LoRA / PEFT Tools
        
        PEFT (Parameter-Efficient Fine-Tuning) Liger Kernel MergeKit
        Synthetic Data Generation
        
        distilabel Data-Juicer Argilla SDV (Synthetic Data Vault) DataTrove (Hugging Face) Bespoke Curator SDG (Harbin Institute)
        Distributed Training
        
        DeepSpeed Colossal-AI Megatron-LM Composer Ray Train Nanotron (Hugging Face) veScale (ByteDance) GPT-NeoX (EleutherAI) RLinf Streaming (MosaicML)
        Model Quantization & Optimization
        
        LLM Compressor (vLLM) NVIDIA Model Optimizer
        📊 8. MLOps / LLMOps & Production
        
        Tooling for tracking, deploying, monitoring, and operating AI systems in production.
        
        Experiment Tracking & Versioning
        
        MLflow DVC (Data Version Control) ClearML Weights & Biases Weave Aim Feast
        Model Hubs & Registries
        
        Civitai Hugging Face Hub OpenVINO Open Model Zoo
        Deployment & Orchestration
        
        BentoML Ray Serve ZenML Kubeflow KServe Seldon Core Metaflow Flyte Prefect Dagster Kubeflow Pipelines Argo Workflows MLRun Kestra KitOps Polyaxon Netflix Maestro HAMi NVIDIA KAI Scheduler NVIDIA DeepOps SkyPilot
        Feature Engineering & Data Preparation
        
        Featuretools Kedro
        Monitoring, Evaluation & Observability
        
        Langfuse Phoenix (Arize) Evidently Deepchecks Opik (Comet) LiteLLM OpenLIT OpenLLMetry (Traceloop) Agenta Helicone Giskard Portkey Gateway TensorZero Envoy AI Gateway
        Guardrails & Safety Tools
        
        NVIDIA NeMo Guardrails Guardrails AI LLM Guard PurpleLlama (Meta) Garak (NVIDIA) Promptfoo DeepTeam (Confident AI)
        📈 9. Evaluation, Benchmarks & Datasets
        
        Benchmarks, evaluation frameworks, datasets, and supporting tools for model assessment.
        
        Benchmark Suites
        
        LiveBench lm-evaluation-harness (EleutherAI) HELM (Stanford) SWE-bench GAIA - Real-world multi-step agentic benchmark.
        
        OpenCompass MLPerf Inference MLPerf Training VLMEvalKit MTEB Vectara Hallucination Leaderboard SWE-rebench (Nebius) - Continuously updated benchmark with 21,000+ real-world SWE tasks for evaluating agentic LLMs. Decontaminated, mined from GitHub.
        
        AgentBench (THUDM)
        Evaluation Frameworks
        
        DeepEval
        Inspect AI RAGAs Lighteval Hugging Face Evaluate OpenAI Evals LMMs-Eval FlashRAG BrowserGym TruLens OpenEvals
        High-quality Open Datasets & Data Tools
        
        Hugging Face Datasets Cleanlab FineWeb / FineWeb-2 (Hugging Face) - Curated 15T+ token web dataset for pre-training.
        
        OSWorld Great Expectations OpenThoughts
        
        🛡️ 10. AI Safety, Alignment & Interpretability
        
        Tools for alignment, interpretability, safety evaluation, and adversarial testing.
        
        Safety Evaluation Frameworks
        
        Inspect AI DeepEval Bloom
        Alignment & RLHF Tools
        
        Safe-RLHF Alignment Handbook OpenRLHF
        Interpretability & Explainability
        
        interpret (Microsoft) TransformerLens SAELens Captum SHAP XAI EasyEdit AIX360 ELI5 Shapash
        Fairness & Bias Mitigation
        
        AI Fairness 360 Fairlearn
        Adversarial & Red-teaming Tools
        
        PyRIT (Microsoft) Garak (NVIDIA) Promptfoo LLM Guard (Protect AI) Adversarial Robustness Toolbox (ART) DeepTeam (Confident AI) Agentic Security Detoxify
        Responsible AI Development
        
        Responsible AI Toolbox
        🧩 11. Specialized Domains
        
        Weather & Climate AI
        
        GraphCast
        Scientific AI & Physics ML
        
        NVIDIA Modulus TorchGeo Astropy
        Scientific AI & Drug Discovery
        
        Boltz Protenix OpenFold DeepChem
        Probabilistic Programming & Bayesian ML
        
        PyMC ArviZ Stanza
        Medical Imaging & Healthcare AI
        
        MONAI nnU-Net
        Game AI & Simulations
        
        Unity ML-Agents OpenSpiel
        Finance & Quantitative AI
        
        OpenBB FinGPT FinRL Qlib FinRobot
        Computer Vision
        
        OpenCV Ultralytics YOLO Detectron2 CVAT SAM 2 Kornia torchaudio MediaPipe
        3D Vision & Point Cloud Processing
        
        Open3D Point Cloud Library (PCL) PyTorch3D RTAB-Map MoveIt 2
        Reinforcement Learning & Robotics
        
        LeRobot (Hugging Face) Stable-Baselines3 Isaac Lab MuJoCo Gymnasium (ex-OpenAI Gym)
        Time Series & Scientific AI
        
        Time Series Library (TSLib) Chronos (Amazon) GluonTS (AWS Labs) Darts AutoTS
        Edge / On-device AI
        
        TensorFlow Lite ONNX Runtime ExecuTorch OpenVINO Apache TVM
        Legal AI & Contract Analysis
        
        OpenContracts
        Autonomous Driving & Robotics Simulators
        
        CARLA Webots Habitat-Sim NASA Astrobee OpenPilot Autoware
        
        🖥️ 12. User Interfaces & Self-hosted Platforms
        
        Local AI Chat UIs & Personal Assistants
        
        OpenClaw Open WebUI text-generation-webui LobeChat LibreChat HuggingChat (self-hosted) Khoj Newelle NextChat big-AGI
        Morphic Leon Willow CoPaw Smart2Brain Casibase
        Full Self-hosted AI Platforms
        
        AnythingLLM Dify Langflow Flowise LocalAI Onyx biniou Self-hosted AI Starter Kit (n8n) CoAI Plane RAG Web UI
        Desktop & Mobile AI Apps
        
        Jan Cherry Studio DeepChat SillyTavern ChatALL Chatbox Maid Dive PocketPal AI
        Agent & Voice Infrastructure
        
        LiveKit Agents Pipecat Agent Chat UI
        🧪 13. Developer Tools & Integrations
        
        AI-Native IDEs & Development Environments
        
        Zed Void Editor Code Server Gitpod
        AI Coding Assistants (open-source)
        
        Continue Tabby Cline Open Interpreter Roo Code Aider Refact
        Notebooks & Interactive Computing
        
        Open Notebook Deta Surf Quarto
        IDE Plugins & Extensions
        
        llama.vim CodeCompanion.nvim Continue VS Code / JetBrains ProxyAI avante.nvim vim-ai windsurf.vim Jupyter AI
        UI Components & Chat Libraries
        
        Assistant UI Deep Chat CopilotKit
        CLI Tools & API Clients
        
        PR-Agent (Qodo) Gemini CLI LLM (Simon Willison) AIChat aicommits Codex CLI Repomix Instructor Mirascope
        
        SDKs & API Development Tools
        
        Vercel AI SDK Fern
        Testing & Debugging Tools
        
        Promptfoo DeepEval Garak Phoenix (Arize)
        📚 14. Resources & Learning
        
        Papers with Open Implementations
        
        Papers with Code - Definitive database linking papers to open code and datasets.
        
        Hugging Face Papers - Daily-updated feed of the latest arXiv papers with open weights.
        
        Open LLM Leaderboard (Hugging Face) - Real-time ranking of open models.
        
        Communities, Forums & Newsletters
        
        Hugging Face Discussions - Largest open AI forum.
        
        Educational Resources & Courses
        
        Prompt Engineering Guide (DAIR-AI) Homemade Machine Learning (trekhleb) Start Machine Learning (louisfb01) r/LocalLLaMA - Go-to subreddit for local/open-source LLM topics.
        
        Courses & Interactive Playgrounds
        
        Hugging Face Course - Free hands-on courses using only open models.
        
        ML For Beginners (Microsoft) LLM Course (Maxime Labonne) AI For Beginners (Microsoft) Generative AI for Beginners (Microsoft) Fast.ai LangChain Academy - Free courses on agents and RAG.
        
        Data Science for Beginners (Microsoft) Learn PyTorch for Deep Learning (Zero to Mastery) The Incredible PyTorch Deep RL Class (Hugging Face) Practical RL (Yandex Data School) NLP Course (Yandex Data School) Large Language Model Notebooks Course Transformers Tutorials (Niels Rogge) Made With ML (Goku Mohandas) AI Engineering Hub Complete Agentic AI Engineering Course
        Starter Projects & Examples
        
        TensorFlow Tutorials Hugging Face Transformers Notebooks
        Curated Resource Lists
        
        Awesome Machine Learning Andrej Karpathy Skills
        Contributing
        
        Contributions are highly welcome! Please read the CONTRIBUTING.md for guidelines (quality standards, formatting, license requirements, etc.).
        
        Only OSI-approved licenses
        
        Projects must be actively maintained (commits in last 6 months)
        
        High-quality, well-documented, real adoption
        
        License
        
        This list itself is licensed under CC0 1.0 Universal. Feel free to use it for any purpose.
        
        Made with ❤️ for the open-source AI community. Star the repo if you find it useful - it helps more people discover the best open tools!
        
        Release History
        Version Changes Urgency Date
        main@2026-06-06 Latest activity on main branch High 6/6/2026
        0.0.0 No release found — using repo HEAD High 4/9/2026
        Dependencies & License Audit
        Loading dependencies...
        Similar Packages
        MiniSearchMinimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https://felladrin-minisearch.hf.spacemain@2026-06-05
        langgraphjsFramework to build resilient language agents as graphs.@langchain/svelte@1.0.16
        PageIndex📑 PageIndex: Document Index for Vectorless, Reasoning-based RAGmain@2026-06-02
        mem0Universal memory layer for AI Agentscli-node-v0.2.8
        Awesome-RAG-Production🚀 Build and scale reliable Retrieval-Augmented Generation (RAG) systems with this curated collection of tools, frameworks, and best practices.main@2026-05-31
        More in RAG & Memory
        vllmA high-throughput and memory-efficient inference and serving engine for LLMs
        spiceaiA portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.
        antflyNo description
        generative-ai-for-beginners21 Lessons, Get Started Building with Generative AI
        Project Info
        Author:alvinreal
        License:NOASSERTION
        Category:RAG & Memory
        Source:
        github
        Latest:main@2026-06-06
        Registered:3/24/2026
        Agent Install Card
        Install command
        uv add awesome-opensource-ai # or: pip install awesome-opensource-ai
        Agent config
        No MCP config inferred yet. Install the package, then follow the README for agent-specific setup.
        Runtime requirements
        Python / uv or pip, Python
        Auth / env
        Auth not detected from README
        Source
        github
        Verification
        Not yet verified
        Dependency Scan
        0 conflicts0 unresolved
        Audit score
        98/100
        Total deps
        0
        Scanned: 5/25/2026
        Open dependency risk map
        GitHub Stats
        ⭐2,849stars
        🍴267forks
        🔤PythonLanguage source: GitHub primary
        Links
        📁 Source Code→
        🌐 Homepage→
        Share
        X HN Reddit email