Ml Inference Repositories

31 open-source ml inference projects analyzed for the hidden assumptions their code never validates, plus architecture and data flow.

Repository Assumptions Language Components Stars
significant-gravitas/autogpt
AutoGPT is the vision of accessible AI for everyone, to use and to build on. .... 8 components, Pyth
12 Python 8 183,578
ollama/ollama
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, G.... 9 components, Go.
12 Go 9 169,478
langflow-ai/langflow
Langflow is a powerful tool for building and deploying AI-powered agents and .... 8 components, Pyth
13 Python 8 147,138
langchain-ai/langchain
The agent engineering platform. 8 components, Python. See how langchain is built.
11 Python 8 134,112
ggml-org/llama.cpp
LLM inference in C/C++. 9 components, C++. See how llama.cpp is built.
14 C++ 9 105,122
instructkr/claw-code
The fastest repo in history to surpass 50K stars ⭐, reaching the milestone in.... 12 components, Rus
0 Rust 12 103,430
openai/whisper
Robust Speech Recognition via Large-Scale Weak Supervision. 10 components, Python. See how whisper i
13 Python 10 98,063
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs. 8 components, Python.
12 Python 8 77,364
compvis/stable-diffusion
A latent text-to-image diffusion model. 6 components, Jupyter Notebook. See how stable-diffusion is
13 Jupyter Notebook 6 72,910
foundationagents/metagpt
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Lang.... 10 components, Pyt
15 Python 10 67,258
microsoft/autogen
A programming framework for agentic AI. 8 components, Python. See how autogen is built.
12 Python 8 57,223
ultralytics/ultralytics
Ultralytics YOLO 🚀. 8 components, Python. See how ultralytics is built.
13 Python 8 56,183
crewaiinc/crewai
Framework for orchestrating role-playing, autonomous AI agents. By fostering .... 8 components, Pyth
10 Python 8 55,831
flowiseai/flowise
Build AI Agents, Visually. 8 components, TypeScript. See how Flowise is built.
11 TypeScript 8 52,072
run-llama/llama_index
LlamaIndex is the leading document agent and OCR platform. 10 components, Python. See how llama_inde
12 Python 10 48,694
gradio-app/gradio
Build and share delightful machine learning apps, all in Python. 🌟 Star to s.... 10 components, Pyt
13 Python 10 42,382
agno-agi/agno
Build, run, manage agentic software at scale.. 10 components, Python. See how agno is built.
12 Python 10 39,530
mindsdb/mindsdb
Query Engine for AI Analytics: Build self-reasoning agents across all your li.... 8 components, Pyth
13 Python 8 39,017
stanfordnlp/dspy
DSPy: The framework for programming—not prompting—language models. 10 components, Python. See how ds
12 Python 10 33,832
microsoft/semantic-kernel
Integrate cutting-edge LLM technology quickly and easily into your apps. 8 components, C#. See how s
12 C# 8 27,745
assafelovic/gpt-researcher
An autonomous agent that conducts deep research on any data using any LLM pro.... 9 components, Pyth
13 Python 9 26,567
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation. 8 components, Python. See how mlc-llm is built.
10 Python 8 22,494
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training ac.... 9 components, C++.
10 C++ 9 19,901
huggingface/text-generation-inference
Large Language Model Text Generation Inference. 8 components, Python. See how text-generation-infere
10 Python 8 10,842
kedro-org/kedro
Kedro is a toolbox for production-ready data science. It uses software engine.... 10 components, Pyt
0 Python 10 10,801
bentoml/bentoml
The easiest way to serve AI apps and models - Build Model Inference APIs, Job.... 8 components, Pyth
11 Python 8 8,591
robinhood/faust
Python Stream Processing. 10 components, Python. See how faust is built.
0 Python 10 6,820
google-deepmind/graphcast
8 components, Python. See how graphcast is built.
14 Python 8 6,669
kyegomez/swarms
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. We.... 6 components, Pyth
12 Python 6 6,288
predibase/lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs. 6 components, Python. See how l
12 Python 6 3,756
neuralmagic/deepsparse
Sparsity-aware deep learning inference runtime for CPUs. 6 components, Python. See how deepsparse is
10 Python 6 3,163

Popular Ml Inference Comparisons

Browse Other Categories

Backend Api Cli Tool Dashboard Data Pipeline Dev Tool Fullstack Library Ml Training All Repositories

Analyze your own ml inference

Paste a GitHub URL and find the assumptions hiding in your code.

Try CodeSea