Ml Inference Repositories

33 open-source ml inference projects analyzed for architecture, code patterns, and dependencies.

Repository Language Components Stars
significant-gravitas/autogpt
AutoGPT is the vision of accessible AI for everyone, to use and to build on. .... 8 components, Pyth
Python 8 183,578
ollama/ollama
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, G.... 9 components, Go.
Go 9 169,478
langflow-ai/langflow
Langflow is a powerful tool for building and deploying AI-powered agents and .... 8 components, Pyth
Python 8 147,138
langchain-ai/langchain
The agent engineering platform. 8 components, Python. See how langchain is built.
Python 8 134,112
ggml-org/llama.cpp
LLM inference in C/C++. 9 components, C++. See how llama.cpp is built.
C++ 9 105,122
instructkr/claw-code
The fastest repo in history to surpass 50K stars ⭐, reaching the milestone in.... 12 components, Rus
Rust 12 103,430
openai/whisper
Robust Speech Recognition via Large-Scale Weak Supervision. 10 components, Python. See how whisper i
Python 10 98,063
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs. 8 components, Python.
Python 8 77,364
compvis/stable-diffusion
A latent text-to-image diffusion model. 6 components, Jupyter Notebook. See how stable-diffusion is
Jupyter Notebook 6 72,910
foundationagents/metagpt
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Lang.... 10 components, Pyt
Python 10 67,258
traefik/traefik
The Cloud Native Application Proxy. 10 components, Go. See how traefik is built.
Go 10 62,418
microsoft/autogen
A programming framework for agentic AI. 8 components, Python. See how autogen is built.
Python 8 57,223
ultralytics/ultralytics
Ultralytics YOLO 🚀. 8 components, Python. See how ultralytics is built.
Python 8 56,183
flowiseai/flowise
Build AI Agents, Visually. 8 components, TypeScript. See how Flowise is built.
TypeScript 8 52,072
crewaiinc/crewai
Framework for orchestrating role-playing, autonomous AI agents. By fostering .... 8 components, Pyth
Python 8 49,277
run-llama/llama_index
LlamaIndex is the leading document agent and OCR platform. 10 components, Python. See how llama_inde
Python 10 48,694
gradio-app/gradio
Build and share delightful machine learning apps, all in Python. 🌟 Star to s.... 10 components, Pyt
Python 10 42,382
berriai/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or nat.... 10 components, Pyt
Python 10 40,426
agno-agi/agno
Build, run, manage agentic software at scale.. 10 components, Python. See how agno is built.
Python 10 39,530
mindsdb/mindsdb
Query Engine for AI Analytics: Build self-reasoning agents across all your li.... 8 components, Pyth
Python 8 39,017
stanfordnlp/dspy
DSPy: The framework for programming—not prompting—language models. 10 components, Python. See how ds
Python 10 33,832
microsoft/semantic-kernel
Integrate cutting-edge LLM technology quickly and easily into your apps. 8 components, C#. See how s
C# 8 27,745
assafelovic/gpt-researcher
An autonomous agent that conducts deep research on any data using any LLM pro.... 9 components, Pyth
Python 9 26,567
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation. 8 components, Python. See how mlc-llm is built.
Python 8 22,494
guidance-ai/guidance
A guidance language for controlling large language models.. 10 components, Jupyter Notebook. See how
Jupyter Notebook 10 21,366
microsoft/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training ac.... 9 components, C++.
C++ 9 19,901
huggingface/text-generation-inference
Large Language Model Text Generation Inference. 8 components, Python. See how text-generation-infere
Python 8 10,842
kedro-org/kedro
Kedro is a toolbox for production-ready data science. It uses software engine.... 10 components, Pyt
Python 10 10,801
bentoml/bentoml
The easiest way to serve AI apps and models - Build Model Inference APIs, Job.... 8 components, Pyth
Python 8 8,591
robinhood/faust
Python Stream Processing. 10 components, Python. See how faust is built.
Python 10 6,820
kyegomez/swarms
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. We.... 6 components, Pyth
Python 6 6,288
predibase/lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs. 6 components, Python. See how l
Python 6 3,756
neuralmagic/deepsparse
Sparsity-aware deep learning inference runtime for CPUs. 6 components, Python. See how deepsparse is
Python 6 3,163

Popular Ml Inference Comparisons

Browse Other Categories

Backend Api Cli Tool Dashboard Data Pipeline Dev Tool Fullstack Library Ml Training Nextjs App Python Ml Python Science Scientific Computing Weather Climate All Repositories

Analyze your own ml inference

Paste a GitHub URL and get architecture maps, code patterns, and dependency analysis.

Try CodeSea