Ml Training Repositories

29 open-source ml training projects analyzed for the hidden assumptions their code never validates, plus architecture and data flow.

Repository Assumptions Language Components Stars
tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone. 8 components, C++. See how tensorflow is bui
12 C++ 8 194,783
pytorch/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration. 8 components, Python. Se
13 Python 8 99,277
hiyouga/llamafactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). 9 components, Python. See how LlamaFac
12 Python 9 70,341
karpathy/nanogpt
The simplest, fastest repository for training/finetuning medium-sized GPTs.. 9 components, Python. S
12 Python 9 56,903
oobabooga/text-generation-webui
The original local LLM interface. Text, vision, tool-calling, training, and m.... 10 components, Pyt
0 Python 10 46,385
lm-sys/fastchat
An open platform for training, serving, and evaluating large language models..... 9 components, Pyth
11 Python 9 39,452
jax-ml/jax
Composable transformations of Python+NumPy programs: differentiate, vectorize.... 10 components, Pyt
13 Python 10 35,442
facebookresearch/detectron2
Detectron2 is a platform for object detection, segmentation and other visual .... 8 components, Pyth
11 Python 8 34,331
lightning-ai/pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero co.... 8 components, Pyth
12 Python 8 31,058
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLfl.... 10 components, Pyt
10 Python 10 25,450
haotian-liu/llava
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V leve.... 8 components, Pyth
12 Python 8 24,698
karpathy/mingpt
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained .... 9 components, Pyth
13 Python 9 24,514
huggingface/trl
Train transformer language models with reinforcement learning.. 8 components, Python. See how trl is
13 Python 8 18,107
nvidia-nemo/nemo
A scalable generative AI framework built for researchers and developers worki.... 10 components, Pyt
12 Python 10 17,099
nvidia/megatron-lm
Ongoing research training transformer models at scale. 8 components, Python. See how Megatron-LM is
10 Python 8 16,102
optuna/optuna
A hyperparameter optimization framework. 10 components, Python. See how optuna is built.
13 Python 10 13,997
lightning-ai/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at sc.... 8 components, Pyth
12 Python 8 13,308
bmaltais/kohya_ss
9 components, Python. See how kohya_ss is built.
15 Python 9 12,195
axolotl-ai-cloud/axolotl
Go ahead and axolotl questions. 10 components, Python. See how axolotl is built.
11 Python 10 11,724
wandb/wandb
The AI developer platform. Use Weights & Biases to train and fine-tune models.... 10 components, Pyt
13 Python 10 11,013
apache/beam
Apache Beam is a unified programming model for Batch and Streaming data proce.... 9 components, Java
0 Java 9 8,534
eleutherai/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, base.... 10 components, Pyt
13 Python 10 7,421
flyteorg/flyte
Dynamic, resilient AI orchestration. Coordinate data, models, and compute as .... 10 components, Go.
0 Go 10 6,911
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Manag.... 10 components, Pyt
13 Python 10 6,636
mosaicml/composer
Supercharge Your Model Training. 9 components, Python. See how composer is built.
11 Python 9 5,477
zenml-io/zenml
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.. 10 components, Python. See ho
0 Python 10 5,302
determined-ai/determined
Determined is an open-source machine learning platform that simplifies distri.... 7 components, Go.
12 Go 7 3,220
microsoft/olive
Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimizati.... 10 components, Pyt
13 Python 10 2,297
bigscience-workshop/megatron-deepspeed
Ongoing research training transformer language models at scale, including: BE.... 8 components, Pyth
13 Python 8 1,437

Popular Ml Training Comparisons

Browse Other Categories

Backend Api Cli Tool Dashboard Data Pipeline Dev Tool Fullstack Library Ml Inference All Repositories

Analyze your own ml training

Paste a GitHub URL and find the assumptions hiding in your code.

Try CodeSea