TLDR Tech / Dev
Soup
Soup wraps LLM fine-tuning and post-training in one YAML file and command, with support for common training methods, local and cloud backends, evaluation, export, serving, and a web UI. Its beta layer-streaming mode trained an 8B NF4 LoRA model in 3.32 GB of GPU memory, though the published laptop throughput predates a later correctness repair.
Read the full story