Deploy and fine-tune large language models on K8s

Substratus

Deploy and fine-tune large language models on K8s

Substratus is a cross-cloud substrate for training and serving ML models. It extends the Kubernetes control plane to orchestrate ML operations through the addition of custom resource definitions: Model, Server, Dataset, and Notebook.

---

Features:

• Deploy state-of-the-art ML models in minutes. We ❤️ open source LLMs.
• Fine-tune without writing code.
• Built-in serving layer compatible with OpenAI APIs.
• Run Notebooks to experiment. Ship an identical serving environment to production.

Our one-minute demo shows the basics:

Learn more at substratus.ai.

Documentation

What problems can Substratus solve? Our introduction docs break it down.

Want to get started fast? Our quickstart will have you stand up a model in minutes.

Collaborators are welcome

See the development docs to get started. Our docs directory has all the details.

Architecture

Want to learn more about how Substratus works? Our architecture documentation is a great place to dive in. We've got diagrams to spare!

---

Disclaimer: Substratus is under rapid development. We also value stability. Hang tight!

from Hacker News https://ift.tt/r3nvkUj