Haru, fully managed.
Everything below the endpoint, operated for you.
Self-hosting Haru means running its control plane: a Postgres state store, runtime supervision, and the failover machinery. Haru Cloud keeps the same architecture and takes over the operating.
Provisioning
GPU fleets come up across regions or clouds through SkyPilot placement. You describe the fleet layout; Haru Cloud sources and assembles the hardware.
Supervision
Heartbeats, VRAM verification, and synthetic probes run continuously against every model the fleet routes — not just the hosts.
Failover
The full promotion sequence — stop standby training, verify VRAM, wake vLLM, probe, flip the pointer — executes and is watched around the clock.
Same Haru. Zero ops.
Haru stays open source, and self-hosting stays a first-class path. Haru Cloud is for teams who want Haru's resilience without owning another control plane.
Self-hosted Haru
You operate it
Run the open-source control plane on your own infrastructure. Full control over the state store, the supervisor, and every placement decision. Learn about Haru.
Haru Cloud
Arkor operates it
The same fleets and failover semantics, delivered as a managed service. You bring models and traffic; provisioning, supervision, and promotion are handled for you.
Coming soon.
Haru Cloud is under active development on top of the open-source Haru core. Until it launches, you can self-host Haru today — the orchestration layer is public on GitHub.
More from the toolkit.
Code-first SDK for fine-tuning open-weight models.
Learn moreInspect and manage training runs from your browser or coding agent.
Learn moreTrain custom models on managed GPUs and use them instantly.
Learn moreServe open-weight models in your app without running inference infrastructure.
Learn moreLLM code review that catches stale comments and drifted docs.
Learn moreDistill a large model into a smaller one you can serve cheaply.
Learn moreHot failover for self-hosted LLM inference, with zero idle GPUs.
Learn moreCloud inference and training with the confidentiality of running locally.
Learn more