Serve a chat-completions API from any open model
Run large language models behind a drop-in REST endpoint
Apps
Search (⌘K)
Nothing running yet
Browse a few examples to see what you could ship this afternoon.
Fine-tune an image model on your own photo set
Adapt a diffusion checkpoint with Prism and a shareable web demo
Squeeze more tokens per second
Raise throughput on batched inference jobs