You're not viewing the latest version. Click here to go to latest.
logo
GPUStack
Home
Initializing search
    GitHub
    GitHub
    • Overview
    • Quickstart
      • Installation Script
      • Docker Installation
      • Manual Installation
      • Air-Gapped Installation
      • Uninstallation
    • Upgrade
      • Playground
        • Chat
        • Image
        • Audio
        • Embedding
        • Rerank
      • Model Management
      • API Key Management
      • User Management
      • Inference Backends
      • Pinned Backend Versions
      • OpenAI Compatible APIs
      • Image Generation APIs
      • Rerank API
      • Setting Up a Multi-node GPUStack Cluster
      • Performing Distributed Inference Across Workers
      • Using Vision Language Models
      • Using Image Generation Models
      • Using Audio Models
      • Using Reranker Models
      • Inference on CPUs
      • Running Inference with Ascend NPUs
      • Running on Copilot+ PCs with Snapdragon X
      • Creating Text Embeddings
      • Inference with Function Calling
      • Running Inference with Moore Threads GPUs
    • Architecture
    • Scheduler
    • Troubleshooting
    • API Reference
      • Start
      • Chat
      • Draw
      • Download Tools

    Home