Air-Gapped Installation

You can install GPUStack in an air-gapped environment. An air-gapped environment refers to a setup where GPUStack will be installed offline.

The following methods are available for installing GPUStack in an air-gapped environment:

OS	Arch	Supported methods
Linux	ARM64	Docker Installation

Docker Installation

Prerequisites

• Port Requirements
• CPU support for llama-box backend: ARM64 with NEON

Check if the CPU is supported:

grep -E -i "neon|asimd" /proc/cpuinfo

• NPU Driver and Firmware (Must supports CANN 8.0.0.beta1)

Check if the NPU driver is installed:

npu-smi info

• Docker

Run GPUStack

When running GPUStack with Docker, it works out of the box in an air-gapped environment as long as the Docker images are available. To do this, follow these steps:

1. Pull GPUStack docker image in an online environment:

Ascend 910BAscend 310P

docker pull gpustack/gpustack:latest-npu

docker pull gpustack/gpustack:latest-npu-310p

If your online environment differs from the air-gapped environment in terms of OS or arch, specify the OS and arch of the air-gapped environment when pulling the image:

Ascend 910BAscend 310P

docker pull --platform linux/arm64 gpustack/gpustack:latest-npu

docker pull --platform linux/arm64 gpustack/gpustack:latest-npu-310p

2. Publish docker image to a private registry or load it directly in the air-gapped environment.
3. Refer to the Docker Installation guide to run GPUStack using Docker.