Self-Hosting System Requirements

​

System Configuration

​

Dependencies

• Docker v.27 or above - follow the official instructions and the post-install guide
• jq - json data parsing library
• psql - postgres command line client
• zip/unzip

​

NVIDIA GPU Setup (GPU machines only)

1. Add NVIDIA package repositories:
   curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
   curl -fsSL https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list \
     | sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#' \
     | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
   
2. Download the nvidia-container-toolkit:
   sudo apt-get update
   sudo apt-get install -y nvidia-container-toolkit
   
3. Configure Docker to use the NVIDIA runtime:
   sudo nvidia-ctk runtime configure --runtime=docker
   sudo systemctl restart docker
   
4. Verify the installation:
   docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.5-base-ubuntu20.04 nvidia-smi
   
   This should display your GPU information if the toolkit is properly installed.

​

Advised Tools for Troubleshooting/Maintenance

• vi - or equivalent required for file editing
• object store CLIs if applicable (aws cli, mc)

​

Required Permissions and Access

• Make sure you run the installation as a regular user (not a root user), with sudo privileges