GPU Auto-Detection

Overview

NeuronDB automatically detects available GPUs and falls back to CPU if GPU is unavailable.

Automatic Detection

-- Check GPU status
SELECT neurondb_gpu_info();

-- Enable auto-detection (default)
SET neurondb.gpu_enabled = true;
SET neurondb.gpu_auto_detect = true;

Fallback Behavior

When GPU is unavailable, operations automatically fall back to CPU:

-- Will use GPU if available, CPU otherwise
SELECT vector_l2_distance_gpu(embedding, query) AS distance
FROM documents;

Learn More

For detailed documentation on GPU auto-detection, fallback behavior, and manual configuration, visit: GPU Auto-Detection Documentation

Related Topics

• CUDA Support - NVIDIA GPU
• ROCm Support - AMD GPU
• Metal Support - Apple Silicon