TGI (HF Inference)

AI
docker run --gpus all -p 8080:80 ghcr.io/huggingface/text-generation-inference --model-id <model>