Skip to content

Commit

Permalink
Add line-break in docker run for readability
Browse files Browse the repository at this point in the history
Co-authored-by: Daniël de Kok <[email protected]>
  • Loading branch information
alvarobartt and danieldk authored Jan 9, 2025
1 parent 31822da commit e9042d3
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,8 @@ model=HuggingFaceH4/zephyr-7b-beta
# share a volume with the Docker container to avoid downloading weights every run
volume=$PWD/data

docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:3.0.0 --model-id $model
docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data \
ghcr.io/huggingface/text-generation-inference:3.0.0 --model-id $model
```

And then you can make requests like
Expand Down

0 comments on commit e9042d3

Please sign in to comment.