Skip to content

How can I use Gpu? #21

Answered by LostRuins
Rakot321 asked this question in Q&A
Discussion options

You must be logged in to vote

This tool currently only focuses on CPU inference, you may want to check out this repo instead for GPU inference for llama: https://github.com/0cc4m/KoboldAI

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by LostRuins
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants