How to use DeepSpeed in Kaggle? #20097

Unanswered

BrandonStudio asked this question in DDP / multi-GPU / multi-node

BrandonStudio
Jul 17, 2024

When I try to use strategy = "deepspeed", I get error

Trainer(strategy='deepspeed')` is not compatible with an interactive environment. Run your code as a script, or choose a notebook-compatible strategy: `Trainer(strategy='ddp_notebook')

Hasn't anyone tried to run a bigger PLM with Lightning in Kaggle or Colab?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment