We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I just had an eval of Claude 3 Haiku create git repositories in ~ and ~/Programming. Not great.
~
~/Programming
Should figure out a way to constrain its impacts, either via Docker container or chroot or CI or something.
The text was updated successfully, but these errors were encountered:
I added a basic Dockerfile for running evals in 75deabc
Sorry, something went wrong.
Fixed now that Dockerfile.eval exists.
Dockerfile.eval
Ideally, it should prob be changed so that each eval runs in its own container (spawned by gpt-eval). But that's for another time.
No branches or pull requests
I just had an eval of Claude 3 Haiku create git repositories in
~
and~/Programming
. Not great.Should figure out a way to constrain its impacts, either via Docker container or chroot or CI or something.
The text was updated successfully, but these errors were encountered: