fix: improve docker set up

[aeneasr]

Improves the docker set up and removes some unused files.

Closes #3914
Closes #3916
Closes #3685
Closes #3683

Related issue(s)

Checklist

• I have read the contributing guidelines.
• I have referenced an issue containing the design document if my change
  introduces a new feature.
• I am following the
  contributing code guidelines.
• I have read the security policy.
• I confirm that this pull request does not address a security
  vulnerability. If this pull request addresses a security vulnerability, I
  confirm that I got the approval (please contact
  [email protected]) from the maintainers to push
  the changes.
• I have added tests that prove my fix is effective or that my feature
  works.
• I have added or changed the documentation.

Further Comments

[CLAassistant]

All committers have signed the CLA.

[aeneasr]

@polarathene can you please sign the CLA?

[polarathene]

Sorry for the delay in engagement, I've been caught up elsewhere 😅

Thanks for tackling all of this 💪 I'll do a quick review in a moment.

[polarathene]

Bit more thorough than anticipated 😅

Hope the feedback helps.

[polarathene]

While busybox for a shell is convenient, it kinda defeats the purpose of distroless.

[aeneasr]

True - but this really is only for local dev and I do know a few people including myself who sometimes need to exec locally i to the pod to do and test something. It should also point as a warning that this isn’t a prod image

[polarathene]

Just for reference, the changes here don't completely reflect those from #3914

Notably with the sqlite path being dropped. Which as was detailed in the referenced PR would lose the ownership for the ory user if a bind mount volume was attached to the same location, requiring the user to manually adjust.

Might want to make note to document these caveats (or drop the non-root user to simplify and avoid the issue entirely).

[polarathene]

From the referenced PR this was the sqlite related snippet (useful for testing with sqlite even without a volume as DB state will still persist until container is destroyed, restarts are still valid for persistence):

# Create the sqlite directory with ownership to that user and group:
# NOTE: This is required for read/write by SQLite.
# - Path may be a default value somewhere, or only explicitly provided via DSN?
# - Owner/Group is only relevant to permissions allowing the hydra process to read/write to the location.
# - Bind mount volumes will replace the ownership with that of the host directory, requiring correction.
install --owner ory --group ory --directory /var/lib/sqlite

[aeneasr]

It works fine in my testing - other variants did not, which is why i‘ve set it up like this. But yeah, could be I missed something

[polarathene]

Closes #3914
Closes #3916
Closes #3916

Also looks like you meant to reference another issue to close, not the same one twice

[polarathene]

For context to anyone landing here:

• Unexplained revert: Revert "fix: improve docker set up" #3923
• PR remerged: fix: improve docker set up #3924