Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure a secure storage location for exported data #13

Open
2 of 3 tasks
eporter23 opened this issue Jan 7, 2025 · 2 comments
Open
2 of 3 tasks

Configure a secure storage location for exported data #13

eporter23 opened this issue Jan 7, 2025 · 2 comments
Assignees
Labels
Devops Routing to the Devops team

Comments

@eporter23
Copy link
Contributor

eporter23 commented Jan 7, 2025

UNC has indicated that our total storage for Emory datasets is currently ~70GB.
We want to identify a secure (non-public) location for these datasets after we export them.
We anticipate the export package may be constructed as zip files (one per dataset), and the initial use case would be to ensure service managers can access the location and download these as easily as possible.

The location should be accessible to members of the Scrum team as well as the Research Data Program Manager.

Options to discuss:

  • AWS: S3 [preferred option]
  • AWS: EFS
  • AWS: Glacier
  • OneDrive or Sharepoint

To do: determine which account to put the bucket in

  • Create a new S3 bucket in our DLP account ("emory_dataverse_backup")
  • Add intelligent tiering
  • Add Jen to the AWS account
@eporter23 eporter23 added the Devops Routing to the Devops team label Jan 7, 2025
@eporter23
Copy link
Contributor Author

Discussed using an S3 bucket, and then we can configure Cyberduck for file access.

@jcrompton42
Copy link

I have configured s3 bucket emory-dataverse-backup (underscores are forbidden characters in bucket names) and configured intelligent tiering. Files not accessed for 90 days will be moved to archive, and files not accessed for 180 days will be moved to glacier.

I need @rotated8 to add Jen to the AWS account for this ticket to be completed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Devops Routing to the Devops team
Projects
None yet
Development

No branches or pull requests

2 participants