Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DEMO NOT FOR MERGE] Adding support for NetCDF datasets in CMR #714

Closed
wants to merge 6 commits into from

Conversation

abarciauskas-bgse
Copy link
Contributor

No description provided.

@netlify
Copy link

netlify bot commented Oct 26, 2023

Deploy Preview for veda-ui ready!

Name Link
🔨 Latest commit 3390b4b
🔍 Latest deploy log https://app.netlify.com/sites/veda-ui/deploys/655e872c1691550008a883f3
😎 Deploy Preview https://deploy-preview-714--veda-ui.netlify.app/
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

);

const commonTimeseriesParams = {
isPeriodic: data['dashboard:is_periodic'],
timeDensity: data['dashboard:time_density']
isPeriodic: data['dashboard:is_periodic'] || true,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a temporary measure? Or we won't be able to get is_periodic or time_density data from zarr cmr?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we won't be able to get is_periodic or time_density from NASA's CMR STAC so we need some fallback, but I think a better way may be to make this parameter configurable in the dataset configuration page, do you think that would be straight forward to do?

? data.summaries.datetime
: data.extent.temporal.interval[0];
const lastDatetime = domain[domain.length - 1]
if (lastDatetime == null) {
domain[domain.length - 1] = new Date().toISOString()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think I understand what is going on with temporal interval. Can you explain why this step is necessary for netCDF data?

Copy link
Contributor Author

@abarciauskas-bgse abarciauskas-bgse Nov 2, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For each of these colletions, the CMR STAC record's second temporal extent is null (see GPM_3IMERGDF.v07 and TRMM_3B42_Daily.v7,

"temporal":{"interval":[["1998-01-01T00:00:00.000Z",null]]}

Copy link
Collaborator

@hanbyul-here hanbyul-here left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One more question: Did you use Zarr layer for prototype purpose? Or can netcdf and zarr actually be treated in the same way?

@abarciauskas-bgse
Copy link
Contributor Author

@hanbyul-here good question. NetCDF and zarr can be treated in the same way, the difference is that NetCDF is a single file and Zarr URL points to the entrypoint of a zarr store which is many small files representing metadata or chunks of data values or coordinate data. I could definitely imagine we may need better constructs for handling cases of Zarr vs NetCDF but I'm not sure it's necessary yet.

@abarciauskas-bgse
Copy link
Contributor Author

Closing in favor of #782

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants