Skip to content

Instantly share code, notes, and snippets.

@rabernat
Created September 3, 2018 15:59
Show Gist options
  • Save rabernat/fd2522f1937a43f49ac0423d35915648 to your computer and use it in GitHub Desktop.
Save rabernat/fd2522f1937a43f49ac0423d35915648 to your computer and use it in GitHub Desktop.
LLC4320 Rotary Spectrum
Display the source blob
Display the rendered blob
Raw
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@apatlpo
Copy link

apatlpo commented Sep 5, 2018

Is there a particular reason for using xrft and not an apply_ufunc approach ? The latter choice would provide a template for users to adapt the code depending on the analysis they want to perform.

The use of stack and group_bybins is just brilliant ! Thanks for showing this.

For your information, Shane used 80d long time windows in his paper.

What do you mean by "full dataset is too big" when motivating subsetting? What happen if you decrease it?
Do you have a description of the dask server (memory ...)? This would be useful for comparison with hpc.

@auraoupa
Copy link

auraoupa commented Sep 5, 2018

A naïve question : what is the 'face' dimension ?

@rabernat
Copy link
Author

The 'face' dimension is related to how the LLC models grids the sphere. https://xmitgcm.readthedocs.io/en/latest/performance.html#llc-reading-strategies

@rabernat
Copy link
Author

Is there a particular reason for using xrft and not an apply_ufunc approach ? The latter choice would provide a template for users to adapt the code depending on the analysis they want to perform.

No not really. We wrote xrft so we like to use it, that's all.

What do you mean by "full dataset is too big" when motivating subsetting? What happen if you decrease it?

The dask graph becomes too big, or the tasks require too much memory.

Do you have a description of the dask server (memory ...)? This would be useful for comparison with hpc.

For this I used 100 nodes, each with 2 cores and 22 GB of memory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment