Update ESMValTool to v2.15 and reduce the size of the ESMValTool conda environment - #885
bouweandela wants to merge 7 commits into
Conversation
|
Important Draft PR not reviewedDraft PRs are not automatically reviewed by default.
To automatically review draft PRs, update your CodeRabbit configuration: reviews:
auto_review:
drafts: trueThanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Tests are failing because
|
bouweandela
changed the title
|
I'll make a PR into this branch for the ENSO and O3 fixes |
|
merged main back into this. The sea-ice diagnostic also changed |
* origin/main: chore: clean up docs chore: cleanup docs(changelog): add fragment for 896 chore(cmip7): regenerate the synthetic CMIP7 catalog fix(cmip7): derive the CMIP7 tracking_id from the instance_id refactor(cmip7): fold the extension rule into one helper refactor(cmip7): tighten the version bump after review docs(changelog): add fragment for 895 fix(cmip7): extend historical runs on every calendar fix(cmip7): bump the version of fabricated CMIP7 test data
Three recipes were renamed upstream, so the pinned registry pointed at files that no longer exist and provider setup failed with a 404. Also refreshes the sea ice sensitivity hash, which changed in the same release.
|
For the ENSO diagnostic we are missing the TROPFLUX v2 and GPCP-Monthly-3-3. We have v1 and 3.2 respectively via obs4MIPs @Darwyn72 Any ideas? I couldn't find them on CEDA. Otherwise @bouweandela could you upload them or otherwise point me to a file on levante |
@lewisjared @bouweandela the East Metagrid (CEDA) and West Metagrid (ORNL) are not mirroring each other's holdings at present, there are still technical problems. GPCP-3-3 is on West TropfluxV2 has not been processed as yet. Felicity Chun at ACCESS-NRI was looking into this. The original data providers were going to give her access to the 'sst' and 'taux' files to process with CMOR, as the original datafile is too large. She is currently on holiday, so I will have to chase her next week - I'm not sure she was even given access to the files yet - I've not heard anything. |
|
The GPCP-V3.3 data appears to have disappeared from ESGF, but I've uploaded the copy that we still had on Levante to s3://ref-obs4ref-public/ESMValTool/obs4MIPs/GPCP-V3.3. The TROPFLUX v2 data was stored in a scratch directory on Levante and has since been deleted. I suspect ACCESS NRI would still have a copy. @flicj191 or @rbeucher Would you be able to provide the data? |
|
I'm on leave until next week. @flicj191 should be able to help |
I spoke to Felicity Chun this morning and she has the CMORised files. We discussed about where to upload them. I suggested we put them on the CEDA Archive in the same folders as the current datasets. It would need the metadata sorting out on CEDA and for the files. |
@hb326 opened a PR in ESMValTool to add the corresponding recipe available to the main branch: ESMValGroup/ESMValTool#4604 |
|
@lewisjared @bouweandela, yes, I have the files that are used for the ESMValTool ENSO recipes. Do you need me to upload them somewhere specifcally or I can try to submit a delivery to the CEDA archive? I'm not sure where it would go from there. |
|
@flicj191 If you upload them to Levante and let me know where they are, I can put them in the ESMValTool OBS dataset used by the REF. |
Thanks @bouweandela ! I have copied them to |
|
Thanks @flicj191! @lewisjared I've uploaded the files and added them to the registry. I'm not sure if the old version can be removed from the registry. |
This branch has not been deployed
6 participants
Description
Use the
esmvaltool-basepackage for a smaller conda-environment (about 2.3 GB).See ESMValGroup/ESMValTool#4595 for documentation of the package.
Checklist
Please confirm that this pull request has done the following:
changelog/