Skip to content

Reinstate JRA55 multi year tests #538

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

simone-silvestri
Copy link
Collaborator

let's see if they work now... Otherwise we can fix the links here.

@navidcy
Copy link
Member

navidcy commented May 22, 2025

https://buildkite.com/clima/climaocean-ci/builds/4157#0196f83f-7b7f-4365-a261-529567e11b3b/183-644

  RequestError: Operation too slow. Less than 1 bytes/sec transferred the last 20 seconds while requesting https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/tas/gr/v20200916/tas_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_195801010000-195812312100.nc

@simone-silvestri
Copy link
Collaborator Author

Uff, at least the link now works. We can figure out here a solution.

@simone-silvestri
Copy link
Collaborator Author

simone-silvestri commented May 22, 2025

The download is extremely slow even if using the wget file downloaded from the website:

(base) simonesilvestri@Simones-MBP Downloads % bash wget_script_2025-5-21_19-14-57.sh
wget_script_2025-5-21_19-14-57.sh: line 1: /Users/simonesilvestri/Downloads/wget_script_2025-5-21_19-14-57.sh#!/bin/bash: No such file or directory
Running wget_script_2025-5-21_19-14-57.sh version: 0.4
Use wget_script_2025-5-21_19-14-57.sh -h for help.

Script created for 63 file(s)
(The count won't match if you manually edit this file!)

huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc ...Downloading
--2025-05-22 19:13:56--  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Resolving esgf-data2.llnl.gov (esgf-data2.llnl.gov)... 198.128.245.139
Connecting to esgf-data2.llnl.gov (esgf-data2.llnl.gov)|198.128.245.139|:443... connected.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:14:28--  (try: 2)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:15:01--  (try: 3)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:15:34--  (try: 4)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... ^C

We probably need to find a way to ignore the time limit of requests in julia until we find a faster server.
Or maybe find a way to use globus programmatically

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants