[Enhancement] Avoid scary error messages when waiting for nodes to be reserved
The Vagrant executable cannot be found. Please check if it is in the system path.
INFO [G5k] Submitting {'name': 'eesp-01', 'types': ['allow_classic_ssh'], 'resources': "{cluster='nova'}/nodes=1+{cluster='nova'}/nodes=3,walltime=1:00:00", 'command': g5k_api_utils.py:294
'sleep 31536000', 'queue': 'default'} on lyon
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', RemoteDisconnected('Remote connectionpool.py:812
end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', RemoteDisconnected('Remote connectionpool.py:812
end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', RemoteDisconnected('Remote connectionpool.py:812
end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:56:01] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:57:13] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:24] g5k_api_utils.py:325
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:24] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:24] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:24] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:43] g5k_api_utils.py:325
WARNING Retrying (Retry(total=4, connect=5, read=4, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection connectionpool.py:812
aborted.', RemoteDisconnected('Remote end closed connection without response'))': /stable/sites/lyon/jobs/1438700
INFO [G5k] Waiting for 1438700 on lyon [2023-01-13 15:58:43] g5k_api_utils.py:325
INFO [G5k] All jobs are Running !
Quite often the runs look like the above - As a user, this seems to indicate some kind of network error (while in fact, it seems to be completely benign as it is just querying and polling to see the status of the job)
Maybe it would be possible to capture the warning and emit it in a more friendly manner? :-)