...
To restart a simulation one need needs to :
1) Make sure the restart files of the previous month is under ~/MODEL_EXEC_RUN/$TRUE_HOST
...
3) Edit the file 'chunk_job.log'
As you hopefully know, each simulated month consists of two scripts:
- a very short Script-job : ${GEM_exp}_S
- followed by one of more Model-jobs : ${GEM_exp}_M
To know where the simulation wasis, Chunk_lance is using a log file called 'chunk_job.log'. The chunk_job itself will check this file to determine which job to execute next. Therefore, this log file should usually not be touched.
However, to rerun part of a simulation one can alter the log file by hand. Just make sure there is never a blank line at the end of the log file 'chunk_job.log' since the chunk_job only checks the very last line of the log file!
Restart using Chunk_lance
In case a simulation stops and you want to find out which job (scripts, entry or model) crashed, you have have look in the listings directory (~/listings/${TRUE_HOST}). Check which of the following jobs has crashed:
...
'chunk_job.log' contains entries like the following:
Volet |
---|
1 simulation starting at Thu Aug 19 15:09:15 EDT 2021 1 scripts LUCAS_NAM-44_orgVeg_ISBA_197901_S finished at Thu Aug 19 15:09:36 EDT 2021 1 model LUCAS_NAM-44_orgVeg_ISBA_197901_M starting at Thu Aug 19 15:09:36 EDT 2021 1 model LUCAS_NAM-44_orgVeg_ISBA_197901_M finished at Thu Aug 19 16:04:22 EDT 2021 2 scripts LUCAS_NAM-44_orgVeg_ISBA_197902_S starting at Thu Aug 19 16:04:22 EDT 2021 2 scripts LUCAS_NAM-44_orgVeg_ISBA_197902_S finished at Thu Aug 19 16:04:26 EDT 2021 2 model LUCAS_NAM-44_orgVeg_ISBA_197902_M starting at Thu Aug 19 16:04:26 EDT 2021 2 model LUCAS_NAM-44_orgVeg_ISBA_197902_M finished at Thu Aug 19 16:52:18 EDT 2021 |
Each completed month has at least 4 entries:
Volet |
---|
..._S starting ... ..._S finished ... ..._M starting ... ..._M finished ... |
To restart a month make sure the last line either contains:
... current_month_S starting ...
or
... previous_month_M finished ..
...
.
Restart from previous restart file
...