TRUSTING ORCHIDEE_4_3 at spirit/ESPRI MESO-IPSL/TGCC

Started in January 2026 at spirit, continuously running

This is a program testing the different revisions on the branch ORCHIDEE_4_3 using configuration IPSLCM7_work. Different compile options and run modes are tested offline and coupled to LMDZ. Restart files and diagnostics are compared to a reference run. Intercomparison of some runs are done.
Each line in the grey table corresponds to a specific installation of the model and all related tests. The revision number of ORCHIDEE is set in column 2 and the revsion numbers for the other compontents and tools are listed in the end of the line. The fifth column shows the reference revision which is used for comparing.
When the Status field in the third column is green and says OK it means that all tests finished well and there were no changes compared to the reference run. When the status field says DIFFER it means that all tests finished but some of the results changed. When the Status field becomes red saying FAILED their might be several reasons, read the comments in fourth column to know more. There might be some runs that are not counted for in the Status field. This will be listed below.


See here the discription of the different test cases performed at each execution of the trusting. Default set up is used if nothing else is said.
Offline => JobName Compilation Experiment Type PeriodLenght Total lenght Other LMDZOR => JobName Compilation Experiment Type Parallelization PeriodLenght Total lenght Other
O1p prod FG_CRUJRA_OD_HIST 1Y 2Y LO1p prod clim_pdControl.orch4 mpi_omp 1D 2D
O2p prod FG_CRUJRA_OD_HIST 1M 2Y LO2p prod clim_pdControl.orch4 mpi_omp 2D 2D
O3p prod FG_CRUJRA_OD_HIST 1Y 2Y Using different nubmer of cores MPI LO3p prod clim_pdControl.orch4 mpi_omp 1D 2D Using different number of cores MPI
O4p prod FG_CRUJRA_HIST 1Y 2Y LO4p prod clim_pdControl.orch4 mpi 1D 2D
O5d debug FG_CRUJRA_OD_HIST 1D 4D LO5d debug clim_pdControl.orch4 mpi_omp 1D 2D
O6d debug FG_CRUJRA_OD_HIST 2D 4D LO6d debug clim_pdControl.orch4 mpi_omp 1D 2D Using different number of cores MPI
O7d debug FG_CRUJRA_OD_HIST 2D 4D Using IOIPSL output. Deactivate routing scheme. LO7d debug clim_pdControl.orch4 mpi_omp 1D 2D Using interpolation with XIOS
O8d debug FG_CRUJRA_OD_HIST 2D 4D Using interpolation with XIOS
O9d debug FG_CRUJRA_OD_HIST 2D 4D OK_SOIL_CARBON_DISCRETIZATION=y
O10ddebug FG_CRUJRA_HIST 1D 4D ICOLMDZOR => JobName Compilation Experiment Type Parallelization PeriodLenght Total lenght Other
O11ddebug FG_CRUJRA_HIST 2D 4D DLO1p prod clim_pdControl.orch4 mpi_omp 1D 2D
O12ddebug FR_SAFRAN_HIST 2D 4D DLO2p prod clim_pdControl.orch4 mpi_omp 2D 2D
O13ddebug FG_CRUJRA_SPIN 1Y 2Y 1 pixel from global forcing file DLO3d debug clim_pdControl.orch4 mpi_omp 1D 2D
O14pprod FL_IT-MBo_PD_SPIN 1Y 2Y

Exceptions where the results are accepted

1- For cross test with LMDZ changing the number of MPI or OMP, the results are not identical at irene-amd. This is the case for the cross tests: LO1p=LO3p, LO1p=LO4p and LO5d=LO6d. These differences are not counted in the final status for the trusting.


Date branches/ORCHIDEE_4_3 revision Status Other information Reference at branches/ORCHIDEE_4_3 O1p O2p O3p O4p O5d O6d O7d O8d O9d O10d O11d O12d O13d O14p O10d = O11d (1D*4=2D*2, FG4) O1p = O2p (1Y*2=1M*24, FG2) O1p = O3p (Diff MPI, FG2) O5d = O6d (1D*4=1D*2, FG2) O6d = O7d (XIOS=IOIPSL, FG2) LO1p LO2p LO3p LO4p LO5d LO6d LO7d LO1p = LO2p (1D*2=2D*1) LO1p = LO3p (Diff MPI) LO1p = LO4p (Diff mpi_omp and mpi) LO5d = LO6d (Diff MPI) . . DLO1p DLO2p DLO3d DLO1p = DLO2p (1D*2=2D*1) IOIPSL ORCHIDEE_4 LMDZ DYNAMICO ICOSA_LMDZ XIOS IPSLCM7 libIGCM ... login host
2026-01-07T23:09 9292 OK Take as first ref XXXX Restart and diag differ. RealCpuTime=1383.880 Restart and diag differ. RealCpuTime=165.120 Restart and diag differ. RealCpuTime=1049.090 Restart and diag differ. RealCpuTime=1740.740 Restart and diag differ. RealCpuTime=77.740 Restart and diag differ. RealCpuTime=128.950 Restart and diag differ. RealCpuTime=118.000 Restart and diag differ. RealCpuTime=309.640 Restart and diag differ. RealCpuTime=215.270 Restart and diag differ. RealCpuTime=103.360 Restart and diag differ. RealCpuTime=169.820 Restart and diag differ. RealCpuTime=246.730 Restart and diag differ. RealCpuTime=273.130 Restart and diag differ. RealCpuTime=23.000 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. Restart and diag differ. RealCpuTime=194.530 Restart and diag differ. RealCpuTime=569.450 Restart and diag differ. RealCpuTime=276.580 Restart and diag differ. RealCpuTime=196.460 Restart and diag differ. RealCpuTime=1820.320 Restart and diag differ. RealCpuTime=1645.260 Restart and diag differ. RealCpuTime=1817.520 Restart OK. Restart differ err=6. Diag OK. Restart OK. Diag OK. Restart OK (with accepted err=2). Diag OK. Restart and diag differ. RealCpuTime=711.830 Restart and diag differ. RealCpuTime=1286.720 Restart and diag differ. RealCpuTime=6335.000 Restart OK (with accepted err=2). 7157 9292 5913 ICOLMDZORINCA_v7.0.1-1397-g7fae0ad 5799 2889 7445 1690 jgipsl spirit
2026-01-12T01:11 9298 DIFFER Failed for coupled runs 9292 Restart OK. Diag differ.RealCpuTime=1369.290 Restart OK. Diag differ.RealCpuTime=146.640 Restart OK. Diag differ.RealCpuTime=1287.420 Restart OK. Diag differ.RealCpuTime=1556.530 Restart OK. Diag differ.RealCpuTime=82.780 Restart OK. Diag differ.RealCpuTime=129.940 OK. RealCpuTime=74.680 Restart OK. Diag differ.RealCpuTime=328.710 Restart OK. Diag differ.RealCpuTime=203.060 Restart OK. Diag differ.RealCpuTime=83.670 Restart OK. Diag differ.RealCpuTime=148.380 Restart OK. Diag differ.RealCpuTime=283.970 Restart OK. Diag differ.RealCpuTime=285.920 Restart OK. Diag differ.RealCpuTime=23.470 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. Fatal error Fatal error Fatal error OK. RealCpuTime=298.190 Fatal error Fatal error Restart files do not exist. Error: LO1p and LO2p Error: LO1p and LO3p Error: LO1p Error: LO5d and LO6d Fatal error Fatal error Fatal error Error: DLO1p and DLO2p jgipsl spirit
2026-01-15T02:22 9317 DIFFER Failed for coupled runs. Take as new ref. 9292 Restart and diag differ. RealCpuTime=1669.830 Restart and diag differ. RealCpuTime=142.390 Restart and diag differ. RealCpuTime=1338.410 Restart and diag differ. RealCpuTime=1656.540 Restart and diag differ. RealCpuTime=140.740 Restart and diag differ. RealCpuTime=124.810 Restart and diag differ. RealCpuTime=125.420 Restart and diag differ. RealCpuTime=324.780 Restart and diag differ. RealCpuTime=178.920 Restart and diag differ. RealCpuTime=114.010 Restart and diag differ. RealCpuTime=182.640 Restart OK. Diag differ.RealCpuTime=309.440 Restart OK. Diag differ.RealCpuTime=277.610 Restart OK. Diag differ.RealCpuTime=25.300 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. Fatal error Fatal error Fatal error Restart and diag differ. RealCpuTime=344.170 No Script_Output file. Restart files do not exist. Restart files do not exist. Error: LO1p and LO2p Error: LO1p and LO3p Error: LO1p Error: LO5d and LO6d Fatal error Fatal error Fatal error Error: DLO1p and DLO2p 7157 9307 5913 ICOLMDZORINCA_v7.0.1-1397-g7fae0ad 5799 7449 1699 jgipsl spirit
2026-01-17T02:22 9327 FAILED 9317 Restart files do not exist. Fatal error OK. RealCpuTime=826.940 OK. RealCpuTime=1183.010 OK. RealCpuTime=86.540 OK. RealCpuTime=130.310 OK. RealCpuTime=117.430 OK. RealCpuTime=327.100 OK. RealCpuTime=208.440 OK. RealCpuTime=107.580 OK. RealCpuTime=172.430 OK. RealCpuTime=243.150 OK. RealCpuTime=274.930 OK. RealCpuTime=24.140 Restart OK. Error: O1p and O2p Error: O1p Restart OK. Restart OK. Fatal error Fatal error Fatal error OK. RealCpuTime=339.830 Restart files do not exist. Fatal error Fatal error Error: LO1p and LO2p Error: LO1p and LO3p Error: LO1p Error: LO5d and LO6d Fatal error Fatal error Fatal error Error: DLO1p and DLO2p 7157 9326 5913 ICOLMDZORINCA_v7.0.1-1397-g7fae0ad 5799 7449 1701 jgipsl spirit
2026-01-18T02:22 9327 FAILED 9317 Restart files do not exist. OK. RealCpuTime=159.700 OK. RealCpuTime=1124.660 OK. RealCpuTime=1695.210 OK. RealCpuTime=103.290 OK. RealCpuTime=179.590 OK. RealCpuTime=117.600 OK. RealCpuTime=342.850 OK. RealCpuTime=209.030 OK. RealCpuTime=105.220 OK. RealCpuTime=190.630 OK. RealCpuTime=249.620 OK. RealCpuTime=339.030 OK. RealCpuTime=45.180 Restart OK. Error: O1p Error: O1p Restart OK. Restart OK. Fatal error Fatal error Fatal error OK. RealCpuTime=313.390 Fatal error Fatal error Restart files do not exist. Error: LO1p and LO2p Error: LO1p and LO3p Error: LO1p Error: LO5d and LO6d Fatal error Fatal error Fatal error Error: DLO1p and DLO2p 7157 9326 5913 ICOLMDZORINCA_v7.0.1-1397-g7fae0ad 5799 7449 1701 jgipsl spirit
2026-01-20T02:22 9331 OK 9317 OK. RealCpuTime=1491.670 OK. RealCpuTime=179.830 OK. RealCpuTime=1306.880 OK. RealCpuTime=1498.000 OK. RealCpuTime=160.180 OK. RealCpuTime=126.470 OK. RealCpuTime=116.050 OK. RealCpuTime=347.180 OK. RealCpuTime=234.010 OK. RealCpuTime=92.270 OK. RealCpuTime=175.410 OK. RealCpuTime=301.250 OK. RealCpuTime=183.560 OK. RealCpuTime=23.440 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- 7157 9331 ? ? 7469 1703 jgipsl spirit
2026-01-29T02:22 9351 OK 9317 OK. RealCpuTime=1643.120 OK. RealCpuTime=165.560 OK. RealCpuTime=1197.090 OK. RealCpuTime=1543.120 OK. RealCpuTime=102.130 OK. RealCpuTime=163.530 OK. RealCpuTime=113.910 OK. RealCpuTime=298.870 OK. RealCpuTime=201.880 OK. RealCpuTime=111.850 OK. RealCpuTime=145.390 OK. RealCpuTime=285.490 OK. RealCpuTime=298.680 OK. RealCpuTime=22.760 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9350 - - - bab56c29 7472 1703 jgipsl spirit
2026-01-31T02:22 9360 OK 9317 OK. RealCpuTime=880.870 OK. RealCpuTime=145.390 OK. RealCpuTime=830.830 OK. RealCpuTime=948.360 OK. RealCpuTime=116.900 OK. RealCpuTime=123.300 OK. RealCpuTime=124.310 OK. RealCpuTime=265.450 OK. RealCpuTime=257.990 OK. RealCpuTime=56.630 OK. RealCpuTime=119.390 OK. RealCpuTime=288.660 OK. RealCpuTime=249.850 OK. RealCpuTime=25.050 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9359 - - - bab56c29 7472 1703 jgipsl spirit
2026-02-01T02:22 9361 OK 9317 OK. RealCpuTime=1643.860 OK. RealCpuTime=152.760 OK. RealCpuTime=1329.370 OK. RealCpuTime=1722.190 OK. RealCpuTime=107.960 OK. RealCpuTime=172.420 OK. RealCpuTime=110.060 OK. RealCpuTime=321.700 OK. RealCpuTime=269.330 OK. RealCpuTime=106.570 OK. RealCpuTime=180.030 OK. RealCpuTime=292.200 OK. RealCpuTime=294.360 OK. RealCpuTime=22.820 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9359 - - - bab56c29 7472 1703 jgipsl spirit
2026-02-08T02:22 9370 OK 9317 OK. RealCpuTime=1534.950 OK. RealCpuTime=152.850 OK. RealCpuTime=1313.160 OK. RealCpuTime=1654.370 OK. RealCpuTime=107.690 OK. RealCpuTime=169.790 OK. RealCpuTime=110.660 OK. RealCpuTime=314.030 OK. RealCpuTime=238.020 OK. RealCpuTime=107.100 OK. RealCpuTime=126.750 OK. RealCpuTime=292.620 OK. RealCpuTime=229.660 OK. RealCpuTime=23.090 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9359 - - - bab56c29 7472 1703 jgipsl spirit
2026-02-09T14:47 9370 FAILED 9317 Restart files do not exist. OK. RealCpuTime=171.450 OK. RealCpuTime=1265.840 OK. RealCpuTime=1643.650 OK. RealCpuTime=106.760 OK. RealCpuTime=129.130 OK. RealCpuTime=112.870 OK. RealCpuTime=328.610 OK. RealCpuTime=218.460 OK. RealCpuTime=110.910 OK. RealCpuTime=171.760 OK. RealCpuTime=257.520 OK. RealCpuTime=343.470 OK. RealCpuTime=24.030 Restart OK. Error: O1p Error: O1p Restart OK. Restart OK. Restart and diag differ. RealCpuTime=293.850 Restart and diag differ. RealCpuTime=572.510 Restart and diag differ. RealCpuTime=274.380 OK. RealCpuTime=293.900 Restart and diag differ. RealCpuTime=1834.310 Restart and diag differ. RealCpuTime=1619.690 Restart and diag differ. RealCpuTime=1815.180 Restart OK. Restart differ err=6. Diag OK. Restart OK. Diag OK. Restart differ err=6. Diag OK. Restart files do not exist. Restart and diag differ. RealCpuTime=1355.020 Restart files do not exist. Error: DLO1p 7157 9359 5913 ICOLMDZORINCA_v7.0.1-1397-g7fae0ad 5799 bab56c29 7472 1703 jgipsl spirit
2026-02-11T02:22 9375 OK 9317 OK. RealCpuTime=1519.070 OK. RealCpuTime=156.640 OK. RealCpuTime=1418.260 OK. RealCpuTime=1041.200 OK. RealCpuTime=62.030 OK. RealCpuTime=130.400 OK. RealCpuTime=125.170 OK. RealCpuTime=322.260 OK. RealCpuTime=154.040 OK. RealCpuTime=88.530 OK. RealCpuTime=102.180 OK. RealCpuTime=284.400 OK. RealCpuTime=275.900 OK. RealCpuTime=28.630 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9373 - - - bab56c29 7472 1703 jgipsl spirit
2026-02-25T02:22 9396 FAILED 9317 OK. RealCpuTime=1578.610 OK. RealCpuTime=168.930 OK. RealCpuTime=1298.160 OK. RealCpuTime=1690.580 OK. RealCpuTime=87.670 OK. RealCpuTime=142.840 OK. RealCpuTime=120.030 Fatal error OK. RealCpuTime=274.570 OK. RealCpuTime=104.890 OK. RealCpuTime=162.860 OK. RealCpuTime=338.230 OK. RealCpuTime=289.370 OK. RealCpuTime=22.680 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9394 - - - bab56c29 7472 1703 jgipsl spirit
2026-03-01T02:22 9413 OK 9317 OK. RealCpuTime=1563.590 OK. RealCpuTime=159.670 OK. RealCpuTime=1341.640 OK. RealCpuTime=1454.980 OK. RealCpuTime=106.480 OK. RealCpuTime=144.550 OK. RealCpuTime=112.950 OK. RealCpuTime=305.750 OK. RealCpuTime=195.830 OK. RealCpuTime=81.580 OK. RealCpuTime=140.490 OK. RealCpuTime=236.470 OK. RealCpuTime=255.590 OK. RealCpuTime=22.510 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9394 - - - bab56c29 7472 1703 jgipsl spirit
2026-03-08T02:22 9420 OK 9317 OK. RealCpuTime=1415.540 OK. RealCpuTime=166.230 OK. RealCpuTime=874.390 OK. RealCpuTime=1655.880 OK. RealCpuTime=57.490 OK. RealCpuTime=85.650 OK. RealCpuTime=112.410 OK. RealCpuTime=214.650 OK. RealCpuTime=123.310 OK. RealCpuTime=86.620 OK. RealCpuTime=83.340 OK. RealCpuTime=169.490 OK. RealCpuTime=249.810 OK. RealCpuTime=24.690 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. - - - - - - - --- --- --- --- - - - --- 7157 9394 - - - bab56c29 7520 1703 jgipsl spirit
2026-03-15T02:22 9424 OK 9317 OK. RealCpuTime=1675.110 OK. RealCpuTime=160.850 OK. RealCpuTime=1084.300 OK. RealCpuTime=1399.830 OK. RealCpuTime=95.240 OK. RealCpuTime=171.500 OK. RealCpuTime=113.840 OK. RealCpuTime=322.970 OK. RealCpuTime=279.920 OK. RealCpuTime=87.170 OK. RealCpuTime=132.840 OK. RealCpuTime=251.510 OK. RealCpuTime=259.770 OK. RealCpuTime=22.620 Restart OK. Restart OK. Restart OK. Restart OK. Restart OK. 7157 9394 bab56c29 7520 1703 jgipsl spirit