Skip to content
Skipping 1,062 KB.. Full Log
E       
E        [[-1.62273185  1.52964745  0.3761664  -0.50771604  1.57947835
E           0.55469002 -1.1577175   1.79986478]
E         [-0.58395162  1.71350815  0.29173991  0.22391714  0.24590882
E           1.01796553 -1.33532669  0.60011474]]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_lhs.py:62: ValueError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
__________________ test_surface_term_localized_and_cn_scaling __________________

    def test_surface_term_localized_and_cn_scaling():
        gr = setup_grid(_NG, _DZ, _DZ, _DZ * (_NZT + 1))
        rng = np.random.default_rng(11)
        dt = 60.0
        lhs_diff, lhs_ma_zt, invrs_rho_ds_zt, rho_ds_zm, u_star_sqd, wind_speed, invrs_dzt = _inputs(rng, gr)
        args = (jnp.asarray(lhs_diff), jnp.asarray(lhs_ma_zt), dt, jnp.asarray(invrs_rho_ds_zt),
                jnp.asarray(rho_ds_zm), jnp.asarray(u_star_sqd), jnp.asarray(wind_speed), gr, 0, 0)
>       base = np.asarray(windm_edsclrm_lhs(*args))
                          ^^^^^^^^^^^^^^^^^^^^^^^^
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[-1.48571919 -0.00288855  0.40599343 -1.88524397 -1.40829566
E           1.71284409 -1.7183177  -1.4809042 ]
E         [ 1.79331381  0.48753437 -0.52402751  0.04556009  0.65137181
E          -0.89876474 -1.44812771  1.15215838]]
E       
E        [[ 0.68144234  0.04952925  1.26694574  0.19630108  1.92365456
E          -1.18196215  0.21492145 -0.06550121]
E         [-0.58690058  0.36638122 -1.05879507  1.20881074  1.46933421
E          -1.48496132 -0.13170717 -0.89142043]]
E       
E        [[-1.66753201  1.58377723 -0.28020523 -1.4092348   0.69344943
E          -1.19113589  1.60572431 -1.13140697]
E         [-1.86770125 -1.19692418 -0.6170085  -0.12436735  1.62453736
E           0.78944435 -0.64271736 -1.93249114]]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_lhs.py:78: ValueError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_windm_edsclrm_lhs.xml -
============================= slowest 15 durations =============================
0.13s call     clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_lhs.py::test_lhs_matches_f90_assembly

(5 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_lhs.py::test_lhs_matches_f90_assembly - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[-0.68638201  1.52409004 -0.46602778 -0.33872706 -0.39151396
   -0.01255222  1.15885653 -1.76984869]
  [ 1.21548704 -1.55817849  1.00056251  1.14582832  1.29674442
    0.99859823  0.33629566  0.54250523]]

 [[-0.79632431  0.18724632  1.6983095  -0.9961909  -0.79230888
    0.06051654 -0.09212711 -0.80942598]
  [-0.64738986 -1.10715655  0.88700408 -0.95046203  1.54918098
    0.34532349  1.14856963  0.50961795]]

 [[-1.62273185  1.52964745  0.3761664  -0.50771604  1.57947835
    0.55469002 -1.1577175   1.79986478]
  [-0.58395162  1.71350815  0.29173991  0.22391714  0.24590882
    1.01796553 -1.33532669  0.60011474]]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_lhs.py::test_surface_term_localized_and_cn_scaling - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[-1.48571919 -0.00288855  0.40599343 -1.88524397 -1.40829566
    1.71284409 -1.7183177  -1.4809042 ]
  [ 1.79331381  0.48753437 -0.52402751  0.04556009  0.65137181
   -0.89876474 -1.44812771  1.15215838]]

 [[ 0.68144234  0.04952925  1.26694574  0.19630108  1.92365456
   -1.18196215  0.21492145 -0.06550121]
  [-0.58690058  0.36638122 -1.05879507  1.20881074  1.46933421
   -1.48496132 -0.13170717 -0.89142043]]

 [[-1.66753201  1.58377723 -0.28020523 -1.4092348   0.69344943
   -1.19113589  1.60572431 -1.13140697]
  [-1.86770125 -1.19692418 -0.6170085  -0.12436735  1.62453736
    0.78944435 -0.64271736 -1.93249114]]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
============================== 2 failed in 0.60s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_windm_edsclrm_lhs.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_windm_edsclrm_rhs.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_rhs_is_cn_explicit_half FAILED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_no_diffusion_is_pure_time_plus_tendency FAILED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_grad_finite FAILED [100%]

=================================== FAILURES ===================================
_________________________ test_rhs_is_cn_explicit_half _________________________

    def test_rhs_is_cn_explicit_half():
        rng = np.random.default_rng(545)
        dt = 60.0
        lhs_diff, xm, xm_tndcy = _inputs(rng)
>       got = np.asarray(windm_edsclrm_rhs(jnp.asarray(lhs_diff), jnp.asarray(xm), jnp.asarray(xm_tndcy), dt))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[-1.19147169  1.26627236  0.60924776  1.90165371  1.76880206
E          -1.69827121 -0.92372881 -1.84510251]
E         [-1.14636946 -1.9315875   1.87317936  0.73583607 -1.52520287
E          -1.8679437   1.12926853 -1.06671348]]
E       
E        [[-0.09825562 -0.5705109   1.92056741  1.32182048 -1.32470799
E           0.08165562 -0.31340509 -0.70146373]
E         [-1.7908162  -1.28913637 -1.6800432  -1.77181536 -0.53644832
E           1.14905894 -1.8667776  -0.13233778]]
E       
E        [[ 0.14219461 -1.08009536  1.72982352 -0.97913112  0.7923364
E          -1.25352379  0.53728725  1.57109789]
E         [-0.81325559 -0.03744118  0.21188722 -1.27103021  1.8465853
E           0.3065091   1.68759379 -0.69125656]]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py:63: ValueError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
_________________ test_no_diffusion_is_pure_time_plus_tendency _________________

    def test_no_diffusion_is_pure_time_plus_tendency():
        rng = np.random.default_rng(3)
        dt = 30.0
        _, xm, xm_tndcy = _inputs(rng)
        zero = np.zeros((3, _NG, _NZT))
>       got = np.asarray(windm_edsclrm_rhs(jnp.asarray(zero), jnp.asarray(xm), jnp.asarray(xm_tndcy), dt))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[0. 0. 0. 0. 0. 0. 0. 0.]
E         [0. 0. 0. 0. 0. 0. 0. 0.]]
E       
E        [[0. 0. 0. 0. 0. 0. 0. 0.]
E         [0. 0. 0. 0. 0. 0. 0. 0.]]
E       
E        [[0. 0. 0. 0. 0. 0. 0. 0.]
E         [0. 0. 0. 0. 0. 0. 0. 0.]]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py:75: ValueError
_______________________________ test_grad_finite _______________________________

    def test_grad_finite():
        rng = np.random.default_rng(99)
        lhs_diff, xm, xm_tndcy = _inputs(rng)
>       g = jax.grad(lambda x: jnp.sum(
            windm_edsclrm_rhs(jnp.asarray(lhs_diff), x, jnp.asarray(xm_tndcy), 60.0) ** 2))(jnp.asarray(xm))

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py:84: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

x = GradTracer(primal=[[  1.75047507   5.23945262   4.13699238   6.47505955   6.05774148
   -2.15270662 -11.08977628  -0.3...8.53077714   6.76829763   3.72878118   4.93639771
   -6.76548646 -10.19207165  -5.57322864]], typeof(tangent)=f64[2,8])

    g = jax.grad(lambda x: jnp.sum(
>       windm_edsclrm_rhs(jnp.asarray(lhs_diff), x, jnp.asarray(xm_tndcy), 60.0) ** 2))(jnp.asarray(xm))
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E   ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[ 0.0241227   0.26036653  0.04766384  1.88874549  0.45961257
E       0.27313399 -0.85285311  0.21804581]
E     [-0.1299059   0.44023203  1.72176999 -1.01645847 -0.76224665
E      -0.4356814  -0.91891307 -0.5999402 ]]
E   
E    [[ 1.74491876 -0.48846314  1.09859684 -1.83773104 -0.80537762
E       0.81036459 -0.19098952  1.55943156]
E     [-0.25959987  0.49423918  0.34151886  0.39652698  0.62274262
E       0.04512793 -1.22528099 -1.72413047]]
E   
E    [[-0.99181723 -1.61922865 -1.54748253 -0.87765667  0.37006541
E      -0.62710989  1.11139693  1.86154185]
E     [-0.67263996 -1.05486348  0.75132523  0.2906633   1.07822862
E       0.46766295 -0.88192609  1.64442527]]]. The error was:
E   TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
E   
E   --------------------
E   For simplicity, JAX has removed its internal frames from the traceback of the following exception. Set JAX_TRACEBACK_FILTERING=off to include these.

clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py:85: ValueError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_windm_edsclrm_rhs.xml -
============================= slowest 15 durations =============================
0.07s call     clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_rhs_is_cn_explicit_half
0.01s call     clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_grad_finite

(7 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_rhs_is_cn_explicit_half - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[-1.19147169  1.26627236  0.60924776  1.90165371  1.76880206
   -1.69827121 -0.92372881 -1.84510251]
  [-1.14636946 -1.9315875   1.87317936  0.73583607 -1.52520287
   -1.8679437   1.12926853 -1.06671348]]

 [[-0.09825562 -0.5705109   1.92056741  1.32182048 -1.32470799
    0.08165562 -0.31340509 -0.70146373]
  [-1.7908162  -1.28913637 -1.6800432  -1.77181536 -0.53644832
    1.14905894 -1.8667776  -0.13233778]]

 [[ 0.14219461 -1.08009536  1.72982352 -0.97913112  0.7923364
   -1.25352379  0.53728725  1.57109789]
  [-0.81325559 -0.03744118  0.21188722 -1.27103021  1.8465853
    0.3065091   1.68759379 -0.69125656]]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_no_diffusion_is_pure_time_plus_tendency - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[0. 0. 0. 0. 0. 0. 0. 0.]
  [0. 0. 0. 0. 0. 0. 0. 0.]]

 [[0. 0. 0. 0. 0. 0. 0. 0.]
  [0. 0. 0. 0. 0. 0. 0. 0.]]

 [[0. 0. 0. 0. 0. 0. 0. 0.]
  [0. 0. 0. 0. 0. 0. 0. 0.]]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_windm_edsclrm_rhs.py::test_grad_finite - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[[ 0.0241227   0.26036653  0.04766384  1.88874549  0.45961257
    0.27313399 -0.85285311  0.21804581]
  [-0.1299059   0.44023203  1.72176999 -1.01645847 -0.76224665
   -0.4356814  -0.91891307 -0.5999402 ]]

 [[ 1.74491876 -0.48846314  1.09859684 -1.83773104 -0.80537762
    0.81036459 -0.19098952  1.55943156]
  [-0.25959987  0.49423918  0.34151886  0.39652698  0.62274262
    0.04512793 -1.22528099 -1.72413047]]

 [[-0.99181723 -1.61922865 -1.54748253 -0.87765667  0.37006541
   -0.62710989  1.11139693  1.86154185]
  [-0.67263996 -1.05486348  0.75132523  0.2906633   1.07822862
    0.46766295 -0.88192609  1.64442527]]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

--------------------
For simplicity, JAX has removed its internal frames from the traceback of the following exception. Set JAX_TRACEBACK_FILTERING=off to include these.
============================== 3 failed in 0.65s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_windm_edsclrm_rhs.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 4 items

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_scalar_lhs_terms FAILED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_wp2_term_ta_lhs FAILED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_wp3_term_tp_lhs FAILED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_ac_pr2_lhs FAILED [100%]

=================================== FAILURES ===================================
____________________________ test_scalar_lhs_terms _____________________________

    def test_scalar_lhs_terms():
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        rng = np.random.default_rng(41)
        C1 = rng.uniform(0.5, 2.0, (_NG, nzm)); itau1 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
        C4 = rng.uniform(3.0, 6.0, _NG); itau4 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
        C8 = rng.uniform(3.0, 6.0, _NG); C8b = rng.uniform(0.1, 0.5, _NG)
        itau3 = rng.uniform(1e-3, 1e-2, (_NG, nzt)); Skw = rng.uniform(-3.0, 3.0, (_NG, nzt))
    
>       jd = np.asarray(wp2_term_dp1_lhs(jnp.asarray(C1), jnp.asarray(itau1)))
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wp2_term_dp1_lhs() missing 3 required positional arguments: 'gr', 'C1_Skw_fnc', and 'invrs_tau1m'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py:47: TypeError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
_____________________________ test_wp2_term_ta_lhs _____________________________

    def test_wp2_term_ta_lhs():
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        invrs_dzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(42)
        invrs_rho_ds_zm = rng.uniform(0.8, 2.0, (_NG, nzm))
        rho_ds_zt = rng.uniform(0.5, 1.2, (_NG, nzt))
>       j = np.asarray(wp2_term_ta_lhs(jnp.asarray(invrs_rho_ds_zm), jnp.asarray(rho_ds_zt), gr))
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wp2_term_ta_lhs() missing 3 required positional arguments: 'gr', 'rho_ds_zt', and 'invrs_rho_ds_zm'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py:68: TypeError
_____________________________ test_wp3_term_tp_lhs _____________________________

    def test_wp3_term_tp_lhs():
        """wp3_term_tp_lhs — 2-band turbulent-production LHS (F90:4885). Band 0 = coeff of wp2[k+1], band 1 = wp2[k]."""
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        invrs_dzt = np.asarray(gr.invrs_dzt)
        rng = np.random.default_rng(43)
        coef = rng.uniform(0.5, 2.0, _NG)
        wp2 = rng.uniform(1e-3, 2.0, (_NG, nzm)); rho_zm = rng.uniform(0.5, 1.2, (_NG, nzm))
        inv_rho_zt = rng.uniform(0.8, 2.0, (_NG, nzt))
>       j = np.asarray(wp3_term_tp_lhs(jnp.asarray(coef), jnp.asarray(wp2), jnp.asarray(rho_zm),
                                       jnp.asarray(inv_rho_zt), gr))
E       TypeError: wp3_term_tp_lhs() missing 3 required positional arguments: 'wp2', 'rho_ds_zm', and 'invrs_rho_ds_zt'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py:88: TypeError
_______________________________ test_ac_pr2_lhs ________________________________

    def test_ac_pr2_lhs():
        """wp3_terms_ac_pr2_lhs (F90:5011) and wp2_terms_ac_pr2_lhs (F90:3511) — accumulation+pr2 LHS via d(wm)/dz."""
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        idzt = np.asarray(gr.invrs_dzt); idzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(44)
        C11 = rng.uniform(0.3, 0.8, (_NG, nzt)); wm_zm = rng.uniform(-0.1, 0.1, (_NG, nzm))
        C_uu_shr = rng.uniform(0.1, 0.5, _NG); wm_zt = rng.uniform(-0.1, 0.1, (_NG, nzt))
>       j3 = np.asarray(wp3_terms_ac_pr2_lhs(jnp.asarray(C11), jnp.asarray(wm_zm), gr))
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wp3_terms_ac_pr2_lhs() missing 3 required positional arguments: 'gr', 'C11_Skw_fnc', and 'wm_zm'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py:108: TypeError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.xml -
============================= slowest 15 durations =============================
0.11s call     clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_scalar_lhs_terms
0.02s call     clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_wp3_term_tp_lhs

(10 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_scalar_lhs_terms - TypeError: wp2_term_dp1_lhs() missing 3 required positional arguments: 'gr', 'C1_Skw_fnc', and 'invrs_tau1m'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_wp2_term_ta_lhs - TypeError: wp2_term_ta_lhs() missing 3 required positional arguments: 'gr', 'rho_ds_zt', and 'invrs_rho_ds_zm'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_wp3_term_tp_lhs - TypeError: wp3_term_tp_lhs() missing 3 required positional arguments: 'wp2', 'rho_ds_zm', and 'invrs_rho_ds_zt'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py::test_ac_pr2_lhs - TypeError: wp3_terms_ac_pr2_lhs() missing 3 required positional arguments: 'gr', 'C11_Skw_fnc', and 'wm_zm'
============================== 4 failed in 0.68s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_wp2_wp3_lhs_terms.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_wp2_wp3_terms.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 4 items

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp2_bp_pr2_dp1_pr1 FAILED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp2_pr3 FAILED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp3_bp1_pr2_pr1 FAILED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_pr_dfsn_turb FAILED [100%]

=================================== FAILURES ===================================
___________________________ test_wp2_bp_pr2_dp1_pr1 ____________________________

    def test_wp2_bp_pr2_dp1_pr1():
        gr, nzm = _grid()
        rng = np.random.default_rng(31)
        C_uu_buoy = rng.uniform(0.1, 0.6, _NG)
        thv = rng.uniform(290.0, 320.0, (_NG, nzm)); wpthvp = rng.uniform(-0.05, 0.2, (_NG, nzm))
        C1 = rng.uniform(0.5, 2.0, (_NG, nzm)); itau1 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
        up2 = rng.uniform(1e-3, 2.0, (_NG, nzm)); vp2 = rng.uniform(1e-3, 2.0, (_NG, nzm))
        C4 = rng.uniform(3.0, 6.0, _NG); itau4 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
    
>       jb = np.asarray(wp2_terms_bp_pr2_rhs(jnp.asarray(C_uu_buoy), jnp.asarray(thv), jnp.asarray(wpthvp)))
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wp2_terms_bp_pr2_rhs() missing 3 required positional arguments: 'C_uu_buoy', 'thv_ds_zm', and 'wpthvp'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py:57: TypeError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
_________________________________ test_wp2_pr3 _________________________________

    def test_wp2_pr3():
        gr, nzm = _grid()
        nzt = nzm - 1
        invrs_dzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(32)
        C_uu_shr = rng.uniform(0.1, 0.5, _NG); C_uu_buoy = rng.uniform(0.1, 0.5, _NG)
        thv = rng.uniform(290.0, 320.0, (_NG, nzm)); wpthvp = rng.uniform(-0.05, 0.2, (_NG, nzm))
        upwp = rng.uniform(-0.5, 0.5, (_NG, nzm)); vpwp = rng.uniform(-0.5, 0.5, (_NG, nzm))
        um = rng.uniform(-15.0, 15.0, (_NG, nzt)); vm = rng.uniform(-15.0, 15.0, (_NG, nzt))
>       j = np.asarray(wp2_term_pr3_rhs(jnp.asarray(C_uu_shr), jnp.asarray(C_uu_buoy), jnp.asarray(thv),
                                        jnp.asarray(wpthvp), jnp.asarray(upwp), jnp.asarray(um),
                                        jnp.asarray(vpwp), jnp.asarray(vm), gr))
E       TypeError: wp2_term_pr3_rhs() missing 3 required positional arguments: 'um', 'vpwp', and 'vm'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py:79: TypeError
_____________________________ test_wp3_bp1_pr2_pr1 _____________________________

    def test_wp3_bp1_pr2_pr1():
        gr, nzm = _grid()
        nzt = nzm - 1
        rng = np.random.default_rng(33)
        C11 = rng.uniform(0.3, 0.8, (_NG, nzt)); thv_zt = rng.uniform(290.0, 320.0, (_NG, nzt))
        wp2thvp = rng.uniform(-0.1, 0.3, (_NG, nzt))
        C8 = rng.uniform(3.0, 6.0, _NG); C8b = rng.uniform(0.1, 0.5, _NG)
        itau3 = rng.uniform(1e-3, 1e-2, (_NG, nzt)); Skw = rng.uniform(-3.0, 3.0, (_NG, nzt))
        wp3 = rng.standard_normal((_NG, nzt))
>       jb = np.asarray(wp3_terms_bp1_pr2_rhs(jnp.asarray(C11), jnp.asarray(thv_zt), jnp.asarray(wp2thvp)))
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wp3_terms_bp1_pr2_rhs() missing 3 required positional arguments: 'C11_Skw_fnc', 'thv_ds_zt', and 'wp2thvp'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py:104: TypeError
______________________________ test_pr_dfsn_turb _______________________________

    def test_pr_dfsn_turb():
        """The pressure-diffusion / pressure-turbulence RHS builders (deferred from iter 494, F90-verified iter 503):
          wp2_term_pr_dfsn_rhs (F90:4229)  C·invrs_rho_ds_zm·invrs_dzm·Δ(rho_ds_zt·(wpup2+wpvp2+wp3)); lower BC = first interior
          wp3_term_pr_turb_rhs (F90:5452)  −C·invrs_rho_ds_zt·invrs_dzt·Δ(rho_ds_zm·wp2·em)   [TKE branch]
          wp3_term_pr_dfsn_rhs (F90:5564)  C·invrs_rho_ds_zt·invrs_dzt·Δ(rho_ds_zm·net), net=(wp2up2+wp2vp2+wp4)−wp2·(up2+vp2+wp2)
        """
        gr = _grid()[0]; nzm = gr.zm.shape[1]; nzt = nzm - 1
        idzm = np.asarray(gr.invrs_dzm); idzt = np.asarray(gr.invrs_dzt)
        rng = np.random.default_rng(34)
        # wp2_term_pr_dfsn_rhs
        Cw2 = rng.uniform(0.1, 0.5, _NG); rho_zt = rng.uniform(0.5, 1.2, (_NG, nzt)); irho_zm = rng.uniform(0.8, 2.0, (_NG, nzm))
        wpup2 = rng.standard_normal((_NG, nzt)); wpvp2 = rng.standard_normal((_NG, nzt)); wp3 = rng.standard_normal((_NG, nzt))
>       j2 = np.asarray(wp2_term_pr_dfsn_rhs(jnp.asarray(Cw2), jnp.asarray(rho_zt), jnp.asarray(irho_zm),
                                             jnp.asarray(wpup2), jnp.asarray(wpvp2), jnp.asarray(wp3), gr))
E       TypeError: wp2_term_pr_dfsn_rhs() missing 3 required positional arguments: 'wpup2', 'wpvp2', and 'wp3'

clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py:128: TypeError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_wp2_wp3_terms.xml -
============================= slowest 15 durations =============================
0.10s call     clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp2_bp_pr2_dp1_pr1

(11 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp2_bp_pr2_dp1_pr1 - TypeError: wp2_terms_bp_pr2_rhs() missing 3 required positional arguments: 'C_uu_buoy', 'thv_ds_zm', and 'wpthvp'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp2_pr3 - TypeError: wp2_term_pr3_rhs() missing 3 required positional arguments: 'um', 'vpwp', and 'vm'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_wp3_bp1_pr2_pr1 - TypeError: wp3_terms_bp1_pr2_rhs() missing 3 required positional arguments: 'C11_Skw_fnc', 'thv_ds_zt', and 'wp2thvp'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_wp2_wp3_terms.py::test_pr_dfsn_turb - TypeError: wp2_term_pr_dfsn_rhs() missing 3 required positional arguments: 'wpup2', 'wpvp2', and 'wp3'
============================== 4 failed in 0.61s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_wp2_wp3_terms.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_w_up_in_cloud.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_f2py_oracle PASSED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants PASSED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_differentiable PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_w_up_in_cloud.xml -
============================= slowest 15 durations =============================
1.78s call     clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_differentiable
1.09s call     clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_f2py_oracle
0.90s call     clubb_jax/pytests/auto_llm_generated_pytests/test_w_up_in_cloud.py::test_invariants

(6 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 3 passed in 4.19s ===============================
JAX pytest module: auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_matches_reference FAILED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_all_zero_is_noop FAILED [100%]

=================================== FAILURES ===================================
_________________ test_xm_correction_wpxp_cl_matches_reference _________________

    def test_xm_correction_wpxp_cl_matches_reference():
        rng = np.random.default_rng(0)
        ng, nzt = 3, 12
        nzm = nzt + 1
        xm = rng.normal(size=(ng, nzt))
        invrs_dzt = rng.uniform(0.5, 2.0, size=(ng, nzt))
        dt = 60.0
    
        wpxp_chnge = rng.normal(size=(ng, nzm)) * 1e-3      # col 0: clipping fired
        wpxp_chnge[1] = 0.0                                  # col 1: no clipping → no-op
        wpxp_chnge[2] = 0.5 * eps                            # col 2: sub-eps → gated off (no-op)
    
>       got = np.asarray(xm_correction_wpxp_cl(
            jnp.asarray(xm), jnp.asarray(wpxp_chnge), jnp.asarray(invrs_dzt), dt))
E       TypeError: xm_correction_wpxp_cl() missing 5 required positional arguments: 'dt', 'wpxp_chnge', 'invrs_dzt', 'stats', and 'xm'

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py:54: TypeError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
_________________ test_xm_correction_wpxp_cl_all_zero_is_noop __________________

    def test_xm_correction_wpxp_cl_all_zero_is_noop():
        rng = np.random.default_rng(1)
        ng, nzt = 2, 8
        xm = rng.normal(size=(ng, nzt))
        invrs_dzt = rng.uniform(0.5, 2.0, size=(ng, nzt))
>       got = np.asarray(xm_correction_wpxp_cl(
            jnp.asarray(xm), jnp.zeros((ng, nzt + 1)), jnp.asarray(invrs_dzt), 60.0))
E       TypeError: xm_correction_wpxp_cl() missing 5 required positional arguments: 'dt', 'wpxp_chnge', 'invrs_dzt', 'stats', and 'xm'

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py:71: TypeError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.xml -
============================= slowest 15 durations =============================
0.08s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_all_zero_is_noop
0.06s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_matches_reference

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_matches_reference - TypeError: xm_correction_wpxp_cl() missing 5 required positional arguments: 'dt', 'wpxp_chnge', 'invrs_dzt', 'stats', and 'xm'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py::test_xm_correction_wpxp_cl_all_zero_is_noop - TypeError: xm_correction_wpxp_cl() missing 5 required positional arguments: 'dt', 'wpxp_chnge', 'invrs_dzt', 'stats', and 'xm'
============================== 2 failed in 0.64s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_xm_correction_wpxp_cl.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_xm_wpxp_terms.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 3 items

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_xm_term_ta_lhs FAILED [ 33%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_wpxp_term_tp_lhs FAILED [ 66%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_wpxp_ac_pr1_bp FAILED [100%]

=================================== FAILURES ===================================
_____________________________ test_xm_term_ta_lhs ______________________________

    def test_xm_term_ta_lhs():
        gr, nzm, nzt = _grid()
        idzt = np.asarray(gr.invrs_dzt)
        rng = np.random.default_rng(51)
        inv_rho_zt = rng.uniform(0.8, 2.0, (_NG, nzt)); rho_zm = rng.uniform(0.5, 1.2, (_NG, nzm))
>       j = np.asarray(xm_term_ta_lhs(jnp.asarray(inv_rho_zt), jnp.asarray(rho_zm), gr))
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: xm_term_ta_lhs() missing 3 required positional arguments: 'gr', 'rho_ds_zm', and 'invrs_rho_ds_zt'

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py:50: TypeError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
____________________________ test_wpxp_term_tp_lhs _____________________________

    def test_wpxp_term_tp_lhs():
        gr, nzm, nzt = _grid()
        idzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(52)
        wp2 = rng.uniform(1e-3, 2.0, (_NG, nzm))
>       j = np.asarray(wpxp_term_tp_lhs(jnp.asarray(wp2), gr))
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wpxp_term_tp_lhs() missing 2 required positional arguments: 'gr' and 'wp2'

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py:64: TypeError
_____________________________ test_wpxp_ac_pr1_bp ______________________________

    def test_wpxp_ac_pr1_bp():
        gr, nzm, nzt = _grid()
        idzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(53)
        C7 = rng.uniform(0.3, 0.8, (_NG, nzm)); wm_zt = rng.uniform(-0.1, 0.1, (_NG, nzt))
        C6 = rng.uniform(2.0, 5.0, (_NG, nzm)); itau6 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
        thv = rng.uniform(290.0, 320.0, (_NG, nzm)); xpthvp = rng.uniform(-0.1, 0.3, (_NG, nzm))
    
>       jac = np.asarray(wpxp_terms_ac_pr2_lhs(jnp.asarray(C7), jnp.asarray(wm_zt), gr))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       TypeError: wpxp_terms_ac_pr2_lhs() missing 4 required positional arguments: 'gr', 'C7_Skw_fnc', 'wm_zt', and 'invrs_dzm'

clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py:81: TypeError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_xm_wpxp_terms.xml -
============================= slowest 15 durations =============================
0.10s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_xm_term_ta_lhs

(8 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_xm_term_ta_lhs - TypeError: xm_term_ta_lhs() missing 3 required positional arguments: 'gr', 'rho_ds_zm', and 'invrs_rho_ds_zt'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_wpxp_term_tp_lhs - TypeError: wpxp_term_tp_lhs() missing 2 required positional arguments: 'gr' and 'wp2'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xm_wpxp_terms.py::test_wpxp_ac_pr1_bp - TypeError: wpxp_terms_ac_pr2_lhs() missing 4 required positional arguments: 'gr', 'C7_Skw_fnc', 'wm_zt', and 'invrs_dzm'
============================== 3 failed in 0.63s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_xm_wpxp_terms.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_xp2_xpyp_terms.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 4 items

clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_tp_rhs FAILED [ 25%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_pr1 FAILED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_pr2 FAILED [ 75%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_dp1 FAILED [100%]

=================================== FAILURES ===================================
_______________________________ test_term_tp_rhs _______________________________

    def test_term_tp_rhs():
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        invrs_dzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(21)
        xam = rng.standard_normal((_NG, nzt)); xbm = rng.standard_normal((_NG, nzt))
        wpxap = rng.standard_normal((_NG, nzm)); wpxbp = rng.standard_normal((_NG, nzm))
>       j = np.asarray(term_tp_rhs(jnp.asarray(xam), jnp.asarray(xbm),
                                   jnp.asarray(wpxap), jnp.asarray(wpxbp), jnp.asarray(invrs_dzm)))
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[ 0.35877341  1.51067731 -1.78633124  1.68661351 -0.04731721 -0.79997858
E         -0.80295672 -1.08281652 -0.22364536  0.83388418  0.58406373  0.63828602
E         -1.69480839 -1.57096212  1.55380317  0.96888537  2.183214    1.20981583
E         -1.02439134  1.28527245  0.62839426  0.21482493 -0.81987332  0.00278022
E         -0.1469987   0.89253511  0.12449694  1.58474591 -0.77448575  0.47110256]
E        [ 0.49884238 -0.86433854 -1.18126605  1.0135795   0.51744047 -0.16250519
E          0.3943674  -0.67534403  0.2383482  -0.60512669  0.18878847  0.98608946
E         -0.33963025  0.84977381 -1.03419934 -0.28849077 -1.3647426  -0.10058609
E          0.07865408 -0.19726266 -0.26767572  1.34019469  1.42379284 -1.215631
E          1.17411449 -1.72306961 -0.73447925 -0.1734456   0.1110606  -1.04741668]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py:44: ValueError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
________________________________ test_term_pr1 _________________________________

    def test_term_pr1():
        nzm = 11
        rng = np.random.default_rng(22)
        C4 = rng.uniform(3.0, 6.0, (_NG, 1)); C14 = rng.uniform(0.5, 2.0, (_NG, 1))
        xbp2 = rng.uniform(1e-3, 2.0, (_NG, nzm)); wp2 = rng.uniform(1e-3, 2.0, (_NG, nzm))
        itau4 = rng.uniform(1e-3, 1e-2, (_NG, nzm)); itau14 = rng.uniform(1e-3, 1e-2, (_NG, nzm))
>       j = np.asarray(term_pr1(jnp.asarray(C4), jnp.asarray(C14), jnp.asarray(xbp2), jnp.asarray(wp2),
                                jnp.asarray(itau4), jnp.asarray(itau14), w_tol_sqd))
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[4.09904075]
E        [3.59788614]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py:60: ValueError
________________________________ test_term_pr2 _________________________________

    def test_term_pr2():
        gr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        nzm = gr.zm.shape[1]; nzt = nzm - 1
        invrs_dzm = np.asarray(gr.invrs_dzm)
        rng = np.random.default_rng(23)
        C_uu_shr = rng.uniform(0.1, 0.5, (_NG, 1)); C_uu_buoy = rng.uniform(0.1, 0.5, (_NG, 1))
        thv = rng.uniform(290.0, 320.0, (_NG, nzm)); wpthvp = rng.uniform(-0.05, 0.2, (_NG, nzm))
        upwp = rng.uniform(-0.5, 0.5, (_NG, nzm)); vpwp = rng.uniform(-0.5, 0.5, (_NG, nzm))
        um = rng.uniform(-15.0, 15.0, (_NG, nzt)); vm = rng.uniform(-15.0, 15.0, (_NG, nzt))
>       j = np.asarray(term_pr2(jnp.asarray(C_uu_shr), jnp.asarray(C_uu_buoy), jnp.asarray(thv),
                                jnp.asarray(wpthvp), jnp.asarray(upwp), jnp.asarray(vpwp),
                                jnp.asarray(um), jnp.asarray(vm), gr))
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[0.37757323]
E        [0.35658329]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py:80: ValueError
________________________________ test_term_dp1 _________________________________

    def test_term_dp1():
        """term_dp1_lhs (F90:5729) main-diagonal +(Cn/tau) [interior, BC 0]; term_dp1_rhs (F90:5809) explicit
        +(Cn/tau)·threshold [ALL levels incl. boundaries]. The DP1 dissipation terms missed by iter 492."""
        nzm = 11
        rng = np.random.default_rng(24)
        Cn = rng.uniform(0.1, 2.0, (_NG, nzm)); itau = rng.uniform(1e-3, 1e-2, (_NG, nzm)); thr = 1e-8
>       jl = np.asarray(term_dp1_lhs(jnp.asarray(Cn), jnp.asarray(itau)))
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[0.72751079 0.8698369  1.19200186 1.06215956 1.17200376 1.18240589
E         1.76082141 0.26421788 1.51070301 1.6586978  1.45310413]
E        [0.87885865 1.89161217 0.15880336 1.62558594 1.24389239 0.17813984
E         0.73155888 0.81871803 0.43448612 1.32094161 0.9345577 ]]. The error was:
E       TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'

clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py:104: ValueError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_xp2_xpyp_terms.xml -
============================= slowest 15 durations =============================
0.09s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_tp_rhs
0.03s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_pr1

(10 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_tp_rhs - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[ 0.35877341  1.51067731 -1.78633124  1.68661351 -0.04731721 -0.79997858
  -0.80295672 -1.08281652 -0.22364536  0.83388418  0.58406373  0.63828602
  -1.69480839 -1.57096212  1.55380317  0.96888537  2.183214    1.20981583
  -1.02439134  1.28527245  0.62839426  0.21482493 -0.81987332  0.00278022
  -0.1469987   0.89253511  0.12449694  1.58474591 -0.77448575  0.47110256]
 [ 0.49884238 -0.86433854 -1.18126605  1.0135795   0.51744047 -0.16250519
   0.3943674  -0.67534403  0.2383482  -0.60512669  0.18878847  0.98608946
  -0.33963025  0.84977381 -1.03419934 -0.28849077 -1.3647426  -0.10058609
   0.07865408 -0.19726266 -0.26767572  1.34019469  1.42379284 -1.215631
   1.17411449 -1.72306961 -0.73447925 -0.1734456   0.1110606  -1.04741668]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_pr1 - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[4.09904075]
 [3.59788614]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_pr2 - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[0.37757323]
 [0.35658329]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xp2_xpyp_terms.py::test_term_dp1 - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'jaxlib._jax.ArrayImpl'>, [[0.72751079 0.8698369  1.19200186 1.06215956 1.17200376 1.18240589
  1.76082141 0.26421788 1.51070301 1.6586978  1.45310413]
 [0.87885865 1.89161217 0.15880336 1.62558594 1.24389239 0.17813984
  0.73155888 0.81871803 0.43448612 1.32094161 0.9345577 ]]. The error was:
TypeError: unhashable type: 'jaxlib._jax.ArrayImpl'
============================== 4 failed in 0.63s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_xp2_xpyp_terms.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_f2py_oracle FAILED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_boundaries_and_grad FAILED [100%]

=================================== FAILURES ===================================
_______________________________ test_f2py_oracle _______________________________

    def test_f2py_oracle():
        try:
            import clubb_f2py
            from clubb_python import clubb_api
            from clubb_python.derived_types.err_info import ErrInfo
        except ModuleNotFoundError as e:
            if (e.name or "").split(".")[0] not in {"clubb_f2py", "clubb_python", "netCDF4"}:
                raise
            pytest.skip(f"  f2py xpyp_term_ta_*_godunov oracle: SKIP ({type(e).__name__})")
        jgr = setup_grid(ngrdcol=_NG, deltaz=_DZ, zm_init=0.0, zm_top=_ZTOP, grid_type=1)
        ng, nzm = jgr.zm.shape
        nzt = nzm - 1
        clubb_api.init_err_info(ng)
        cf = clubb_api.get_default_config_flags(); clubb_api.init_config_flags(cf)
        clubb_api.setup_grid(nzmax=nzm, ngrdcol=ng, sfc_elevation=np.zeros(ng),
                             l_implemented=False, l_ascending_grid=True, grid_type=2,
                             deltaz=np.full(ng, _DZ), zm_init=np.zeros(ng), zm_top=np.full(ng, float(jgr.zm[0, -1])),
                             momentum_heights=np.asfortranarray(np.asarray(jgr.zm)),
                             thermodynamic_heights=np.asfortranarray(np.asarray(jgr.zt)),
                             err_info=ErrInfo(ngrdcol=ng))
        # Pull the EXACT stored grid so the JAX side uses identical invrs_dzm / grid_dir.
        g = clubb_f2py.get_grid(ng, nzm, nzt)
        invrs_dzm = np.asarray(g[4]); grid_dir = float(g[13])
        shim = _GridShim(invrs_dzm=jnp.asarray(invrs_dzm))
    
        rng = np.random.default_rng(7)
        worst = 0.0
        for _ in range(3):
            coef = rng.uniform(-2, 2, (ng, nzt))                 # zt-level implicit coef (sign drives upwind split)
            irho = rng.uniform(0.5, 1.5, (ng, nzm))
            rho_zm = rng.uniform(0.5, 1.2, (ng, nzm))
            term_zm = rng.uniform(-1, 1, (ng, nzm))
            sgn = np.sign(rng.uniform(-1, 1, (ng, nzt)))         # ±1 turbulent-velocity sign
    
            f_lhs = np.asarray(clubb_f2py.f2py_xpyp_term_ta_pdf_lhs_godunov(coef, irho, rho_zm))
>           j_lhs = np.asarray(xpyp_term_ta_pdf_lhs_godunov(coef, irho, rho_zm, shim, grid_dir))
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E           ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'numpy.ndarray'>, [[ 0.50038187  1.5888552   1.10274276 -1.09917124 -0.79933486  1.49421378
E             -1.97893878  1.28491367  1.18827772 -0.12826019 -0.78787029 -0.88629755
E             -0.98052165 -0.21969478  0.01819304  0.21398941  1.98200113  1.17064768
E              0.48871692  1.95584059 -1.13876521 -1.35915186  0.45015842 -1.82423197
E             -1.85727888  0.05955528 -0.1351759   1.66867109  0.51690502  0.05647059]
E            [-0.01250626 -1.00994031 -1.9528239  -1.23039142  0.76812848 -1.1975731
E             -0.52185476 -1.98506303  1.32019092 -1.38215568 -0.92960278  1.52132862
E              0.03916324  1.38860099  0.55886867  0.96708379 -1.63401758  0.16457529
E              0.03108895  1.48535751 -0.55494376  0.39273627 -1.76299343 -0.4494728
E             -0.70785461 -1.39920108  1.26535242 -0.48221531  1.91499154  0.35996677]]. The error was:
E           TypeError: unhashable type: 'numpy.ndarray'

clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py:73: ValueError
------------------------------ Captured log call -------------------------------
WARNING  jax._src.xla_bridge:xla_bridge.py:878 An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
___________________________ test_boundaries_and_grad ___________________________

    def test_boundaries_and_grad():
        ng, nzm, nzt = 2, 10, 9
        jgr = setup_grid(ngrdcol=ng, deltaz=_DZ, zm_init=0.0, zm_top=(nzm - 1) * _DZ, grid_type=1)
        rng = np.random.default_rng(2)
        coef = rng.uniform(-2, 2, (ng, nzt)); irho = rng.uniform(0.5, 1.5, (ng, nzm))
        rho_zm = rng.uniform(0.5, 1.2, (ng, nzm)); term_zm = rng.uniform(-1, 1, (ng, nzm))
        sgn = np.sign(rng.uniform(-1, 1, (ng, nzt)))
>       lhs = np.asarray(xpyp_term_ta_pdf_lhs_godunov(coef, irho, rho_zm, jgr, jgr.grid_dir))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'numpy.ndarray'>, [[-0.95355146 -0.80603543  1.25690296 -1.63233623  0.4004021   0.91424211
E         -1.24839571 -1.77941349 -0.90012253]
E        [ 0.62973206  0.24906265 -1.39975095 -0.26947684  0.67718919 -0.30886131
E          0.5327376   1.86974381  0.73225929]]. The error was:
E       TypeError: unhashable type: 'numpy.ndarray'

clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py:88: ValueError
- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.xml -
============================= slowest 15 durations =============================
0.19s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_f2py_oracle
0.05s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_boundaries_and_grad

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
=========================== short test summary info ============================
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_f2py_oracle - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'numpy.ndarray'>, [[ 0.50038187  1.5888552   1.10274276 -1.09917124 -0.79933486  1.49421378
  -1.97893878  1.28491367  1.18827772 -0.12826019 -0.78787029 -0.88629755
  -0.98052165 -0.21969478  0.01819304  0.21398941  1.98200113  1.17064768
   0.48871692  1.95584059 -1.13876521 -1.35915186  0.45015842 -1.82423197
  -1.85727888  0.05955528 -0.1351759   1.66867109  0.51690502  0.05647059]
 [-0.01250626 -1.00994031 -1.9528239  -1.23039142  0.76812848 -1.1975731
  -0.52185476 -1.98506303  1.32019092 -1.38215568 -0.92960278  1.52132862
   0.03916324  1.38860099  0.55886867  0.96708379 -1.63401758  0.16457529
   0.03108895  1.48535751 -0.55494376  0.39273627 -1.76299343 -0.4494728
  -0.70785461 -1.39920108  1.26535242 -0.48221531  1.91499154  0.35996677]]. The error was:
TypeError: unhashable type: 'numpy.ndarray'
FAILED clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py::test_boundaries_and_grad - ValueError: Non-hashable static arguments are not supported. An error occurred while trying to hash an object of type <class 'numpy.ndarray'>, [[-0.95355146 -0.80603543  1.25690296 -1.63233623  0.4004021   0.91424211
  -1.24839571 -1.77941349 -0.90012253]
 [ 0.62973206  0.24906265 -1.39975095 -0.26947684  0.67718919 -0.30886131
   0.5327376   1.86974381  0.73225929]]. The error was:
TypeError: unhashable type: 'numpy.ndarray'
============================== 2 failed in 0.73s ===============================
JAX pytest module failed: auto_llm_generated_pytests/test_xpyp_term_ta_godunov.py (exit 1)
JAX pytest module: auto_llm_generated_pytests/test_xpyp_term_ta_pdf.py
============================= test session starts ==============================
platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0 -- /home/jenkins/workspace/clubb_jax/.venv-jax/bin/python
cachedir: .pytest_cache
rootdir: /home/jenkins/workspace/clubb_jax
collecting ... collected 2 items

clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_pdf.py::test_f2py_oracle PASSED [ 50%]
clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_pdf.py::test_differentiable PASSED [100%]

- generated xml file: /home/jenkins/workspace/clubb_jax/output/tests/pytests/jax/auto_llm_generated_pytests/test_xpyp_term_ta_pdf.xml -
============================= slowest 15 durations =============================
0.67s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_pdf.py::test_differentiable
0.54s call     clubb_jax/pytests/auto_llm_generated_pytests/test_xpyp_term_ta_pdf.py::test_f2py_oracle

(4 durations < 0.005s hidden.  Use -vv to show these durations.)
============================== 2 passed in 1.62s ===============================
JAX pytest commands: 181 modules selected, 46 module commands failed.
[Pipeline] }
ERROR: script returned exit code 1
Setting overall build result to FAILURE
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Expected failure test)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_comparison_mutation_test.py
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0
Mutation test artifacts: /home/jenkins/workspace/clubb_jax/output/tests/jax_comparison_mutation_3x_777vl
Control: running unmodified bomex comparison...
Control passed.
Mutation heating: running comparison...
PASS heating: thlm mean absolute difference 0.00015; failing columns [1, 2, 3, 4].
Mutation parameter_handling: running comparison...
PASS parameter_handling: wp3 mean absolute difference 9.25992e-07; failing columns [2, 3, 4].
Mutation first_column: running comparison...
PASS first_column: wp3 mean absolute difference 4.69019e-07; failing columns [2, 3, 4].
Mutation missing_stat: running comparison...
PASS missing_stat: wprtp absent only from JAX output; strict comparison rejected it.

==============================================================================
Expected failure test: PASS
==============================================================================
Case: bomex | 4 timesteps x 60 s | 4 columns | CPU/double
Statistics: input/stats/multi_col_stats.in
Tolerances: JAX-versus-Fortran harness defaults (absolute 1e-07; percentage 1e-07%)

[PASS] Unmodified control — JAX and Fortran matched.

[PASS] heating
  Add 1e-6 K/s of spurious heating to every column.
  Numerical difference detected; both models completed 4 timesteps.
  thlm: mean absolute difference 0.00015; mean percentage difference 4.91235e-05%
  Failing columns: 1, 2, 3, 4; first comparison failure: timestep 1.

[PASS] parameter_handling
  Load C8 as [0.2, 0.3, 0.4, 0.5] instead of [0.2, 0.4, 0.6, 0.8].
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 9.25992e-07; mean percentage difference 0.244887%
  Failing columns: 2, 3, 4; first comparison failure: timestep 1.

[PASS] first_column
  Use column 1's previous wp3 in every column's timestep equation.
  Numerical difference detected; both models completed 4 timesteps.
  wp3: mean absolute difference 4.69019e-07; mean percentage difference 0.118965%
  Failing columns: 2, 3, 4; first comparison failure: timestep 3.

[PASS] missing_stat
  Omit wprtp from JAX statistics output while keeping its calculation.
  wprtp is missing only from JAX output; both models completed 4 timesteps.
  Strict bindiff detected the missing variable; other stats were unchanged.

Result: PASS — 4/4 mutations verified | 114.2 s
Logs and outputs: /home/jenkins/workspace/clubb_jax/output/tests/jax_comparison_mutation_3x_777vl
==============================================================================
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Jax vs Fortran: standard stats)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ ./tests/run_jax_vs_fortran_cases.py -workers 8
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: case default
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 1 flag set = 23 JAX/Fortran pairs
  Flag sets:
    default
  Cases:
    arm (360 iterations)
    atex (360 iterations)
    bomex (native duration)
    cobra (360 iterations)
    dycoms2_rf01 (native duration)
    dycoms2_rf01_fixed_sst (300 iterations)
    dycoms2_rf02_nd (native duration)
    fire (native duration)
    gabls2 (360 iterations)
    gabls3_night (360 iterations)
    jun25_altocu (180 iterations)
    neutral (native duration)
    wangara (native duration)
    dycoms2_rf02_do (native duration)
    dycoms2_rf02_ds (240 iterations)
    lba_kk (360 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (380 iterations)
      - dt_main: 60 s
    lba (93 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (73 iterations)
      - percentage limit: 0.001%
    nov11_altocu (62 iterations)
      - percentage limit: 0.001%
    rico_silhs (360 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (240 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (74 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-----------------------------------------------------------------------------------------------------------------
[match         ] default                  fire                       180 / 180      255.7          5.0      272.2
[match         ] default                  dycoms2_rf01_fixed_sst     300 / 300      361.9          4.3      376.7
[match         ] default                  bomex                      360 / 360      371.7         11.3      400.6
[match         ] default                  dycoms2_rf02_nd            360 / 360      409.7          7.0      429.2
[match         ] default                  dycoms2_rf01               240 / 240      368.2         27.3      433.0
[match         ] default                  arm                        360 / 360      402.9         12.7      437.9
[match         ] default                  cobra                      360 / 360      419.9         12.6      446.6
[match         ] default                  atex                       360 / 360      408.1         19.0      454.7
[match         ] default                  gabls2                     360 / 360      177.1         28.8      213.6
[match         ] default                  gabls3_night               360 / 360      131.2          7.7      144.8
[match         ] default                  jun25_altocu               180 / 180      243.3          9.9      264.9
[match         ] default                  neutral                    360 / 360      375.9         12.4      429.2
[match         ] default                  wangara                    480 / 480      453.4         10.2      487.8
[match         ] default                  rico                       380 / 380      420.7         13.0      445.0
[match         ] default                  lba                          93 / 93      420.8          8.1      443.7
[match         ] default                  clex9_oct14                  73 / 73      299.1          6.7      316.6
[match         ] default                  dycoms2_rf02_ds            240 / 240      557.0         31.7      606.7
[match         ] default                  nov11_altocu                 62 / 62      264.6          4.7      277.2
[match         ] default                  rico_silhs                 360 / 360      202.4          8.9      216.4
[match         ] default                  lba_kk                     360 / 360      701.4         21.0      734.4
[match         ] default                  dycoms2_rf02_do            360 / 360      716.8         34.1      763.2
[match         ] default                  lba_kk_silhs               240 / 240      305.1         27.0      339.3
[match         ] default                  lba_silhs                    74 / 74      407.9         20.0      433.6

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 24m 43.8s
Results JSON: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/final_bindiff.log [passed]
[Pipeline] }
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Run Jax Python vs Fortran cases w varying flags)
[Pipeline] catchError
[Pipeline] {
[Pipeline] sh
+ source /etc/profile.d/larson-group.sh
++ export GIT_EDITOR=vi
++ GIT_EDITOR=vi
++ export SVN_EDITOR=vi
++ SVN_EDITOR=vi
++ export OMP_STACKSIZE=1048579
++ OMP_STACKSIZE=1048579
++ export LMOD_ROOT=/opt/lmod/
++ LMOD_ROOT=/opt/lmod/
++ source /opt/lmod//lmod/lmod/init/bash
+++ '[' -z '' ']'
+++ case "$-" in
+++ __lmod_vx=x
+++ '[' -n x ']'
+++ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/usr/local/spack/opt/spack/linux-pop22-cascadelake/gcc-12.2.0/lmod-8.7.37-bi3kyxcdrfgw3y7vv2k7c5rjxg75qzju/lmod/lmod/init/bash)
Shell debugging restarted
+++ unset __lmod_vx
+++ find /usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core -print -quit
++ export MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
++ MODULEPATH=/usr/local/spack/share/spack/lmod/linux-pop22-x86_64/Core
+ module load gcc netcdf-fortran
+ '[' -z '' ']'
+ case "$-" in
+ __lmod_sh_dbg=x
+ '[' -n x ']'
+ set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output
Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded:
gcc-runtime/13.1.0-gzedt3f (required by: mpich/4.2.1, hdf5/1.14.3-42x3zrv,
netcdf-c/4.9.2, netcdf-fortran/4.5.3)
-------------------------------------------------------------------------------



Shell debugging restarted
+ unset __lmod_sh_dbg
+ return 0
+ ulimit -s 8388608
+ python3 tests/run_jax_vs_fortran_cases.py -debug 0 -max_iters 5 -workers 8 -flag_config_file input/flag_sets/config_core_flags_wo_never_supported_jax_features.json
CLUBB JAX runtime:
  Environment: /home/jenkins/workspace/clubb_jax/.venv-jax (Python 3.12)
  Accelerator: cpu
  JAX: 0.11.0 (jaxlib 0.11.0)
  Device: cpu:0

Run settings:
  Output: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results
  Statistics: input/stats/standard_stats.in
  Debug: 0
  Forwarded to both runs: -debug 0 -max_iters 5
  Columns: 4
  Workers: 8
  Comparison limits: absolute 1e-07; percentage 1e-07%

Cases and flag sets:
  23 cases x 18 flag sets = 414 JAX/Fortran pairs
  Flag sets:
    default
    config_core_flags_wo_never_supported_jax_features_flag2
      - saturation_formula = 1
      - l_godunov_upwind_xpyp_ta = .true.
      - l_lh_importance_sampling = .false.
      - l_random_k_lh_start = .true.
      - l_max_overlap_in_cloud = .false.
    config_core_flags_wo_never_supported_jax_features_flag3
      - ipdf_call_placement = 1
      - l_ho_trad_coriolis = .true.
      - l_ho_nontrad_coriolis = .true.
    config_core_flags_wo_never_supported_jax_features_flag4
      - iiPDF_type = 7
    config_core_flags_wo_never_supported_jax_features_flag5
      - l_predict_upwp_vpwp = .false.
    config_core_flags_wo_never_supported_jax_features_flag6
      - l_wp2_fill_holes_tke = .false.
      - l_enable_relaxed_clipping = .true.
      - l_min_xp2_from_corr_wx = .false.
      - l_add_dycore_grid = .true.
      - l_lh_straight_mc = .true.
    config_core_flags_wo_never_supported_jax_features_flag7
      - l_diag_Lscale_from_tau = .true.
      - fill_holes_type = 3
    config_core_flags_wo_never_supported_jax_features_flag8
      - l_upwind_xpyp_ta = .false.
      - l_upwind_xm_ma = .false.
      - l_lh_clustered_sampling = .false.
      - l_lh_instant_var_covar_src = .false.
      - l_lh_limit_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag9
      - l_min_wp2_from_corr_wx = .true.
      - l_stability_correct_tau_zm = .true.
      - l_damp_wp2_using_em = .false.
      - l_use_C7_Richardson = .false.
    config_core_flags_wo_never_supported_jax_features_flag10
      - l_vert_avg_closure = .true.
      - l_use_cloud_cover = .true.
      - l_damp_wp3_Skw_squared = .false.
      - l_use_C11_Richardson = .true.
      - l_rcm_in_cloud_k_lh_start = .false.
    config_core_flags_wo_never_supported_jax_features_flag11
      - l_rcm_supersat_adj = .false.
      - l_C2_cloud_frac = .true.
      - l_use_precip_frac = .false.
      - l_do_expldiff_rtm_thlm = .true.
      - l_use_shear_Richardson = .true.
    config_core_flags_wo_never_supported_jax_features_flag12
      - l_prescribed_avg_deltaz = .true.
      - l_stability_correct_Kh_N2_zm = .true.
      - l_trapezoidal_rule_zt = .true.
      - l_trapezoidal_rule_zm = .true.
      - l_call_pdf_closure_twice = .true.
    config_core_flags_wo_never_supported_jax_features_flag13
      - l_brunt_vaisala_freq_moist = .true.
      - l_use_thvm_in_bv_freq = .true.
      - l_lmm_stepping = .true.
      - l_vary_convect_depth = .true.
    config_core_flags_wo_never_supported_jax_features_flag14
      - l_use_tke_in_wp3_pr_turb_term = .false.
      - l_use_tke_in_wp2_wp3_K_dfsn = .true.
      - l_use_wp3_lim_with_smth_Heaviside = .true.
      - l_smooth_Heaviside_tau_wpxp = .false.
      - l_modify_limiters_for_cnvg_test = .true.
    config_core_flags_wo_never_supported_jax_features_flag15
      - l_mono_flux_lim_rtm = .false.
      - l_mono_flux_lim_um = .false.
      - l_mono_flux_lim_vm = .false.
      - l_mono_flux_lim_spikefix = .false.
    config_core_flags_wo_never_supported_jax_features_flag16
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .false.
      - l_lh_var_frac = .true.
    config_core_flags_wo_never_supported_jax_features_flag17
      - l_standard_term_ta = .true.
      - l_partial_upwind_wp3 = .true.
      - l_lh_normalize_weights = .false.
    config_core_flags_wo_never_supported_jax_features_flag18
      - ipdf_call_placement = 3
  Cases:
    arm (5 iterations)
    atex (5 iterations)
    bomex (5 iterations)
    cobra (5 iterations)
    dycoms2_rf01 (5 iterations)
    dycoms2_rf01_fixed_sst (5 iterations)
    dycoms2_rf02_nd (5 iterations)
    fire (5 iterations)
    gabls2 (5 iterations)
    gabls3_night (5 iterations)
    jun25_altocu (5 iterations)
    neutral (5 iterations)
    wangara (5 iterations)
    dycoms2_rf02_do (5 iterations)
    dycoms2_rf02_ds (5 iterations)
    lba_kk (5 iterations)
      - input case: lba
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "disabled"
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
    rico (5 iterations)
      - dt_main: 60 s
    lba (5 iterations)
      - percentage limit: 0.001%
      - microphysics_setting.lh_microphys_type = "disabled"
    clex9_oct14 (5 iterations)
      - percentage limit: 0.001%
    nov11_altocu (5 iterations)
      - percentage limit: 0.001%
    rico_silhs (5 iterations)
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_kk_silhs (5 iterations)
      - input case: lba
      - dt_main: 60 s
      - microphysics_setting.microphys_scheme = "khairoutdinov_kogan"
      - microphysics_setting.lh_microphys_type = "interactive"
      - microphysics_setting.l_local_kk = .true.
      - microphysics_setting.l_ice_microphys = .false.
      - microphysics_setting.l_graupel = .false.
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.
    lba_silhs (5 iterations)
      - percentage limit: 0.001%
      - input case: lba
      - dt_main: 60 s
      - configurable_silhs_flags_nl.l_lh_deterministic_test = .true.
      - configurable_silhs_flags_nl.l_lh_importance_sampling = .false.
      - configurable_silhs_flags_nl.l_random_k_lh_start = .false.

[Status        ] Flag set                                                 Case                       Timesteps    JAX (s)  Fortran (s)  Total (s)
-------------------------------------------------------------------------------------------------------------------------------------------------
[match         ] default                                                  arm                            5 / 5       81.8          1.1       86.1
[match         ] default                                                  dycoms2_rf01_fixed_sst         5 / 5       81.4          1.2       86.2
[match         ] default                                                  bomex                          5 / 5       84.0          1.0       88.8
[match         ] default                                                  fire                           5 / 5       84.4          1.0       89.3
[match         ] default                                                  dycoms2_rf01                   5 / 5       85.1          1.5       90.3
[match         ] default                                                  dycoms2_rf02_nd                5 / 5       85.5          1.7       90.4
[match         ] default                                                  atex                           5 / 5       85.5          1.7       91.2
[match         ] default                                                  cobra                          5 / 5       87.7          1.1       92.3
[match         ] default                                                  gabls3_night                   5 / 5       31.6          1.0       35.1
[match         ] default                                                  neutral                        5 / 5       83.5          1.8       88.4
[match         ] default                                                  gabls2                         5 / 5       87.9          1.5       91.7
[match         ] default                                                  jun25_altocu                   5 / 5       83.3          2.2       89.0
[match         ] default                                                  wangara                        5 / 5       85.1          1.1       89.4
[match         ] default                                                  lba_kk                         5 / 5      134.6          1.4      139.4
[match         ] default                                                  dycoms2_rf02_do                5 / 5      144.4          1.8      153.0
[match         ] default                                                  dycoms2_rf02_ds                5 / 5      144.3          1.7      155.0
[match         ] default                                                  clex9_oct14                    5 / 5      112.3          1.6      118.3
[match         ] default                                                  nov11_altocu                   5 / 5      115.8          1.3      122.3
[match         ] default                                                  rico_silhs                     5 / 5      125.1          1.4      130.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  arm                            1 / 5       83.7          1.1       88.0
[match         ] default                                                  rico                           5 / 5      217.5          1.1      222.5
[match         ] default                                                  lba_kk_silhs                   5 / 5      107.8          1.7      112.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  atex                           1 / 5       84.4          1.4       88.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  bomex                          1 / 5       82.7          1.2       87.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  cobra                          1 / 5       80.8          1.3       88.4
[match         ] default                                                  lba                            5 / 5      216.3          1.6      226.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01                   1 / 5       77.9          2.1       85.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf01_fixed_sst         1 / 5       76.4          1.0       80.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_nd                1 / 5       84.0          1.1       88.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls3_night                   5 / 5       38.2          1.2       46.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  fire                           1 / 5       71.5          1.8       80.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag2  gabls2                         5 / 5       85.1          1.4       89.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  jun25_altocu                   1 / 5       72.8          1.6       80.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  neutral                        1 / 5       79.4          1.3       86.2
[match         ] default                                                  lba_silhs                      5 / 5      258.6          3.3      266.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  wangara                        1 / 5       84.9          1.3       90.4
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  rico_silhs                         -        9.6          1.5       11.1
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk_silhs                       -        7.2          0.9        8.1
[both_failed   ] config_core_flags_wo_never_supported_jax_features_flag2  lba_silhs                          -        6.5          0.9        7.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_do                1 / 5      155.9          2.6      162.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  dycoms2_rf02_ds                1 / 5      155.6          1.7      165.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba_kk                         1 / 5      140.0          2.6      150.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  clex9_oct14                    1 / 5      114.4          1.6      120.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  arm                            5 / 5       83.5          1.2       87.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  nov11_altocu                   1 / 5      115.0          1.4      120.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  rico                           5 / 5      189.7          1.4      199.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  atex                           5 / 5       72.4          1.6       81.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  cobra                          5 / 5       75.1          1.8       82.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  bomex                          5 / 5       83.7          1.4       91.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01_fixed_sst         5 / 5       76.0          1.2       80.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf01                   5 / 5       82.0          1.4       87.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag2  lba                            1 / 5      223.7          1.3      230.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_nd                5 / 5       80.8          1.2       85.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls3_night                   5 / 5       31.9          1.2       37.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  fire                           5 / 5       74.8          1.0       80.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  gabls2                         5 / 5       75.9          1.4       82.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  jun25_altocu                   5 / 5       76.8          1.3       86.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  wangara                        5 / 5       79.6          1.2       85.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  neutral                        5 / 5       82.8          1.3       90.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk                         5 / 5      138.9          1.4      143.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_ds                5 / 5      158.2          1.7      163.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  dycoms2_rf02_do                5 / 5      164.7          2.0      180.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  clex9_oct14                    5 / 5      119.9          1.2      126.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  nov11_altocu                   5 / 5      116.4          1.4      122.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico_silhs                     5 / 5      119.7          1.0      123.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  arm                                -       69.5          1.6       71.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  rico                           5 / 5      207.0          1.2      212.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  atex                               -       81.1          1.0       82.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba                            5 / 5      230.2          2.5      240.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  bomex                              -       79.4          1.4       80.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_kk_silhs                   5 / 5      121.4          2.2      128.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  cobra                              -       88.2          1.2       89.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls3_night                       -       40.9          0.9       41.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01                       -       83.8          1.6       85.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf01_fixed_sst             -       81.9          1.3       83.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_nd                    -       72.9          2.1       75.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  fire                               -       83.0          1.8       84.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  jun25_altocu                       -       79.7          1.6       81.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  gabls2                             -       95.9          1.5       97.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico                               -       35.5          1.5       37.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  neutral                            -       81.3          2.8       84.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag3  lba_silhs                      5 / 5      241.5          4.2      261.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_do                    -       90.9          1.5       92.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  wangara                            -       92.4          1.0       93.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  dycoms2_rf02_ds                    -       91.0          1.4       92.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk                             -       80.7          1.1       81.9
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  rico_silhs                         -       42.2          1.1       43.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba                                -       89.2          1.1       90.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  clex9_oct14                        -       87.1          2.7       89.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  nov11_altocu                       -       92.7          1.9       94.6
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_kk_silhs                       -       82.9          2.8       85.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag4  lba_silhs                          -       85.2          5.4       90.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  arm                            5 / 5       81.5          1.0       90.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  atex                           5 / 5       82.4          1.5       90.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  bomex                          5 / 5       87.1          1.1       92.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  cobra                          5 / 5       91.4          1.4       99.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls3_night                   5 / 5       46.7          1.8       51.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01                   5 / 5       85.8          1.5       91.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf01_fixed_sst         5 / 5       82.1          1.2       89.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  fire                           5 / 5       83.0          1.6       94.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_nd                5 / 5       89.1          1.6       99.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  gabls2                         5 / 5      108.0          2.2      119.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  jun25_altocu                   5 / 5      116.6          2.0      125.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  neutral                        5 / 5      118.5          1.7      129.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  wangara                        5 / 5      112.6          1.8      119.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk                         5 / 5      182.2          1.3      187.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_ds                5 / 5      192.7          1.7      199.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  dycoms2_rf02_do                5 / 5      198.3          2.0      205.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  clex9_oct14                    5 / 5      113.8          1.4      125.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  nov11_altocu                   5 / 5      125.1          1.7      134.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico_silhs                     5 / 5      130.9          1.0      135.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  rico                           5 / 5      233.7          1.2      238.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  arm                            1 / 5       87.9          1.7       91.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  atex                               -       78.6          1.8       82.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_kk_silhs                   5 / 5       99.0          2.3      105.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba                            5 / 5      247.9          1.4      260.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  bomex                              -       83.3          1.4       86.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  cobra                              -       82.3          1.5       85.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01                       -       84.9          2.7       89.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls3_night                       -       39.9          1.1       43.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf01_fixed_sst             -       75.7          1.1       78.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_nd                    -       78.1          1.4       81.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  fire                               -       72.3          1.2       75.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  gabls2                             -       80.6          1.6       83.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  jun25_altocu                   1 / 5       78.1          1.5       81.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  neutral                            -       78.3          1.5       81.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  wangara                            -       81.8          2.2       86.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag5  lba_silhs                      5 / 5      249.9          3.0      258.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk                             -      145.3          3.0      151.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_do                    -      156.4          2.9      162.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  dycoms2_rf02_ds                    -      154.3          3.1      160.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  clex9_oct14                        -      113.5          1.8      118.1
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  arm                                -       24.2          1.1       25.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  atex                               -       20.5          1.6       22.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  nov11_altocu                       -      109.1          1.8      113.9
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico_silhs                         -      117.0          1.1      120.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  bomex                              -       21.6          1.0       22.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01                       -       19.6          1.4       21.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  cobra                              -       22.6          1.4       24.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  rico                               -      186.2          1.4      190.5
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf01_fixed_sst             -       25.6          1.4       27.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_nd                    -       26.8          1.2       28.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  fire                               -       24.6          1.1       25.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls2                             -       23.0          1.4       24.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba                                -      196.9          3.2      202.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  gabls3_night                       -       24.2          1.0       25.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_kk_silhs                       -       90.6          2.6       95.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  jun25_altocu                       -       19.2          1.7       20.8
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  neutral                            -       20.4          1.0       21.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  wangara                            -       21.0          1.3       22.3
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_do                    -       22.3          1.4       23.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk                             -       22.1          1.1       23.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  dycoms2_rf02_ds                    -       23.6          1.4       25.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico                               -       19.9          1.1       21.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba                                -       25.9          1.3       27.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  rico_silhs                         -       19.5          1.2       20.7
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  nov11_altocu                       -       23.8          1.3       25.2
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_kk_silhs                       -       17.6          1.8       19.4
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  clex9_oct14                        -       27.9          1.1       29.0
[jax_failed    ] config_core_flags_wo_never_supported_jax_features_flag7  lba_silhs                          -       25.5          2.6       28.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  arm                            5 / 5       78.3          1.1       83.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  bomex                          5 / 5       78.7          1.6       84.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  atex                           5 / 5       78.9          1.9       85.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01                   5 / 5       76.0          2.4       82.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  cobra                          5 / 5       77.9          2.0       83.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf01_fixed_sst         5 / 5       78.3          0.9       82.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_nd                5 / 5       80.3          1.0       84.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag6  lba_silhs                          -      217.5          4.3      223.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls3_night                   5 / 5       27.7          1.0       31.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  jun25_altocu                   5 / 5       66.9          1.2       72.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  fire                           5 / 5       76.0          1.2       81.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  gabls2                         5 / 5       71.1          1.8       78.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  neutral                        5 / 5       70.3          1.4       79.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  wangara                        5 / 5       72.1          1.8       79.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_ds                5 / 5      136.2          1.3      141.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  dycoms2_rf02_do                5 / 5      144.8          1.7      151.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk                         5 / 5      145.1          1.0      149.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  clex9_oct14                    5 / 5      100.1          1.2      106.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  nov11_altocu                   5 / 5      101.1          1.4      109.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico_silhs                     5 / 5      116.4          0.9      120.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_kk_silhs                   5 / 5       92.2          1.8       97.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  atex                           5 / 5       70.1          1.1       77.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  arm                            5 / 5       74.1          1.3       82.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  rico                           5 / 5      185.0          2.0      192.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  bomex                          5 / 5       75.7          1.5       82.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  cobra                          5 / 5       77.3          1.2       81.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba                            5 / 5      205.3          1.2      211.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls3_night                   5 / 5       34.5          1.2       41.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01                   5 / 5       70.3          1.6       78.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf01_fixed_sst         5 / 5       65.6          1.5       71.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_nd                5 / 5       70.0          1.6       78.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  fire                           5 / 5       72.4          1.6       79.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  gabls2                         5 / 5       69.9          2.1       74.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  jun25_altocu                   5 / 5       68.8          1.5       73.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag8  lba_silhs                      5 / 5      215.8          4.0      230.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  neutral                        5 / 5       66.3          1.6       73.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  wangara                        5 / 5       73.9          1.0       78.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_do                5 / 5      141.0          1.9      146.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk                         5 / 5      133.5          1.1      138.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  dycoms2_rf02_ds                5 / 5      145.3          1.6      154.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  clex9_oct14                    5 / 5      108.3          1.1      116.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  nov11_altocu                   5 / 5      108.1          1.9      115.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico_silhs                     5 / 5      108.4          1.0      113.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  rico                           5 / 5      174.3          1.5      178.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba                            5 / 5      198.3          1.2      205.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 arm                            1 / 5       65.1          1.3       75.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_kk_silhs                   5 / 5       84.9          2.4       94.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 bomex                          1 / 5       71.4          1.6       79.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 atex                           1 / 5       80.0          1.8       85.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 cobra                          1 / 5       76.8          1.2       81.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01                   1 / 5       76.3          1.4       81.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls3_night                   5 / 5       37.0          1.2       40.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf01_fixed_sst         1 / 5       74.5          1.0       80.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_nd                1 / 5       70.5          1.0       76.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 fire                           1 / 5       68.0          1.1       73.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag10 gabls2                         5 / 5       69.9          2.4       75.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 neutral                        1 / 5       68.9          1.0       74.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 jun25_altocu                   1 / 5       73.0          1.1       78.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 wangara                        1 / 5       73.5          1.6       82.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag9  lba_silhs                      5 / 5      224.3          5.1      238.5
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk                         1 / 5      135.3          1.7      144.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_do                1 / 5      144.2          2.2      152.7
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 clex9_oct14                    1 / 5      106.2          2.0      114.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 dycoms2_rf02_ds                1 / 5      147.2          1.5      153.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 nov11_altocu                   1 / 5      105.3          1.4      111.2
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico_silhs                     5 / 5      108.2          1.2      114.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 rico                           5 / 5      176.4          1.3      188.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 arm                            5 / 5       73.0          1.0       77.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 atex                           5 / 5       73.8          1.2       78.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba                            1 / 5      195.7          1.4      202.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_kk_silhs                   1 / 5       90.2          2.0       98.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 bomex                          5 / 5       78.4          1.2       84.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 cobra                          5 / 5       78.1          1.2       82.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01                   5 / 5       64.4          1.2       70.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf01_fixed_sst         5 / 5       71.3          1.2       80.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls3_night                   5 / 5       37.5          1.6       41.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_nd                5 / 5       72.7          1.4       78.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 fire                           5 / 5       73.4          1.2       78.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 gabls2                         5 / 5       71.1          1.4       75.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 jun25_altocu                   5 / 5       71.3          1.1       75.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 neutral                        5 / 5       66.8          1.2       71.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag10 lba_silhs                      1 / 5      212.1          6.4      229.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 wangara                        5 / 5       70.5          1.3       75.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_do                5 / 5      136.4          2.1      143.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk                         5 / 5      136.0          1.6      143.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 dycoms2_rf02_ds                5 / 5      144.6          2.0      150.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 clex9_oct14                    5 / 5      119.5          1.1      126.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 nov11_altocu                   5 / 5      102.6          1.4      109.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico_silhs                     5 / 5      107.2          1.0      111.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 rico                           5 / 5      177.7          1.0      183.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_kk_silhs                   5 / 5       83.3          1.4       88.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba                            5 / 5      222.6          1.3      229.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 arm                            5 / 5      112.2          1.0      116.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 cobra                          5 / 5       80.6          1.6       86.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 atex                           5 / 5      112.0          1.5      116.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 bomex                          5 / 5      110.9          1.5      117.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01                   5 / 5      115.1          1.4      119.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls3_night                   5 / 5       60.1          1.2       63.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 gabls2                         5 / 5       73.7          1.8       77.8
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf01_fixed_sst         1 / 5      120.0          1.2      128.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag11 lba_silhs                      5 / 5      232.2          3.9      240.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 fire                           5 / 5      121.9          1.1      126.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_nd                5 / 5      125.4          1.2      130.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 jun25_altocu                   5 / 5      127.7          1.5      134.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 neutral                        5 / 5      113.8          1.8      118.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 wangara                        5 / 5      127.0          1.0      132.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_do                5 / 5      186.0          2.1      193.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 dycoms2_rf02_ds                5 / 5      195.8          1.6      204.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 nov11_altocu                   5 / 5      149.8          1.2      159.4
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk                         1 / 5      194.3          1.8      204.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag12 clex9_oct14                    5 / 5      163.3          1.4      169.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 rico_silhs                     5 / 5      136.7          1.4      145.6
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 rico                           5 / 5      229.8          1.3      237.1
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 lba                            1 / 5      247.1          1.3      264.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 arm                            5 / 5       82.1          1.0       86.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 atex                           5 / 5       81.0          1.0       85.3
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 lba_kk_silhs                   1 / 5      132.4          1.5      138.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 bomex                          5 / 5       81.5          0.9       87.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01                   5 / 5       72.2          1.3       76.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 cobra                          5 / 5       79.7          1.2       84.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls3_night                   5 / 5       34.3          0.9       37.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf01_fixed_sst         5 / 5       72.8          1.4       80.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_nd                5 / 5       72.3          1.2       76.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 fire                           5 / 5       76.8          0.9       81.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 gabls2                         5 / 5       74.8          1.3       79.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 jun25_altocu                   5 / 5       71.9          1.2       77.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 neutral                        5 / 5       71.0          1.3       79.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 wangara                        5 / 5       78.3          1.5       87.0
[diff          ] config_core_flags_wo_never_supported_jax_features_flag12 lba_silhs                      1 / 5      274.2          2.7      285.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_do                5 / 5      157.7          1.6      162.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 dycoms2_rf02_ds                5 / 5      150.5          1.7      156.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 clex9_oct14                    5 / 5      113.8          1.2      119.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk                         5 / 5      147.2          1.4      152.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 nov11_altocu                   5 / 5      114.9          1.4      122.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico                           5 / 5      192.7          1.2      202.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 rico_silhs                     5 / 5      114.8          2.3      124.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 atex                           5 / 5       71.8          1.3       77.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 arm                            5 / 5       72.9          1.2       78.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba                            5 / 5      202.1          1.2      209.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_kk_silhs                   5 / 5       95.3          1.4       99.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 bomex                          5 / 5       75.7          1.0       79.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01                   5 / 5       64.7          1.8       75.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 cobra                          5 / 5       78.4          2.0       91.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls3_night                   5 / 5       42.9          1.0       46.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_nd                5 / 5       73.5          1.6       79.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 fire                           5 / 5       71.9          1.7       76.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf01_fixed_sst         5 / 5       76.3          1.8       81.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 gabls2                         5 / 5       71.0          1.3       75.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 neutral                        5 / 5       68.8          2.4       81.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 jun25_altocu                   5 / 5       85.1          1.6       90.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 wangara                        5 / 5       80.6          1.2       85.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag13 lba_silhs                      5 / 5      240.7          3.8      249.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_ds                5 / 5      141.5          2.2      147.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk                         5 / 5      142.0          1.4      147.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 dycoms2_rf02_do                5 / 5      144.8          1.9      149.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 clex9_oct14                    5 / 5      101.1          1.4      109.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 nov11_altocu                   5 / 5       97.2          1.2      108.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico                           5 / 5      186.7          1.1      192.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 rico_silhs                     5 / 5      118.4          1.5      129.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 arm                            5 / 5       71.1          1.1       76.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 atex                           5 / 5       66.8          1.0       73.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_kk_silhs                   5 / 5       95.9          1.7      103.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 bomex                          5 / 5       68.3          2.1       76.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 cobra                          5 / 5       65.8          1.3       73.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba                            5 / 5      202.3          1.6      211.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01                   5 / 5       68.5          1.7       73.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf01_fixed_sst         5 / 5       65.4          0.9       69.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls3_night                   5 / 5       35.3          1.0       38.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 fire                           5 / 5       64.3          1.2       71.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_nd                5 / 5       71.1          1.4       76.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 gabls2                         5 / 5       73.4          2.0       77.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 jun25_altocu                   5 / 5       68.5          1.7       75.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 neutral                        5 / 5       68.0          1.1       72.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 wangara                        5 / 5       77.0          1.3       81.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag14 lba_silhs                      5 / 5      229.0          3.8      242.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_do                5 / 5      137.6          1.9      146.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 clex9_oct14                    5 / 5       92.5          1.7      100.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 dycoms2_rf02_ds                5 / 5      151.0          1.3      155.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk                         5 / 5      148.4          1.2      154.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 nov11_altocu                   5 / 5      108.6          1.1      114.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico_silhs                     5 / 5       98.6          0.9      102.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 rico                           5 / 5      178.1          1.3      183.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_kk_silhs                   5 / 5       75.2          1.6       82.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 arm                            5 / 5       70.2          1.3       80.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 atex                           5 / 5       73.8          2.0       81.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 cobra                          5 / 5       73.7          1.4       80.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 bomex                          5 / 5       79.0          1.4       84.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba                            5 / 5      216.1          1.4      224.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01                   5 / 5       61.8          1.4       67.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf01_fixed_sst         5 / 5       55.3          1.0       59.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls3_night                   5 / 5       30.7          1.2       38.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_nd                5 / 5       70.6          1.0       76.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 gabls2                         5 / 5       59.7          1.8       65.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 fire                           5 / 5       67.9          1.2       78.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 neutral                        5 / 5       61.6          1.0       66.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 jun25_altocu                   5 / 5       74.3          1.2       79.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 wangara                        5 / 5       68.0          1.3       75.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag15 lba_silhs                      5 / 5      204.3          3.5      214.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk                         5 / 5      109.4          1.3      119.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_do                5 / 5      139.0          2.2      151.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 clex9_oct14                    5 / 5      105.6          2.7      114.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 dycoms2_rf02_ds                5 / 5      142.0          1.5      146.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 nov11_altocu                   5 / 5      100.0          1.3      104.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico_silhs                     5 / 5      101.7          1.0      106.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 rico                           5 / 5      185.6          1.1      191.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba                            5 / 5      171.7          1.3      186.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_kk_silhs                   5 / 5       73.8          2.9       83.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 arm                            5 / 5       67.0          1.5       74.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 atex                           5 / 5       67.0          1.0       71.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 bomex                          5 / 5       67.7          1.0       73.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 cobra                          5 / 5       67.2          1.4       72.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls3_night                   5 / 5       27.7          1.6       34.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01_fixed_sst         5 / 5       59.9          1.1       68.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf01                   5 / 5       67.8          1.7       77.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_nd                5 / 5       65.2          1.4       69.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 fire                           5 / 5       65.3          1.1       69.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 gabls2                         5 / 5       63.1          1.3       66.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 jun25_altocu                   5 / 5       62.0          1.2       66.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 neutral                        5 / 5       65.3          1.4       77.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 wangara                        5 / 5       59.9          1.2       65.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag16 lba_silhs                      5 / 5      204.9          3.1      214.9
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_ds                5 / 5      116.3          1.8      121.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 dycoms2_rf02_do                5 / 5      120.2          1.4      125.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk                         5 / 5      118.3          1.1      123.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 nov11_altocu                   5 / 5       81.1          1.2       87.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 clex9_oct14                    5 / 5       89.9          1.2       96.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico_silhs                     5 / 5       89.7          1.1       94.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 rico                           5 / 5      158.6          1.0      164.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba                            5 / 5      162.5          1.4      173.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 arm                            5 / 5       65.5          1.0       69.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_kk_silhs                   5 / 5       73.7          2.2       82.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 bomex                          5 / 5       61.1          1.0       66.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 atex                           5 / 5       62.5          1.2       68.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 cobra                          5 / 5       68.0          1.2       73.8
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01                   5 / 5       63.8          1.6       68.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf01_fixed_sst         5 / 5       61.4          1.3       67.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls3_night                   5 / 5       31.6          1.3       35.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_nd                5 / 5       67.5          1.0       71.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 fire                           5 / 5       65.5          1.3       69.6
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 gabls2                         5 / 5       60.1          1.3       63.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 jun25_altocu                   5 / 5       68.1          1.2       75.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 neutral                        5 / 5       65.1          1.2       71.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 wangara                        5 / 5       61.3          0.9       65.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag17 lba_silhs                      5 / 5      196.0          3.6      206.0
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_do                5 / 5      129.0          2.3      135.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 dycoms2_rf02_ds                5 / 5      119.1          1.8      125.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk                         5 / 5      126.9          1.1      131.2
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 clex9_oct14                    5 / 5       92.8          1.3      101.4
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 nov11_altocu                   5 / 5       92.3          1.7       97.7
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico_silhs                     5 / 5      100.2          0.9      110.1
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 rico                           5 / 5      151.4          1.7      159.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_kk_silhs                   5 / 5       65.8          1.6       71.5
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba                            5 / 5      158.3          1.1      163.3
[match         ] config_core_flags_wo_never_supported_jax_features_flag18 lba_silhs                      5 / 5      141.2          2.2      147.2

Overall cases:
  Match Diff Failed
  ----- ---- ------
    296   69     49

Flag set default:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag2:
  Match Diff Failed
  ----- ---- ------
      2   18      3

Flag set config_core_flags_wo_never_supported_jax_features_flag3:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag4:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag5:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag6:
  Match Diff Failed
  ----- ---- ------
      0   23      0

Flag set config_core_flags_wo_never_supported_jax_features_flag7:
  Match Diff Failed
  ----- ---- ------
      0    0     23

Flag set config_core_flags_wo_never_supported_jax_features_flag8:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag9:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag10:
  Match Diff Failed
  ----- ---- ------
      2   21      0

Flag set config_core_flags_wo_never_supported_jax_features_flag11:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag12:
  Match Diff Failed
  ----- ---- ------
     16    7      0

Flag set config_core_flags_wo_never_supported_jax_features_flag13:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag14:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag15:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag16:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag17:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Flag set config_core_flags_wo_never_supported_jax_features_flag18:
  Match Diff Failed
  ----- ---- ------
     23    0      0

Total time: 1h 35m 35.0s
Results JSON: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/case_compare_summary.json
Bindiff log: /home/jenkins/workspace/clubb_jax/output/tests/jax_driver_test_results/final_bindiff.log [failed (exit 1)]
[Pipeline] }
ERROR: script returned exit code 1
[Pipeline] // catchError
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] junit
Recording test results
[Checks API] No suitable checks publisher found.
[Pipeline] script
[Pipeline] {
[Pipeline] emailext
Sending email to: messnermet@uwm.edu
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: FAILURE