Skip to content
Success

Changes

Summary

  1. New stats system  (#1270) (details)
  2. Fixing fire tuner (details)
Commit 3d4d74a0d0295936253484c54693f9eac230f604 by noreply
New stats system  (#1270)

* Initial commit for the new stats system

* Adding helper scripts

* Fixes and another script

* Updates

* Improvements

* Fixed bug in all_stats.in

* Updates

* Adding dash app

* Updates, also including new dash app since I'm finding it quite useful

* Improvements/fixes and adding missing variable to all_stats.in

* Updates

* Moving wp2sclrp, wpsclrp2, wpsclrprtp, and wpsclrpthlp to the zt netcdf output file, since those are zt variables. Also adding a missing variable, rcm_in_cloud, to all_stats.in and correcting a missing comma bug. This is technically BIT_CHANGING because the variables are moving files, but the stored data is identical from 1:nzt - the nzm level just had garbage for those variables and is now gone.

* Updates

* Updates

* The big stats pull, only new stats remains now

* Some cleanup

* Lot's of core rework, new index caching system speeds things up

* Missed files

* Small improvements a bug fix to the grid remapped output

* Fixing up logic and ordering things a bit better

* Little improvements

* Cleanup and simplications to new stats core

* Little improvements, mostly to dash app

* Mostly cleanup

* Making GPU code work

* Making more scripts work

* Fixing line lengths

* Bug fixes

* Bug fixes

* Bug fixes

* Bug fixes

* Bug fixes and script updates

* Jenkins script update

* Jenkins script update

* Jenkins script update

* Jenkins script update

* Jenkins script update

* Jenkins script update

* Script update

* Script update

* Script update

* Script update

* Script update

* Script update

* Script update

* Test update

* Jenkins script update

* Test update

* Fixing bug

* Fixing bug

* Fixing up comments

* Small fixes

* Jenkins script update

* CMake update

* Little fix for cmake

* Jenkins script update

* Jenkins script updateS

* Cmake update

* Jenkins script update

* Jenkins script update

* Jenkins script updates

* Adding new stats input

* Small fixes

* Fixing old compile scripts

* Jenkins script updates

* Jenkins script updates

* Jenkins script updates

* Little fixes

* Little cmake fix

* Little jenkins fix

* Mono flux test update and _api renamings

* Small Jenkins fix

* Adding missing comments back

* Even more comments

* stats updates

* Even more comments

* Various small improvements

* Removing test statsd

* Adding some things back to _api and adding structure explaining comment in stats files.

* Many more comments

* Removing plan file

* Spelling fix
The file was modifiedsrc/CLUBB_core/precipitation_fraction.F90 (diff)
The file was modifiedsrc/Microphys/coamps_microphys_driver_module.F90 (diff)
The file was modifiedsrc/SILHS/CMakeLists.txt (diff)
The file was removedsrc/input_grads.F90
The file was modifiedpostprocessing/check_budgets_balance/checkBudget.py (diff)
The file was modifiedjenkins_tests/clubb_plot_ifort_debug/Jenkinsfile (diff)
The file was removedsrc/CLUBB_core/stats_variables.F90
The file was modifiedjenkins_tests/clubb_plot_nvhpc_gpu_vs_cpu/Jenkinsfile (diff)
The file was addedrun_scripts/run_silhs_test.py
The file was modifiedsrc/Microphys/microphys_interface.inc (diff)
The file was modifiedsrc/CLUBB_core/advance_xm_wpxp_module.F90 (diff)
The file was modifiedsrc/clubb_standalone.F90 (diff)
The file was modifiedinput/stats/tuning_stats.in (diff)
The file was removedsrc/CLUBB_core/stats_lh_zt_module.F90
The file was modifiedsrc/CLUBB_core/clip_explicit.F90 (diff)
The file was modifiedjenkins_tests/clubb_ifort_build/Jenkinsfile (diff)
The file was addeddash_app/assets/30_run_ui_resize.js
The file was modifiedjenkins_tests/clubb_gfortran_debug_run/Jenkinsfile (diff)
The file was removedsrc/CLUBB_core/stats_rad_zt_module.F90
The file was removedsrc/SILHS/output_2D_samples_module.F90
The file was modifiedsrc/CLUBB_core/mixing_length.F90 (diff)
The file was addedsrc/Input_fields/CMakeLists.txt
The file was addedsrc/Input_fields/stat_file_utils.F90
The file was addedsrc/Input_fields/extrapolation.F90
The file was addedsrc/Input_fields/input_netcdf.F90
The file was addedsrc/Input_fields/input_fields.F90
The file was modifiedsrc/Microphys/Morrison_microphys/README.MICRO_M2005 (diff)
The file was modifiedsrc/error.F90 (diff)
The file was addedrun_scripts/run_restart_test.py
The file was addedsrc/Input_fields/input_interpret.F90
The file was modifiedsrc/Microphys/Microphys_utils/microphys_stats_vars_module.F90 (diff)
The file was addedsrc/Input_fields/corr_varnce_input_reader.F90
The file was addedsrc/Input_fields/stat_file_module.F90
The file was addeddash_app/case_definitions.py
The file was modifiedsrc/Benchmark_cases/CMakeLists.txt (diff)
The file was modifiedsrc/CLUBB_core/clubb_api_module.F90 (diff)
The file was modifiedcompile/file_list/clubb_model_files (diff)
The file was addeddash_app/assets/10_theme.css
The file was modifiedsrc/CLUBB_core/interpolation.F90 (diff)
The file was modifiedinput/stats/scalars_stats.in (diff)
The file was removedsrc/CLUBB_core/stats_lh_sfc_module.F90
The file was modifiedsrc/G_unit_test_types/spurious_source_test.F90 (diff)
The file was removedsrc/extrapolation.F90
The file was addeddash_app/assets/11_tab_run_theme.css
The file was modifiedsrc/CMakeLists.txt (diff)
The file was modifiedsrc/Microphys/morrison_microphys_module.F90 (diff)
The file was removedsrc/CLUBB_core/recl.inc
The file was addedsrc/Input_fields/input_names.F90
The file was modifiedsrc/CLUBB_core/advance_clubb_core_module.F90 (diff)
The file was modifiedsrc/CLUBB_core/stats_clubb_utilities.F90 (diff)
The file was modifiedsrc/Microphys/mixed_moment_PDF_integrals.F90 (diff)
The file was modifiedsrc/jacobian.F90 (diff)
The file was addedutilities/split_stats_to_legacy.py
The file was modifiedsrc/G_unit_tests.F90 (diff)
The file was removedrun_scripts/check_multi_col_avg.py
The file was modifiedjenkins_tests/clubb_G_unit_reverse_dir_grid_test/Jenkinsfile (diff)
The file was modifiedjenkins_tests/clubb_backwards_compatibility_gfortran_test/Jenkinsfile (diff)
The file was modifiedjenkins_tests/clubb_timestep_convergence_gfortran_test/Jenkinsfile (diff)
The file was modifiedinput/stats/nightly_stats.in (diff)
The file was modifiedsrc/Microphys/KK_microphys_module.F90 (diff)
The file was addeddash_app/tab_multicol.py
The file was removedsrc/hydrostatic_module.F90
The file was addedsrc/Input_fields/hydrostatic_module.F90
The file was modifiedinput/stats/nobudgets_nomicro_stats.in (diff)
The file was removedsrc/CLUBB_core/stats_rad_zm_module.F90
The file was modifiedjenkins_tests/clubb_nvhpc_gpu_column_mirror_test/Jenkinsfile (diff)
The file was modifiedrun_scripts/run_scm.py (diff)
The file was removedsrc/stat_file_utils.F90
The file was modifiedsrc/int2txt.F90 (diff)
The file was modifiedsrc/clubb_thread_test.F90 (diff)
The file was modifiedsrc/clubb_driver_test.F90 (diff)
The file was addedsrc/Microphys/cloud_sed_module.F90
The file was modifiedsrc/Microphys/estimate_scm_microphys_module.F90 (diff)
The file was removedsrc/CLUBB_core/input_reader.F90
The file was modifiedrun_scripts/run_bindiff_all.py (diff)
The file was modifiedsrc/CLUBB_core/setup_clubb_pdf_params.F90 (diff)
The file was removedsrc/CLUBB_core/stats_type.F90
The file was modifiedinput/stats/standard_stats.in (diff)
The file was modifiedsrc/Microphys/advance_microphys_module.F90 (diff)
The file was modifiedinput/stats/all_stats.in (diff)
The file was removedsrc/CLUBB_core/stats_sfc_module.F90
The file was modifiedjenkins_tests/clubb_restart_silhs_gfortran_test/Jenkinsfile (diff)
The file was modifiedsrc/Radiation/radiation_module.F90 (diff)
The file was modifiedsrc/Radiation/BUGSrad/variables_radiation_module.F90 (diff)
The file was addeddash_app/tab_compare.py
The file was addeddash_app/tab_run.py
The file was modifiedjenkins_tests/clubb_mac_gfortran_test/Jenkinsfile (diff)
The file was modifiedjenkins_tests/clubb_release_intel_build/Jenkinsfile (diff)
The file was removedsrc/CLUBB_core/input_names.F90
The file was modifiedsrc/clubb_driver.F90 (diff)
The file was removedsrc/CLUBB_core/output_netcdf.F90
The file was modifiedsrc/CLUBB_core/corr_varnce_module.F90 (diff)
The file was modifiedjenkins_tests/clubb_fire_tuning_gfortran_test/Jenkinsfile (diff)
The file was modifiedrun_scripts/run_thread_test.py (diff)
The file was modifiedsrc/CLUBB_core/mono_flux_limiter.F90 (diff)
The file was addedsrc/Input_fields/input_grads.F90
The file was modifiedsrc/Microphys/microphys_driver.F90 (diff)
The file was modifiedjenkins_tests/clubb_silhs_convergence_gfortran/Jenkinsfile (diff)
The file was modifiedsrc/Microphys/CMakeLists.txt (diff)
The file was modifiedsrc/Microphys/KK_microphys/KK_upscaled_turbulent_sed.F90 (diff)
The file was modifiedrun_scripts/check_mirrored_multi_col_output.py (diff)
The file was modifiedrun_scripts/create_multi_col_params.py (diff)
The file was addedsrc/CLUBB_core/stats_netcdf.F90
The file was removedsrc/CLUBB_core/stat_file_module.F90
The file was modifiedinput/stats/host_budgets_stats.in (diff)
The file was modifiedsrc/Microphys/pdf_hydromet_microphys_wrapper.F90 (diff)
The file was removedsrc/input_netcdf.F90
The file was modifiedinput/stats/nobudgets_stats.in (diff)
The file was modifiedsrc/CLUBB_core/CMakeLists.txt (diff)
The file was removedsrc/CLUBB_core/output_grads.F90
The file was modifiedjenkins_tests/clubb_restart_gfortran_test/Jenkinsfile (diff)
The file was removedsrc/input_fields.F90
The file was modifiedsrc/CLUBB_core/advance_windm_edsclrm_module.F90 (diff)
The file was modifiedrun_scripts/test_monoflux_limiter_GPU.py (diff)
The file was modifiedrun_scripts/run_bindiff_all.bash (diff)
The file was modifiedjenkins_tests/clubb_timestep_gfortran_tests/Jenkinsfile (diff)
The file was addedrun_scripts/check_budget_balance.py
The file was modifiedsrc/Microphys/microphys_init_cleanup.F90 (diff)
The file was addedsrc/Input_fields/sounding.F90
The file was modifiedsrc/Microphys/lh_microphys_driver_module.F90 (diff)
The file was modifiedjenkins_tests/clubb_check_budget_balance_gfortran/Jenkinsfile (diff)
The file was modifiedsrc/Microphys/ice_dfsn_module.F90 (diff)
The file was modifiedsrc/Radiation/simple_rad_module.F90 (diff)
The file was modifiedsrc/generalized_grid_test.F90 (diff)
The file was addedrun_scripts/run_clubb_conv_test.py
The file was modifiedsrc/Benchmark_cases/prescribe_forcings.F90 (diff)
The file was modifiedsrc/CLUBB_core/advance_helper_module.F90 (diff)
The file was removedsrc/input_interpret.F90
The file was removedjenkins_tests/clubb_nvhpc_gpu_multi_col_avg_test/Jenkinsfile
The file was modifiedsrc/soil_vegetation.F90 (diff)
The file was modifiedsrc/G_unit_test_types/read_corr_mtx_test.F90 (diff)
The file was addedsrc/Input_fields/recl.inc
The file was modifiedsrc/CLUBB_core/matrix_solver_wrapper.F90 (diff)
The file was modifiedsrc/Microphys/KK_microphys/KK_upscaled_covariances.F90 (diff)
The file was modifiedjenkins_tests/clubb_gfortran_build/Jenkinsfile (diff)
The file was addedrun_scripts/run_tuner.py
The file was modifiedsrc/CLUBB_core/advance_xp2_xpyp_module.F90 (diff)
The file was removedrun_scripts/run_restart_test.bash
The file was removedsrc/sounding.F90
The file was modifiedREADME (diff)
The file was removedsrc/CLUBB_core/stats_zt_module.F90
The file was modifiedsrc/SILHS/latin_hypercube_driver_module.F90 (diff)
The file was removedsrc/Benchmark_cases/cloud_sed_module.F90
The file was addeddash_app/app.py
The file was addedinput/stats/fire_stats.in
The file was modifiedsrc/CLUBB_core/pdf_closure_module.F90 (diff)
The file was modifiedsrc/CLUBB_core/advance_wp2_wp3_module.F90 (diff)
The file was addedinput/stats/multi_col_stats.in
The file was modifiedjenkins_tests/clubb_rev_grid_matrix_solve_test/Jenkinsfile (diff)
The file was modifiedjenkins_tests/clubb_openmp_gfortran_test/Jenkinsfile (diff)
The file was modifiedsrc/CLUBB_core/remapping_module.F90 (diff)
The file was removedsrc/CLUBB_core/stats_type_utilities.F90
The file was modifiedsrc/CLUBB_core/advance_xp3_module.F90 (diff)
The file was modifiedsrc/SILHS/silhs_api_module.F90 (diff)
The file was modifiedinput/stats/nightly_stats_scalars.in (diff)
The file was modifiedjenkins_tests/clubb_nvhpc_debug_build/Jenkinsfile (diff)
The file was modifiedsrc/CLUBB_core/fill_holes.F90 (diff)
The file was addeddash_app/assets/20_autoscroll.js
The file was modifiedjenkins_tests/clubb_nvhpc_single_prec_build/Jenkinsfile (diff)
The file was modifiedsrc/G_unit_test_types/CMakeLists.txt (diff)
The file was addedsrc/Input_fields/input_reader.F90
The file was modifiedjenkins_tests/clubb_nvhpc_gpu_vs_cpu_diffness/Jenkinsfile (diff)
The file was removedsrc/CLUBB_core/stats_zm_module.F90
The file was modifiedsrc/Microphys/silhs_category_variance_module.F90 (diff)
The file was modifiedsrc/CLUBB_core/sfc_varnce_module.F90 (diff)
The file was modifiedsrc/CLUBB_core/numerical_check.F90 (diff)
The file was addedrun_scripts/fire_tuner.py
The file was modifiedsrc/CLUBB_core/stats_netcdf.F90 (diff)
The file was modifiedrun_scripts/fire_tuner.py (diff)