Commit
3d4d74a0d0295936253484c54693f9eac230f604
by noreply New stats system (#1270) * Initial commit for the new stats system * Adding helper scripts * Fixes and another script * Updates * Improvements * Fixed bug in all_stats.in * Updates * Adding dash app * Updates, also including new dash app since I'm finding it quite useful * Improvements/fixes and adding missing variable to all_stats.in * Updates * Moving wp2sclrp, wpsclrp2, wpsclrprtp, and wpsclrpthlp to the zt netcdf output file, since those are zt variables. Also adding a missing variable, rcm_in_cloud, to all_stats.in and correcting a missing comma bug. This is technically BIT_CHANGING because the variables are moving files, but the stored data is identical from 1:nzt - the nzm level just had garbage for those variables and is now gone. * Updates * Updates * The big stats pull, only new stats remains now * Some cleanup * Lot's of core rework, new index caching system speeds things up * Missed files * Small improvements a bug fix to the grid remapped output * Fixing up logic and ordering things a bit better * Little improvements * Cleanup and simplications to new stats core * Little improvements, mostly to dash app * Mostly cleanup * Making GPU code work * Making more scripts work * Fixing line lengths * Bug fixes * Bug fixes * Bug fixes * Bug fixes * Bug fixes and script updates * Jenkins script update * Jenkins script update * Jenkins script update * Jenkins script update * Jenkins script update * Jenkins script update * Script update * Script update * Script update * Script update * Script update * Script update * Script update * Test update * Jenkins script update * Test update * Fixing bug * Fixing bug * Fixing up comments * Small fixes * Jenkins script update * CMake update * Little fix for cmake * Jenkins script update * Jenkins script updateS * Cmake update * Jenkins script update * Jenkins script update * Jenkins script updates * Adding new stats input * Small fixes * Fixing old compile scripts * Jenkins script updates * Jenkins script updates * Jenkins script updates * Little fixes * Little cmake fix * Little jenkins fix * Mono flux test update and _api renamings * Small Jenkins fix * Adding missing comments back * Even more comments * stats updates * Even more comments * Various small improvements * Removing test statsd * Adding some things back to _api and adding structure explaining comment in stats files. * Many more comments * Removing plan file * Spelling fix The file was modified src/CLUBB_core/precipitation_fraction.F90 (diff) The file was modified src/Microphys/coamps_microphys_driver_module.F90 (diff) The file was modified src/SILHS/CMakeLists.txt (diff) The file was removed src/input_grads.F90 The file was modified postprocessing/check_budgets_balance/checkBudget.py (diff) The file was modified jenkins_tests/clubb_plot_ifort_debug/Jenkinsfile (diff) The file was removed src/CLUBB_core/stats_variables.F90 The file was modified jenkins_tests/clubb_plot_nvhpc_gpu_vs_cpu/Jenkinsfile (diff) The file was added run_scripts/run_silhs_test.py The file was modified src/Microphys/microphys_interface.inc (diff) The file was modified src/CLUBB_core/advance_xm_wpxp_module.F90 (diff) The file was modified src/clubb_standalone.F90 (diff) The file was modified input/stats/tuning_stats.in (diff) The file was removed src/CLUBB_core/stats_lh_zt_module.F90 The file was modified src/CLUBB_core/clip_explicit.F90 (diff) The file was modified jenkins_tests/clubb_ifort_build/Jenkinsfile (diff) The file was added dash_app/assets/30_run_ui_resize.js The file was modified jenkins_tests/clubb_gfortran_debug_run/Jenkinsfile (diff) The file was removed src/CLUBB_core/stats_rad_zt_module.F90 The file was removed src/SILHS/output_2D_samples_module.F90 The file was modified src/CLUBB_core/mixing_length.F90 (diff) The file was added src/Input_fields/CMakeLists.txt The file was added src/Input_fields/stat_file_utils.F90 The file was added src/Input_fields/extrapolation.F90 The file was added src/Input_fields/input_netcdf.F90 The file was added src/Input_fields/input_fields.F90 The file was modified src/Microphys/Morrison_microphys/README.MICRO_M2005 (diff) The file was modified src/error.F90 (diff) The file was added run_scripts/run_restart_test.py The file was added src/Input_fields/input_interpret.F90 The file was modified src/Microphys/Microphys_utils/microphys_stats_vars_module.F90 (diff) The file was added src/Input_fields/corr_varnce_input_reader.F90 The file was added src/Input_fields/stat_file_module.F90 The file was added dash_app/case_definitions.py The file was modified src/Benchmark_cases/CMakeLists.txt (diff) The file was modified src/CLUBB_core/clubb_api_module.F90 (diff) The file was modified compile/file_list/clubb_model_files (diff) The file was added dash_app/assets/10_theme.css The file was modified src/CLUBB_core/interpolation.F90 (diff) The file was modified input/stats/scalars_stats.in (diff) The file was removed src/CLUBB_core/stats_lh_sfc_module.F90 The file was modified src/G_unit_test_types/spurious_source_test.F90 (diff) The file was removed src/extrapolation.F90 The file was added dash_app/assets/11_tab_run_theme.css The file was modified src/CMakeLists.txt (diff) The file was modified src/Microphys/morrison_microphys_module.F90 (diff) The file was removed src/CLUBB_core/recl.inc The file was added src/Input_fields/input_names.F90 The file was modified src/CLUBB_core/advance_clubb_core_module.F90 (diff) The file was modified src/CLUBB_core/stats_clubb_utilities.F90 (diff) The file was modified src/Microphys/mixed_moment_PDF_integrals.F90 (diff) The file was modified src/jacobian.F90 (diff) The file was added utilities/split_stats_to_legacy.py The file was modified src/G_unit_tests.F90 (diff) The file was removed run_scripts/check_multi_col_avg.py The file was modified jenkins_tests/clubb_G_unit_reverse_dir_grid_test/Jenkinsfile (diff) The file was modified jenkins_tests/clubb_backwards_compatibility_gfortran_test/Jenkinsfile (diff) The file was modified jenkins_tests/clubb_timestep_convergence_gfortran_test/Jenkinsfile (diff) The file was modified input/stats/nightly_stats.in (diff) The file was modified src/Microphys/KK_microphys_module.F90 (diff) The file was added dash_app/tab_multicol.py The file was removed src/hydrostatic_module.F90 The file was added src/Input_fields/hydrostatic_module.F90 The file was modified input/stats/nobudgets_nomicro_stats.in (diff) The file was removed src/CLUBB_core/stats_rad_zm_module.F90 The file was modified jenkins_tests/clubb_nvhpc_gpu_column_mirror_test/Jenkinsfile (diff) The file was modified run_scripts/run_scm.py (diff) The file was removed src/stat_file_utils.F90 The file was modified src/int2txt.F90 (diff) The file was modified src/clubb_thread_test.F90 (diff) The file was modified src/clubb_driver_test.F90 (diff) The file was added src/Microphys/cloud_sed_module.F90 The file was modified src/Microphys/estimate_scm_microphys_module.F90 (diff) The file was removed src/CLUBB_core/input_reader.F90 The file was modified run_scripts/run_bindiff_all.py (diff) The file was modified src/CLUBB_core/setup_clubb_pdf_params.F90 (diff) The file was removed src/CLUBB_core/stats_type.F90 The file was modified input/stats/standard_stats.in (diff) The file was modified src/Microphys/advance_microphys_module.F90 (diff) The file was modified input/stats/all_stats.in (diff) The file was removed src/CLUBB_core/stats_sfc_module.F90 The file was modified jenkins_tests/clubb_restart_silhs_gfortran_test/Jenkinsfile (diff) The file was modified src/Radiation/radiation_module.F90 (diff) The file was modified src/Radiation/BUGSrad/variables_radiation_module.F90 (diff) The file was added dash_app/tab_compare.py The file was added dash_app/tab_run.py The file was modified jenkins_tests/clubb_mac_gfortran_test/Jenkinsfile (diff) The file was modified jenkins_tests/clubb_release_intel_build/Jenkinsfile (diff) The file was removed src/CLUBB_core/input_names.F90 The file was modified src/clubb_driver.F90 (diff) The file was removed src/CLUBB_core/output_netcdf.F90 The file was modified src/CLUBB_core/corr_varnce_module.F90 (diff) The file was modified jenkins_tests/clubb_fire_tuning_gfortran_test/Jenkinsfile (diff) The file was modified run_scripts/run_thread_test.py (diff) The file was modified src/CLUBB_core/mono_flux_limiter.F90 (diff) The file was added src/Input_fields/input_grads.F90 The file was modified src/Microphys/microphys_driver.F90 (diff) The file was modified jenkins_tests/clubb_silhs_convergence_gfortran/Jenkinsfile (diff) The file was modified src/Microphys/CMakeLists.txt (diff) The file was modified src/Microphys/KK_microphys/KK_upscaled_turbulent_sed.F90 (diff) The file was modified run_scripts/check_mirrored_multi_col_output.py (diff) The file was modified run_scripts/create_multi_col_params.py (diff) The file was added src/CLUBB_core/stats_netcdf.F90 The file was removed src/CLUBB_core/stat_file_module.F90 The file was modified input/stats/host_budgets_stats.in (diff) The file was modified src/Microphys/pdf_hydromet_microphys_wrapper.F90 (diff) The file was removed src/input_netcdf.F90 The file was modified input/stats/nobudgets_stats.in (diff) The file was modified src/CLUBB_core/CMakeLists.txt (diff) The file was removed src/CLUBB_core/output_grads.F90 The file was modified jenkins_tests/clubb_restart_gfortran_test/Jenkinsfile (diff) The file was removed src/input_fields.F90 The file was modified src/CLUBB_core/advance_windm_edsclrm_module.F90 (diff) The file was modified run_scripts/test_monoflux_limiter_GPU.py (diff) The file was modified run_scripts/run_bindiff_all.bash (diff) The file was modified jenkins_tests/clubb_timestep_gfortran_tests/Jenkinsfile (diff) The file was added run_scripts/check_budget_balance.py The file was modified src/Microphys/microphys_init_cleanup.F90 (diff) The file was added src/Input_fields/sounding.F90 The file was modified src/Microphys/lh_microphys_driver_module.F90 (diff) The file was modified jenkins_tests/clubb_check_budget_balance_gfortran/Jenkinsfile (diff) The file was modified src/Microphys/ice_dfsn_module.F90 (diff) The file was modified src/Radiation/simple_rad_module.F90 (diff) The file was modified src/generalized_grid_test.F90 (diff) The file was added run_scripts/run_clubb_conv_test.py The file was modified src/Benchmark_cases/prescribe_forcings.F90 (diff) The file was modified src/CLUBB_core/advance_helper_module.F90 (diff) The file was removed src/input_interpret.F90 The file was removed jenkins_tests/clubb_nvhpc_gpu_multi_col_avg_test/Jenkinsfile The file was modified src/soil_vegetation.F90 (diff) The file was modified src/G_unit_test_types/read_corr_mtx_test.F90 (diff) The file was added src/Input_fields/recl.inc The file was modified src/CLUBB_core/matrix_solver_wrapper.F90 (diff) The file was modified src/Microphys/KK_microphys/KK_upscaled_covariances.F90 (diff) The file was modified jenkins_tests/clubb_gfortran_build/Jenkinsfile (diff) The file was added run_scripts/run_tuner.py The file was modified src/CLUBB_core/advance_xp2_xpyp_module.F90 (diff) The file was removed run_scripts/run_restart_test.bash The file was removed src/sounding.F90 The file was modified README (diff) The file was removed src/CLUBB_core/stats_zt_module.F90 The file was modified src/SILHS/latin_hypercube_driver_module.F90 (diff) The file was removed src/Benchmark_cases/cloud_sed_module.F90 The file was added dash_app/app.py The file was added input/stats/fire_stats.in The file was modified src/CLUBB_core/pdf_closure_module.F90 (diff) The file was modified src/CLUBB_core/advance_wp2_wp3_module.F90 (diff) The file was added input/stats/multi_col_stats.in The file was modified jenkins_tests/clubb_rev_grid_matrix_solve_test/Jenkinsfile (diff) The file was modified jenkins_tests/clubb_openmp_gfortran_test/Jenkinsfile (diff) The file was modified src/CLUBB_core/remapping_module.F90 (diff) The file was removed src/CLUBB_core/stats_type_utilities.F90 The file was modified src/CLUBB_core/advance_xp3_module.F90 (diff) The file was modified src/SILHS/silhs_api_module.F90 (diff) The file was modified input/stats/nightly_stats_scalars.in (diff) The file was modified jenkins_tests/clubb_nvhpc_debug_build/Jenkinsfile (diff) The file was modified src/CLUBB_core/fill_holes.F90 (diff) The file was added dash_app/assets/20_autoscroll.js The file was modified jenkins_tests/clubb_nvhpc_single_prec_build/Jenkinsfile (diff) The file was modified src/G_unit_test_types/CMakeLists.txt (diff) The file was added src/Input_fields/input_reader.F90 The file was modified jenkins_tests/clubb_nvhpc_gpu_vs_cpu_diffness/Jenkinsfile (diff) The file was removed src/CLUBB_core/stats_zm_module.F90 The file was modified src/Microphys/silhs_category_variance_module.F90 (diff) The file was modified src/CLUBB_core/sfc_varnce_module.F90 (diff) The file was modified src/CLUBB_core/numerical_check.F90 (diff) The file was added run_scripts/fire_tuner.py The file was modified src/CLUBB_core/stats_netcdf.F90 (diff) The file was modified run_scripts/fire_tuner.py (diff)