Skip to content
Failed

Changes

Summary

  1. Improve Dash workflows and broker services (#1342) (details)
Commit 1db1e01971bca05b2e95037f97c94aae0a827a50 by noreply
Improve Dash workflows and broker services (#1342)

* Improve Dash workflows and broker services

Streamline run telemetry and output-scoped admission, add build selection and pyplotgen export support, improve profile and tuning workflows, and make Tune failures column-local and recoverable.

* A little cleanup

* Simplification in SILHS to keep errors silent in debug=-1 mode, and removing accidental change in advance_clubb_core.F90

* Little dash fix and comment improvement

* Replacing scipy usage in the adam initial point choosing with numpy

* Removing l_rtm_nudge from flag set file used by run_bindiff_w_flags tests. This is technically a model_setting, so it shouldn't be here, and is already enabled by cgils_s12, so will remain tested in at least one case.
The file was addeddash_app/plot_tab/callbacks_pyplotgen.py
The file was modifieddash_app/profile_tab/library.py (diff)
The file was modifieddash_app/plot_tab/layout.py (diff)
The file was modifieddash_app/pytests/test_taylor_window_display.py (diff)
The file was modifieddash_app/profile_tab/layout.py (diff)
The file was modifieddash_app/run_tab/tab.py (diff)
The file was addedtests/pytests/test_run_clubb_conv_test.py
The file was modifieddash_app/pytests/test_profile_tab.py (diff)
The file was modifiedutilities/time_clubb.py (diff)
The file was modifieddash_app/run_tab/config_state.py (diff)
The file was modifieddash_app/manager.py (diff)
The file was modifieddash_app/pytests/test_agent_tuning.py (diff)
The file was modifieddash_app/pytests/test_tune_callbacks_settings.py (diff)
The file was modifiedtuner/status.py (diff)
The file was modifieddash_app/pytests/test_callbacks_runs.py (diff)
The file was modifieddash_app/shared/gateway.py (diff)
The file was modifieddash_app/profile_tab/runtime.py (diff)
The file was modifieddash_app/profile_tab/tab.py (diff)
The file was modifieddash_app/run_tab/state.py (diff)
The file was modifiedtuner/pytests/test_tuning_strategy.py (diff)
The file was modifiedtuner/tuning_strategy.py (diff)
The file was modifieddash_app/pytests/test_compile_tab_build_status.py (diff)
The file was modifiedsrc/CLUBB_core/adg1_adg2_3d_luhar_pdf.F90 (diff)
The file was modifiedutilities/save_tunable_config.py (diff)
The file was modifieddash_app/tune_tab/callbacks_runs.py (diff)
The file was modifieddash_app/app.py (diff)
The file was addeddash_app/pytests/test_sam_3d_reference.py
The file was addeddash_app/plot_tab/pyplotgen_runtime.py
The file was modifieddash_app/pytests/test_run_callbacks_settings.py (diff)
The file was addeddash_app/assets/10_build_selector.js
The file was modifiedsrc/CLUBB_core/setup_clubb_pdf_params.F90 (diff)
The file was modifiedpostprocessing/pyplotgen/pyplotgen.py (diff)
The file was modifieddash_app/pytests/test_runtime_loss_batches.py (diff)
The file was modifiedtests/run_clubb_conv_test.py (diff)
The file was modifieddash_app/run_tab/callbacks_console.py (diff)
The file was modifieddash_app/run_tab/callbacks_settings.py (diff)
The file was modifiedutilities/timing_profiles.py (diff)
The file was modifiedutilities/create_case_namelist.py (diff)
The file was modifiedtuner/tuning_scheduler.py (diff)
The file was modifiedtuner/request.py (diff)
The file was modifieddash_app/pytests/test_agent_services.py (diff)
The file was addeddash_app/pytests/test_pyplotgen_export.py
The file was modifieddash_app/pytests/test_selected_build.py (diff)
The file was modifiedinput/flag_sets/run_bindiff_w_flags_config_core_flags.json (diff)
The file was modifieddash_app/compile_tab/tab.py (diff)
The file was modifieddash_app/agent_integration/mcp_server.py (diff)
The file was modifieddash_app/run_tab/callbacks_selection.py (diff)
The file was modifieddash_app/persistence.py (diff)
The file was modifieddash_app/run_tab/callbacks_runs.py (diff)
The file was modifieddash_app/assets/12_tab_plots_theme.css (diff)
The file was addeddash_app/pytests/test_dashboard_activity_labels.py
The file was modifieddash_app/tune_tab/callbacks_settings.py (diff)
The file was addeddash_app/pytests/test_run_broker_simplification.py
The file was modifieddash_app/agent_integration/handoff.py (diff)
The file was modifieddash_app/pytests/test_agent_tab_registry.py (diff)
The file was modifieddash_app/plot_tab/callbacks_case.py (diff)
The file was modifieddash_app/pytests/test_profiles.py (diff)
The file was modifieddash_app/plot_tab/tab.py (diff)
The file was addeddash_app/pytests/test_pyplotgen_output_handler.py
The file was modifiedsrc/clubb_loss_driver.F90 (diff)
The file was modifieddash_app/plot_tab/callbacks_params.py (diff)
The file was addedtuner/pytests/test_adam_baselines.py
The file was modifiedsrc/SILHS/latin_hypercube_driver_module.F90 (diff)
The file was removeddash_app/shared/selected_build.py
The file was modifieddash_app/compile_tab/callbacks.py (diff)
The file was modifieddash_app/pytests/test_agent_plot_actions.py (diff)
The file was modifieddash_app/pytests/test_pdf_contour_plot.py (diff)
The file was modifieddash_app/services/models.py (diff)
The file was modifieddash_app/pytests/test_run_runtime.py (diff)
The file was modifiedrun_scripts/run_tuner_job.py (diff)
The file was modifieddash_app/pytests/test_analysis.py (diff)
The file was modifieddash_app/pytests/test_activity.py (diff)
The file was modifieddash_app/tune_tab/runtime.py (diff)
The file was modifieddash_app/tune_tab/tab.py (diff)
The file was modifieddash_app/pytests/test_output_directory_picker.py (diff)
The file was modifieddash_app/services/profiles.py (diff)
The file was modifiedtuner/enhanced_simann_strategy.py (diff)
The file was modifieddash_app/assets/11_tab_run_theme.css (diff)
The file was modifiedsrc/CLUBB_core/pdf_closure_module.F90 (diff)
The file was addeddash_app/run_tab/telemetry.py
The file was modifieddash_app/tune_tab/callbacks_display.py (diff)
The file was addeddash_app/assets/38_plots_pyplotgen.js
The file was modifiedsrc/SILHS/silhs_importance_sample_module.F90 (diff)
The file was modifieddash_app/profile_tab/figures.py (diff)
The file was modifieddash_app/pytests/test_persistence.py (diff)
The file was modifieddash_app/shared/activity.py (diff)
The file was addeddash_app/compile_tab/build_selector.py
The file was modifieddash_app/run_tab/runtime.py (diff)
The file was modifieddash_app/assets/15_tab_profile_theme.css (diff)
The file was modifieddash_app/plot_tab/plot_types/pdf_contour_plot.py (diff)
The file was modifieddash_app/pytests/test_state_persistence.py (diff)
The file was modifieddash_app/profile_tab/callbacks.py (diff)
The file was addedtuner/adam_spsa_strategy.py
The file was modifieddash_app/assets/37_run_console_state.js (diff)
The file was modifiedpostprocessing/pyplotgen/src/OutputHandler.py (diff)
The file was modifieddash_app/pytests/test_scm_override.py (diff)
The file was modifieddash_app/shared/runtime.py (diff)
The file was modifieddash_app/pytests/test_dashboard_manager.py (diff)
The file was removeddash_app/assets/32_plots_output_menu.js
The file was modifieddash_app/services/jobs.py (diff)
The file was modifieddash_app/assets/34_run_param_clientside.js (diff)
The file was modifiedutilities/pytests/test_time_clubb.py (diff)
The file was modifieddash_app/README.md (diff)
The file was modifieddash_app/assets/09_selected_build_badge.css (diff)
The file was modifieddash_app/plot_tab/plot_types/help_content.py (diff)
The file was modifieddash_app/assets/20_autoscroll.js (diff)
The file was addeddash_app/plot_tab/static.py
The file was modifiedtuner/README.md (diff)
The file was modifieddash_app/run_tab/layout.py (diff)
The file was modifieddash_app/misc_tab/mixing_length_trajectories/analysis.py (diff)
The file was modifiedtuner/tuning_worker.py (diff)
The file was modifieddash_app/run_tab/namelist.py (diff)
The file was modifiedutilities/sam_3d_reference.py (diff)
The file was modifiedsrc/clubb_driver.F90 (diff)
The file was modifieddash_app/assets/37_workspace_persistence.js (diff)
The file was modifieddash_app/assets/13_tab_tune_theme.css (diff)
The file was modifieddash_app/shared/actions.py (diff)
The file was modifieddash_app/tune_tab/layout.py (diff)
The file was modifieddash_app/DEVELOPMENT.md (diff)
The file was modifieddash_app/pytests/test_tunable_config_save.py (diff)
The file was modifiedutilities/pytests/test_timing_profiles.py (diff)
The file was modifieddash_app/pytests/test_param_disclosures.py (diff)
The file was modifieddash_app/shared/broker.py (diff)
The file was modifieddash_app/shared/broker_protocol.py (diff)