Started by an SCM change12912407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master12407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master113b19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixesb19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixes108b928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_hostb928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_host34388b8239840f581d76610aa630dab6219d64d68be88b8239840f581d76610aa630dab6219d64d68berefs/remotes/origin/master88b8239840f581d76610aa630dab6219d64d68be88b8239840f581d76610aa630dab6219d64d68berefs/remotes/origin/master88b8239840f581d76610aa630dab6219d64d68be88b8239840f581d76610aa630dab6219d64d68berefs/remotes/origin/masterhttps://github.com/larson-group/clubb.git343ad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterhttps://github.com/larson-group/sys_adminhttp://carson.math.uwm.edu/jenkins/blue/organizations/jenkins/clubb_fire_tuning_gfortran_test/detail/clubb_fire_tuning_gfortran_test/343/artifactshttp://carson.math.uwm.edu/jenkins/blue/organizations/jenkins/clubb_fire_tuning_gfortran_test/detail/clubb_fire_tuning_gfortran_test/343/changeshttp://carson.math.uwm.edu/jenkins/blue/organizations/jenkins/clubb_fire_tuning_gfortran_test/detail/clubb_fire_tuning_gfortran_test/343/http://carson.math.uwm.edu/jenkins/blue/organizations/jenkins/clubb_fire_tuning_gfortran_test/detail/clubb_fire_tuning_gfortran_test/343/testsfalseCompileRun fire_tunerfalse#34326475141912456clubb_fire_tuning_gfortran_test #343343false34319943SUCCESS1673602571042http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/343/compile/config/linux_x86_64_nvhpc_casper.bashsrc/CLUBB_core/constants_clubb.F90src/CLUBB_core/model_flags.F90src/CLUBB_core/mixing_length.F90src/CLUBB_core/saturation.F9088b8239840f581d76610aa630dab6219d64d68be1673549655000http://carson.math.uwm.edu/jenkins/user/noreplynoreplynoreply@github.comRestructuring and Porting of Compute_mixing_length subroutine(Phase 1) (#1052) * Restructuring and Porting of Compute_mixing_length subroutine(Phase 1) Restructure: The compute_mixing_length is one of the top most routine taking 35-50% of the total time in a single timestep. The subroutine has been restructured to push the i-loop further down to extract vectorization and parallelization. The restructuring also involves introduction of sat_mixrat_liq_acc routines to extract parallelism when called inside a OpenACC parallel region. Porting: OpenACC directives are inserted to port the restructured compute_mixing_length code on to the GPUs. This port is currently unoptimized and there is still room for improvement. NOTE: Currently, l_sat_mixrat_lookup = false and saturation_formula = saturation_flatau (Earthworks config options) case is supported on OpenACC build. Any other options works on CPUs as usual. OpenACC declare create directives are inserted in model_flags and constants_clubb, as these module variables are used inside the saturation routines. * Added debug message about only supporting l_sat_mixrat_lookup = false and saturation_formula = saturation_flatau on GPUs Answers are Bit for Bit with arm-multicolumn case + nvhpc compiler. * Changing CLUBB debug level 1 to 0 for the saturation formula support running on GPUs * Changing indentation to make gfortran happy, it wants ifdefs to start at the beginning of the line. * Adding use statements for error checks and printouts, also making the errors set err_code to clubb_fatal_error. Co-authored-by: huebler <huebler@uwm.edu> 2023-01-12 12:54:15 -060088b8239840f581d76610aa630dab6219d64d68beRestructuring and Porting of Compute_mixing_length subroutine(Phase 1) (#1052)editsrc/CLUBB_core/mixing_length.F90editsrc/CLUBB_core/constants_clubb.F90editsrc/CLUBB_core/model_flags.F90editsrc/CLUBB_core/saturation.F90editcompile/config/linux_x86_64_nvhpc_casper.bashgithttp://carson.math.uwm.edu/jenkins/user/noreplynoreplynoreplyfalseStarted by an SCM change12912407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master12407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master113b19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixesb19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixes108b928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_hostb928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_host3447f1decd0252e0b4d80f4b3873b0b48b6d3ec86317f1decd0252e0b4d80f4b3873b0b48b6d3ec8631refs/remotes/origin/master7f1decd0252e0b4d80f4b3873b0b48b6d3ec86317f1decd0252e0b4d80f4b3873b0b48b6d3ec8631refs/remotes/origin/master7f1decd0252e0b4d80f4b3873b0b48b6d3ec86317f1decd0252e0b4d80f4b3873b0b48b6d3ec8631refs/remotes/origin/masterhttps://github.com/larson-group/clubb.git34442281d4b11e80f65897b48964d23743fc0fe53c542281d4b11e80f65897b48964d23743fc0fe53c5refs/remotes/origin/master42281d4b11e80f65897b48964d23743fc0fe53c542281d4b11e80f65897b48964d23743fc0fe53c5refs/remotes/origin/master42281d4b11e80f65897b48964d23743fc0fe53c542281d4b11e80f65897b48964d23743fc0fe53c5refs/remotes/origin/masterhttps://github.com/larson-group/sys_adminfalse#34433280891912456clubb_fire_tuning_gfortran_test #344344false34420035SUCCESS1674120968703http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/344/src/CLUBB_core/advance_clubb_core_module.F90src/CLUBB_core/model_flags.F90src/CLUBB_core/mixing_length.F90src/CLUBB_core/saturation.F907f1decd0252e0b4d80f4b3873b0b48b6d3ec86311674081416000http://carson.math.uwm.edu/jenkins/user/noreplynoreplynoreply@github.comRestructuring and Porting of Compute_mixing_length subroutine(Phase 2) (#1054) * Restructuring and Porting of Compute_mixing_length subroutine(Phase 2) Restructure: sat_mixrat_liq_2D_acc is being directly called instead of calling the 1D version inside the column loop. Changing sat_mixrat_liq_2D_acc to a subroutine from a function and adding output array, start_index as additional argument. This is a workaround for passing sub-arrays. The OpenACC doen't like the sub-arrays being passed and fails the validation. Porting: OpenACC directives are added inside sat_mixrat_liq_2D_acc for porting Validation: Answers are Bit for Bit with arm-multicolumn case + nvhpc compiler * Fix for compilation issues Issue 1: Missed out declaring 'start_index' while intergrating the change Issue 2: The use of error_code module and the procedures inside it causes OpenACC compilation issues when run on the device. * Removing the sat_mixrat_liq_acc and sat_mixrat_liq_2D_acc, making the normal sat_mixrat_liq work for all current use cases, and making the other versions of sat_mixrat_liq (bolton,gfdl,lookup) functional with OPENACC. Co-authored-by: huebler <huebler@uwm.edu> 2023-01-18 16:36:56 -06007f1decd0252e0b4d80f4b3873b0b48b6d3ec8631Restructuring and Porting of Compute_mixing_length subroutine(Phase 2) (#1054)editsrc/CLUBB_core/advance_clubb_core_module.F90editsrc/CLUBB_core/model_flags.F90editsrc/CLUBB_core/mixing_length.F90editsrc/CLUBB_core/saturation.F90gitiptable_scripts/dynamic_ip.pyiptable_scripts/hostsnetcdf_install_script/install_netcdf.bash42281d4b11e80f65897b48964d23743fc0fe53c51674081855000http://carson.math.uwm.edu/jenkins/user/cerniktcernikttjcernik@uwm.eduremoved old users from iptables hosts file and commited some code that I didnt commit 6 months ago. 2023-01-18 16:44:15 -060042281d4b11e80f65897b48964d23743fc0fe53c5removed old users from iptables hosts file and commited some code that I didnt commit 6 months ago.editiptable_scripts/hostseditnetcdf_install_script/install_netcdf.basheditiptable_scripts/dynamic_ip.pygithttp://carson.math.uwm.edu/jenkins/user/cerniktcernikthttp://carson.math.uwm.edu/jenkins/user/noreplynoreplyfalse345http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/345/343http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/343/Started by an SCM change12912407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master12407142b14155687d0d80b174796965d2793b1212407142b14155687d0d80b174796965d2793b12origin/master113b19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixesb19b67713baf175f99baa0cb0bdde6e8c1fbc588b19b67713baf175f99baa0cb0bdde6e8c1fbc588origin/grid_fixes108b928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_hostb928767c7238139d599dc55420d2a0956161726ab928767c7238139d599dc55420d2a0956161726aorigin/feeding_gr_to_host3426d5d5f573f3866d5d66b028d829342026e5690996d5d5f573f3866d5d66b028d829342026e569099refs/remotes/origin/master6d5d5f573f3866d5d66b028d829342026e5690996d5d5f573f3866d5d66b028d829342026e569099refs/remotes/origin/master6d5d5f573f3866d5d66b028d829342026e5690996d5d5f573f3866d5d66b028d829342026e569099refs/remotes/origin/masterhttps://github.com/larson-group/clubb.git342ad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdad2eeee3ae13f4ecd7f65c96eb5c5b92449333fdrefs/remotes/origin/masterhttps://github.com/larson-group/sys_adminfalse#34224182961912456clubb_fire_tuning_gfortran_test #342342false34219871SUCCESS1673516169363http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/342/src/CLUBB_core/matrix_solver_wrapper.F90src/CLUBB_core/lapack_wrap.F906d5d5f573f3866d5d66b028d829342026e5690991673472578000http://carson.math.uwm.edu/jenkins/user/37674341+huebleruwm37674341+huebleruwm37674341+huebleruwm@users.noreply.github.comPushing column loop into lapack wrap. 2023-01-11 15:29:38 -06006d5d5f573f3866d5d66b028d829342026e569099Pushing column loop into lapack wrap.editsrc/CLUBB_core/matrix_solver_wrapper.F90editsrc/CLUBB_core/lapack_wrap.F90githttp://carson.math.uwm.edu/jenkins/user/37674341+huebleruwm37674341+huebleruwmfalse343http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/343/341http://carson.math.uwm.edu/jenkins/job/clubb_fire_tuning_gfortran_test/341/