We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
d135ebb9
Benchmark comparison has identified performance shifts at:
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
| Change | Before [df4c52b6] <main~1> | After [d135ebb9] <main> | Ratio | Benchmark (Parameter) | |----------|------------------------------|---------------------------|---------|---------------------------------------------------------------| | + | 26.0±3ms | 38.5±3ms | 1.48 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
Benchmarks that have stayed the same: | Change | Before [df4c52b6] <main~1> | After [d135ebb9] <main> | Ratio | Benchmark (Parameter) | |----------|------------------------------|---------------------------|---------|---------------------------------------------------------------------------------------------| | | 59.6±0.6ms | 58.8±0.7ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) | | | 60.4±0.8ms | 59.5±0.7ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) | | | 212±1ms | 214±3ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) | | | 214±3ms | 210±2ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) | | | 38.5±0.3ms | 38.2±0.2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) | | | 39.2±0.3ms | 39.4±0.4ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) | | | 38.3±0.3ms | 38.3±0.5ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) | | | 39.0±0.5ms | 39.0±0.3ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) | | | 50.5±0.6ms | 50.5±0.9ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) | | | 51.7±0.8ms | 51.4±0.6ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) | | | 135±1ms | 131±2ms | 0.97 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) | | | 136±1ms | 131±1ms | 0.97 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) | | | 56.0±1ms | 55.5±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) | | | 58.2±0.8ms | 56.8±0.9ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) | | | 38.6±0.3ms | 37.9±0.5ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) | | | 38.9±0.4ms | 38.9±0.6ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) | | | 50.8±0.6ms | 51.1±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) | | | 51.9±0.6ms | 51.9±0.5ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) | | | 1.08±0.01s | 1.08±0.01s | 1 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) | | | 1.08±0.01s | 1.09±0.01s | 1 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) | | | 478±20ms | 485±30ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) | | | 502±10ms | 497±10ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) | | | 36.6±0.5ms | 36.8±0.4ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) | | | 37.3±0.4ms | 37.7±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) | | | 67.6±0.6ms | 65.6±0.5ms | 0.97 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) | | | 68.5±0.9ms | 67.2±0.8ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) | | | 69.4±0.8ms | 68.9±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) | | | 70.2±0.8ms | 70.3±0.7ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) | | | 64.8±0.7ms | 64.8±0.6ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) | | | 66.5±0.8ms | 65.8±0.7ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) | | | 25.1±0.4ms | 25.6±0.2ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) | | | 29.6±0.3ms | 29.9±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) | | | 147±1ms | 146±3ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) | | | 161±2ms | 162±2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) | | | 23.5±0.2ms | 23.5±0.4ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) | | | 27.6±0.3ms | 27.9±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) | | | 23.2±0.3ms | 24.0±0.5ms | 1.03 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) | | | 27.8±0.3ms | 28.2±0.2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) | | | 24.4±0.3ms | 24.4±0.3ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) | | | 28.3±0.3ms | 28.7±0.2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) | | | 37.4±0.4ms | 37.7±2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) | | | 41.4±0.5ms | 41.5±0.6ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) | | | 24.7±0.3ms | 24.6±0.09ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) | | | 29.1±0.3ms | 28.7±0.2ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) | | | 24.5±0.3ms | 24.7±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) | | | 28.9±0.2ms | 29.1±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) | | | 24.1±0.3ms | 24.2±0.1ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) | | | 28.1±0.3ms | 28.4±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) | | | 541±4ms | 544±4ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) | | | 543±2ms | 545±2ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) | | | 162±1ms | 159±2ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) | | | 180±2ms | 178±1ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) | | | 22.9±0.4ms | 23.2±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) | | | 27.2±0.2ms | 27.5±0.2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) | | | 26.6±0.3ms | 26.5±0.2ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) | | | 30.6±0.4ms | 30.5±0.4ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) | | | 26.1±0.2ms | 26.1±0.4ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) | | | 30.1±0.3ms | 30.1±0.2ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) | | | 25.3±0.1ms | 25.5±0.2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) | | | 29.8±0.3ms | 30.0±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) | | | 92.8±0.6ms | 90.8±1ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) | | | 94.3±2ms | 90.4±1ms | 0.96 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) | | | 106±1ms | 102±1ms | 0.97 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) | | | 107±1ms | 103±2ms | 0.97 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) | | | 63.5±0.5ms | 62.3±0.9ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) | | | 64.3±0.7ms | 62.2±0.8ms | 0.97 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) | | | 30.2±0.8ms | 30.7±0.6ms | 1.02 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) | | | 34.7±0.6ms | 34.9±0.8ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) | | | 32.4±0.5ms | 31.7±0.3ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) | | | 36.6±0.6ms | 36.3±0.4ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) | | | 26.6±0.3ms | 26.1±0.2ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) | | | 30.6±0.5ms | 30.5±0.3ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) | | | 330±0.9ms | 325±3ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) | | | 352±3ms | 340±3ms | 0.97 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) | | | 1.12±0.01ms | 1.13±0.01ms | 1.01 | cube.CubeCreation.time_create(False, 'construct') | | | 402±5μs | 393±3μs | 0.98 | cube.CubeCreation.time_create(False, 'instantiate') | | | 943±10μs | 956±10μs | 1.01 | cube.CubeCreation.time_create(True, 'construct') | | | 581±6μs | 592±5μs | 1.02 | cube.CubeCreation.time_create(True, 'instantiate') | | | 236±3ms | 233±2ms | 0.98 | cube.CubeEquality.time_equality(False, False, 'all_equal') | | | 127±1ms | 126±2ms | 1 | cube.CubeEquality.time_equality(False, False, 'coord_inequality') | | | 260±3ms | 258±2ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'data_inequality') | | | 16.9±0.2μs | 16.5±0.2μs | 0.98 | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') | | | 335±2ms | 335±2ms | 1 | cube.CubeEquality.time_equality(False, True, 'all_equal') | | | 226±1ms | 224±1ms | 0.99 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') | | | 360±2ms | 360±3ms | 1 | cube.CubeEquality.time_equality(False, True, 'data_inequality') | | | 17.2±0.2μs | 17.0±0.2μs | 0.99 | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') | | | 233±2ms | 235±2ms | 1.01 | cube.CubeEquality.time_equality(True, False, 'all_equal') | | | 127±1ms | 125±1ms | 0.99 | cube.CubeEquality.time_equality(True, False, 'coord_inequality') | | | 256±3ms | 259±3ms | 1.01 | cube.CubeEquality.time_equality(True, False, 'data_inequality') | | | 53.6±0.7μs | 53.5±0.6μs | 1 | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') | | | 331±2ms | 334±5ms | 1.01 | cube.CubeEquality.time_equality(True, True, 'all_equal') | | | 226±3ms | 224±2ms | 0.99 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') | | | 361±5ms | 356±3ms | 0.99 | cube.CubeEquality.time_equality(True, True, 'data_inequality') | | | 55.1±0.4μs | 56.0±0.4μs | 1.02 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') | | | 793±3μs | 794±9μs | 1 | import_iris.Iris.time__concatenate | | | 177±1μs | 180±1μs | 1.02 | import_iris.Iris.time__constraints | | | 109±2μs | 110±0.8μs | 1.01 | import_iris.Iris.time__data_manager | | | 96.5±0.7μs | 93.2±0.3μs | 0.97 | import_iris.Iris.time__deprecation | | | 138±2μs | 138±2μs | 1 | import_iris.Iris.time__lazy_data | | | 911±10μs | 907±4μs | 1 | import_iris.Iris.time__merge | | | 76.7±0.7μs | 76.9±0.6μs | 1 | import_iris.Iris.time__representation | | | 582±3μs | 589±3μs | 1.01 | import_iris.Iris.time_analysis | | | 140±1μs | 139±1μs | 1 | import_iris.Iris.time_analysis__area_weighted | | | 109±0.6μs | 109±1μs | 1 | import_iris.Iris.time_analysis__grid_angles | | | 241±2μs | 240±0.5μs | 0.99 | import_iris.Iris.time_analysis__interpolation | | | 187±3μs | 189±2μs | 1.01 | import_iris.Iris.time_analysis__regrid | | | 113±0.7μs | 111±0.6μs | 0.98 | import_iris.Iris.time_analysis__scipy_interpolate | | | 139±1μs | 137±2μs | 0.99 | import_iris.Iris.time_analysis_calculus | | | 329±5μs | 331±1μs | 1 | import_iris.Iris.time_analysis_cartography | | | 93.3±0.5μs | 94.3±0.4μs | 1.01 | import_iris.Iris.time_analysis_geomerty | | | 219±1μs | 221±4μs | 1.01 | import_iris.Iris.time_analysis_maths | | | 98.2±0.7μs | 97.0±3μs | 0.99 | import_iris.Iris.time_analysis_stats | | | 171±2μs | 171±2μs | 1 | import_iris.Iris.time_analysis_trajectory | | | 302±4μs | 305±3μs | 1.01 | import_iris.Iris.time_aux_factory | | | 84.7±1μs | 84.8±1μs | 1 | import_iris.Iris.time_common | | | 159±0.7μs | 165±3μs | 1.04 | import_iris.Iris.time_common_lenient | | | 1.33±0.01ms | 1.34±0.01ms | 1 | import_iris.Iris.time_common_metadata | | | 162±1μs | 164±1μs | 1.01 | import_iris.Iris.time_common_mixin | | | 1.19±0ms | 1.18±0.01ms | 1 | import_iris.Iris.time_common_resolve | | | 197±0.9μs | 200±0.8μs | 1.01 | import_iris.Iris.time_config | | | 122±0.4μs | 123±2μs | 1 | import_iris.Iris.time_coord_categorisation | | | 368±4μs | 363±2μs | 0.98 | import_iris.Iris.time_coord_systems | | | 747±7μs | 749±3μs | 1 | import_iris.Iris.time_coords | | | 651±7μs | 649±7μs | 1 | import_iris.Iris.time_cube | | | 227±2μs | 220±2μs | 0.97 | import_iris.Iris.time_exceptions | | | 77.5±1μs | 77.6±0.8μs | 1 | import_iris.Iris.time_experimental | | | 184±0.6μs | 183±1μs | 0.99 | import_iris.Iris.time_fileformats | | | 248±2μs | 250±1μs | 1 | import_iris.Iris.time_fileformats__ff | | | 2.74±0.02ms | 2.65±0.02ms | 0.97 | import_iris.Iris.time_fileformats__ff_cross_references | | | 79.0±0.4μs | 78.5±0.4μs | 0.99 | import_iris.Iris.time_fileformats__pp_lbproc_pairs | | | 114±1μs | 113±0.6μs | 1 | import_iris.Iris.time_fileformats_abf | | | 402±3μs | 411±6μs | 1.02 | import_iris.Iris.time_fileformats_cf | | | 5.28±0.06ms | 5.25±0.05ms | 1 | import_iris.Iris.time_fileformats_dot | | | 74.1±0.4μs | 75.0±1μs | 1.01 | import_iris.Iris.time_fileformats_name | | | 258±2μs | 257±1μs | 1 | import_iris.Iris.time_fileformats_name_loaders | | | 119±0.9μs | 119±1μs | 1 | import_iris.Iris.time_fileformats_netcdf | | | 122±1μs | 122±1μs | 1 | import_iris.Iris.time_fileformats_nimrod | | | 209±2μs | 210±0.8μs | 1 | import_iris.Iris.time_fileformats_nimrod_load_rules | | | 786±4μs | 787±5μs | 1 | import_iris.Iris.time_fileformats_pp | | | 180±0.6μs | 179±4μs | 0.99 | import_iris.Iris.time_fileformats_pp_load_rules | | | 136±2μs | 133±4μs | 0.98 | import_iris.Iris.time_fileformats_pp_save_rules | | | 545±1μs | 548±3μs | 1.01 | import_iris.Iris.time_fileformats_rules | | | 219±1μs | 222±5μs | 1.01 | import_iris.Iris.time_fileformats_structured_array_identification | | | 83.9±0.5μs | 83.2±0.4μs | 0.99 | import_iris.Iris.time_fileformats_um | | | 161±0.6μs | 159±2μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load | | | 136±0.9μs | 135±0.4μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields | | | 76.2±0.6μs | 75.7±1μs | 0.99 | import_iris.Iris.time_fileformats_um__ff_replacement | | | 81.4±2μs | 81.2±0.7μs | 1 | import_iris.Iris.time_fileformats_um__optimal_array_structuring | | | 991±7μs | 975±6μs | 0.98 | import_iris.Iris.time_fileformats_um_cf_map | | | 136±3μs | 135±1μs | 0.99 | import_iris.Iris.time_io | | | 174±2μs | 174±3μs | 1 | import_iris.Iris.time_io_format_picker | | | 283±2μs | 286±2μs | 1.01 | import_iris.Iris.time_iris | | | 127±1μs | 127±0.7μs | 1 | import_iris.Iris.time_iterate | | | 8.13±0.05ms | 8.23±0.08ms | 1.01 | import_iris.Iris.time_palette | | | 1.89±0.01ms | 1.90±0ms | 1.01 | import_iris.Iris.time_plot | | | 104±1μs | 104±0.7μs | 1 | import_iris.Iris.time_quickplot | | | 2.19±0.01ms | 2.15±0.03ms | 0.98 | import_iris.Iris.time_std_names | | | 1.75±0.03ms | 1.78±0ms | 1.02 | import_iris.Iris.time_symbols | | | 33.5±0.8ms | 33.8±0.6ms | 1.01 | import_iris.Iris.time_tests | | | 252±1μs | 257±1μs | 1.02 | import_iris.Iris.time_third_party_cartopy | | | 4.77±0.02ms | 4.75±0.03ms | 1 | import_iris.Iris.time_third_party_cf_units | | | 120±0.8μs | 119±0.8μs | 0.99 | import_iris.Iris.time_third_party_cftime | | | 2.80±0.01ms | 2.90±0.01ms | 1.03 | import_iris.Iris.time_third_party_matplotlib | | | 1.53±0.03ms | 1.54±0.01ms | 1 | import_iris.Iris.time_third_party_numpy | | | 172±2μs | 171±1μs | 0.99 | import_iris.Iris.time_third_party_scipy | | | 101±0.9μs | 101±2μs | 1 | import_iris.Iris.time_time | | | 328±4μs | 323±2μs | 0.99 | import_iris.Iris.time_util | | | 72.7±1μs | 70.9±1μs | 0.98 | iterate.IZip.time_izip | | | 9.98±0.04ms | 10.0±0.1ms | 1.01 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') | | | 26.2±0.6ms | 27.5±0.6ms | 1.05 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') | | | 9.97±0.08ms | 10.2±0.05ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') | | | 9.86±0.2ms | 10.1±0.2ms | 1.03 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') | | | 22.0±0.3ms | 22.4±0.06ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') | | | 9.91±0.06ms | 10.2±0.1ms | 1.03 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') | | | 1.58±0.01s | 1.60±0.02s | 1.02 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') | | | 22.5±0.4ms | 22.8±0.07ms | 1.01 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') | | | 1.58±0.02s | 1.59±0.02s | 1.01 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') | | | 1.58±0.02s | 1.58±0.01s | 1 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') | | | 22.1±0.1ms | 22.8±0.2ms | 1.03 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') | | | 1.57±0.01s | 1.62±0.02s | 1.03 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') | | | 5.08±0.04ms | 5.19±0.05ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') | | | 20.6±0.2ms | 21.8±0.6ms | 1.06 | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') | | | 5.05±0.06ms | 5.14±0.1ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') | | | 5.09±0.02ms | 5.17±0.2ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') | | | 20.6±0.2ms | 21.1±1ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') | | | 5.04±0.05ms | 5.10±0.3ms | 1.01 | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') | | | 19.9±0.2ms | 19.8±0.4ms | 1 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') | | | 13.5±0.9ms | 13.4±1ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') | | | 26.7±1ms | 26.5±2ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') | | | 78.8±0.4ms | 71.5±2ms | 0.91 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') | | | 26.8±2ms | 26.6±2ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') | | | 479±2ms | 482±5ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') | | | 2.78±0.05ms | 2.85±0.3ms | 1.03 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') | | | 481±4ms | 485±20ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') | | | 493±3ms | 496±7ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') | | | 2.88±0.07ms | 2.97±0.08ms | 1.03 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') | | | 488±4ms | 497±4ms | 1.02 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') | | | 1.66±0.03ms | 1.67±0.06ms | 1 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') | | | 2.76±0.08ms | 2.81±0.09ms | 1.02 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') | | | 1.66±0.09ms | 1.70±0.07ms | 1.03 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') | | | 1.67±0.04ms | 1.71±0.07ms | 1.02 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') | | | 2.94±0.09ms | 2.97±0.08ms | 1.01 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') | | | 1.69±0.04ms | 1.72±0.07ms | 1.02 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') | | | 358±2ms | 364±1ms | 1.02 | load.ManyVars.time_many_var_load | | | 10.1±0.1ms | 10.0±0.1ms | 0.99 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') | | | 10.1±0.02ms | 10.4±0.1ms | 1.03 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') | | | 1.57±0.01s | 1.59±0.02s | 1.02 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') | | | 1.60±0.02s | 1.61±0.01s | 1.01 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') | | | 5.13±0.02ms | 5.20±0.04ms | 1.01 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') | | | 5.14±0.05ms | 5.20±0.05ms | 1.01 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') | | | 9.13±0.2ms | 9.35±0.07ms | 1.02 | load.StructuredFF.time_structured_load((1280, 960, 5), False) | | | 5.87±0.08ms | 6.03±0.07ms | 1.03 | load.StructuredFF.time_structured_load((1280, 960, 5), True) | | | 1.55±0.01s | 1.57±0.01s | 1.01 | load.StructuredFF.time_structured_load((2, 2, 1000), False) | | | 523±4ms | 554±5ms | 1.06 | load.StructuredFF.time_structured_load((2, 2, 1000), True) | | | 4.31±0.04ms | 4.38±0.03ms | 1.02 | load.StructuredFF.time_structured_load((2, 2, 2), False) | | | 4.18±0.04ms | 4.24±0.02ms | 1.01 | load.StructuredFF.time_structured_load((2, 2, 2), True) | | | 169±2ms | 172±3ms | 1.02 | load.TimeConstraint.time_time_constraint(20, 'FF') | | | 24.2±0.2ms | 24.5±0.3ms | 1.01 | load.TimeConstraint.time_time_constraint(20, 'NetCDF') | | | 169±0.4ms | 172±5ms | 1.02 | load.TimeConstraint.time_time_constraint(20, 'PP') | | | 32.9±0.3ms | 33.8±0.4ms | 1.03 | load.TimeConstraint.time_time_constraint(3, 'FF') | | | 23.5±0.2ms | 24.0±0.2ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'NetCDF') | | | 33.3±0.07ms | 33.9±0.4ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'PP') | | | 19.2±0.2ms | 19.3±0.2ms | 1.01 | load.ugrid.BasicLoading.time_load_file(1) | | | 53.5±0.6ms | 55.5±1ms | 1.04 | load.ugrid.BasicLoading.time_load_file(200000) | | | 14.4±0.07ms | 14.9±0.2ms | 1.03 | load.ugrid.BasicLoading.time_load_mesh(1) | | | 24.6±0.3ms | 24.7±0.7ms | 1.01 | load.ugrid.BasicLoading.time_load_mesh(200000) | | | 19.0±0.2ms | 19.7±0.2ms | 1.04 | load.ugrid.BasicLoadingTime.time_load_file(1) | | | 23.3±0.2ms | 23.7±0.3ms | 1.02 | load.ugrid.BasicLoadingTime.time_load_file(200000) | | | 14.4±0.1ms | 14.6±0.09ms | 1.01 | load.ugrid.BasicLoadingTime.time_load_mesh(1) | | | 18.9±0.2ms | 18.9±0.3ms | 1 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) | | | 19.9±0.2ms | 20.6±0.5ms | 1.04 | load.ugrid.Callback.time_load_file_callback(1) | | | 64.9±1ms | 66.8±1ms | 1.03 | load.ugrid.Callback.time_load_file_callback(200000) | | | 20.3±0.3ms | 20.2±0.3ms | 0.99 | load.ugrid.CallbackTime.time_load_file_callback(1) | | | 24.8±0.1ms | 25.2±0.4ms | 1.02 | load.ugrid.CallbackTime.time_load_file_callback(200000) | | | 2.71±0.08ms | 2.78±0.09ms | 1.03 | load.ugrid.DataRealisation.time_realise_data(10000) | | | 4.71±0.09ms | 3.95±0.3ms | 0.84 | load.ugrid.DataRealisation.time_realise_data(200000) | | | 34.6±0.9ms | 34.2±1ms | 0.99 | load.ugrid.DataRealisationTime.time_realise_data(10000) | | | 774±4ms | 766±9ms | 0.99 | load.ugrid.DataRealisationTime.time_realise_data(200000) | | | 421±4ms | 445±4ms | 1.06 | merge_concat.Concatenate.time_concatenate(False) | | | 424±4ms | 445±6ms | 1.05 | merge_concat.Concatenate.time_concatenate(True) | | | 109±0.3M | 109±0.1M | 1 | merge_concat.Concatenate.tracemalloc_concatenate(False) | | | 109±0.3M | 109±0.2M | 1 | merge_concat.Concatenate.tracemalloc_concatenate(True) | | | 56.1±0.2ms | 55.3±0.6ms | 0.98 | merge_concat.Merge.time_merge | | | 1.62±0.2M | 1.62±0.2M | 1 | merge_concat.Merge.tracemalloc_merge | | | 453±3ns | 405±5ns | 0.89 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) | | | 216±1ms | 212±1ms | 0.98 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) | | | 658±1k | 650±0.1k | 0.99 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(50) | | | 60.1±0M | 60.1±0M | 1 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(500) | | | 16.6±0.3ms | 17.5±0.3ms | 1.05 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) | | | 18.9±0.5ms | 19.7±0.4ms | 1.04 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) | | | 808±0.7k | 698±50k | 0.86 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) | | | 12.7±0M | 12.6±0.05M | 0.99 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(500) | | | 116±0.8ms | 118±0.4ms | 1.01 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) | | | 675±10ms | 659±9ms | 0.98 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) | | | 1.21±0.01M | 1.23±0.02M | 1.02 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(50) | | | 96.3±0.03M | 96.3±0.01M | 1 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(500) | | | 76.6±1ms | 76.1±2ms | 0.99 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) | | | 630±7ms | 624±4ms | 0.99 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) | | | 1.18±0.01M | 1.17±0.02M | 0.99 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(50) | | | 96.2±0.01M | 96.2±0.01M | 1 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(500) | | | 2.1752849999999997 | 2.1752849999999997 | 1 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) | | | 216.01528499999998 | 216.01528499999998 | 1 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) | | | 6.41±0.1ms | 6.51±0.02ms | 1.01 | plot.AuxSort.time_aux_sort | | | 68.7±5ms | 76.5±4ms | 1.11 | regridding.CurvilinearRegridding.time_regrid_pic | | | 136±3M | 136±3M | 1 | regridding.CurvilinearRegridding.tracemalloc_regrid_pic | | | 99.2±0.5ms | 98.6±0.8ms | 0.99 | regridding.HorizontalChunkedRegridding.time_regrid_area_w | | | 47.9±1ms | 49.8±0.8ms | 1.04 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid | | | 106±0.04M | 106±0.05M | 1 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w | | | 147±0.02M | 147±0.02M | 1 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w_new_grid | | | 4.47±0.01ms | 4.53±0.03ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(50, False) | | | 79.7±0.8ms | 80.2±1ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(50, True) | | | 51.7±0.7ms | 51.8±1ms | 1 | save.NetcdfSave.time_netcdf_save_cube(600, False) | | | 577±4ms | 583±3ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(600, True) | | | 90.3±0.9ns | 86.5±0.5ns | 0.96 | save.NetcdfSave.time_netcdf_save_mesh(50, False) | | | 62.2±0.4ms | 61.6±0.8ms | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, True) | | | 87.9±0.8ns | 87.3±0.7ns | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(600, False) | | | 507±3ms | 513±2ms | 1.01 | save.NetcdfSave.time_netcdf_save_mesh(600, True) | | | 28.9±0.06k | 30.1±0.07k | 1.04 | save.NetcdfSave.tracemalloc_netcdf_save(50, False) | | | 1.77±0.2M | 1.68±0.1M | 0.95 | save.NetcdfSave.tracemalloc_netcdf_save(50, True) | | | 28.9±0.05k | 30.1±0.08k | 1.04 | save.NetcdfSave.tracemalloc_netcdf_save(600, False) | | | 225±20M | 191±20M | 0.85 | save.NetcdfSave.tracemalloc_netcdf_save(600, True) | | | 41.7±0.4ms | 40.7±0.6ms | 0.98 | stats.PearsonR.time_lazy | | | 8.86±0.1ms | 8.91±0.2ms | 1.01 | stats.PearsonR.time_real | | | 24.9±0.3M | 24.2±1M | 0.97 | stats.PearsonR.tracemalloc_lazy | | | 18.4±0.01M | 18.4±0.01M | 1 | stats.PearsonR.tracemalloc_real | | | 22.7±0.4ms | 26.4±0.9ms | 1.16 | trajectory.TrajectoryInterpolation.time_trajectory_linear | | | 59.1±0.5ms | 70.1±0.6ms | 1.19 | trajectory.TrajectoryInterpolation.time_trajectory_nearest | | | 23.3±0.01M | 23.3±0.01M | 1 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_linear | | | 12.1±0.04M | 12.1±0.04M | 1 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_nearest | Benchmarks that have got worse: | Change | Before [df4c52b6] <main~1> | After [d135ebb9] <main> | Ratio | Benchmark (Parameter) | |----------|------------------------------|---------------------------|---------|---------------------------------------------------------------| | + | 26.0±3ms | 38.5±3ms | 1.48 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
Generated by GHA run 12402780526
12402780526
The text was updated successfully, but these errors were encountered:
Disappointing but presumably a consequence of #6251 which we eventually overcome
Sorry, something went wrong.
stephenworsley
No branches or pull requests
Benchmark comparison has identified performance shifts at:
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: d135ebb
Performance shifts
Full benchmark results
Generated by GHA run
12402780526
The text was updated successfully, but these errors were encountered: