Skip to content

Instantly share code, notes, and snippets.

@zamazan4ik

zamazan4ik/gist:27734cb744ce2cd57e12ad8eda95e318

Created January 28, 2024 02:31
Show Gist options
  • Save zamazan4ik/27734cb744ce2cd57e12ad8eda95e318 to your computer and use it in GitHub Desktop.
Save zamazan4ik/27734cb744ce2cd57e12ad8eda95e318 to your computer and use it in GitHub Desktop.
Download ZIP
lace: Optimized to Release
Raw
gistfile1.txt
cargo pgo optimize bench -- --all-features --workspace
[2024-01-28T02:12:36Z INFO cargo_pgo::pgo::optimize] Found 17 PGO profile files with total size 80.21 MiB at /home/zamazan4ik/open_source/lace/lace/target/pgo-profiles.
[2024-01-28T02:12:37Z INFO cargo_pgo::pgo::optimize] Merged PGO profile(s) to /home/zamazan4ik/open_source/lace/lace/target/pgo-profiles/merged-9352bf5e450bc1ac6d21b02d9533b175ecf8e6698dcc12fc62964e6b6aa326ad.profdata.
Compiling cfg-if v1.0.0
Compiling once_cell v1.19.0
Compiling zerocopy v0.7.32
Compiling either v1.9.0
Compiling ryu v1.0.16
Compiling itoa v1.0.10
Compiling ppv-lite86 v0.2.17
Compiling static_assertions v1.1.0
Compiling memchr v2.7.1
Compiling regex-syntax v0.8.2
Compiling allocator-api2 v0.2.16
Compiling libc v0.2.152
Compiling libm v0.2.8
Compiling crossbeam-utils v0.8.19
Compiling equivalent v1.0.1
Compiling array-init-cursor v0.2.0
Compiling bitflags v2.4.2
Compiling serde v1.0.195
Compiling bytemuck v1.14.0
Compiling thiserror v1.0.56
Compiling rawpointer v0.2.1
Compiling simdutf8 v0.1.4
Compiling zstd-sys v2.0.9+zstd.1.5.5
Compiling planus v0.3.1
Compiling target-features v0.1.5
Compiling smartstring v1.0.1
Compiling typenum v1.17.0
Compiling dyn-clone v1.0.16
Compiling order-stat v0.1.3
Compiling puruspe v0.2.0
Compiling doc-comment v0.3.3
Compiling zstd-safe v7.0.0
Compiling lexical-util v0.8.5
Compiling foreign_vec v0.1.0
Compiling atoi_simd v0.15.6
Compiling streaming-iterator v0.1.9
Compiling strength_reduce v0.2.4
Compiling fast-float v0.2.0
Compiling ethnum v1.5.0
Compiling itertools v0.12.0
Compiling alloc-no-stdlib v2.0.4
Compiling safe_arch v0.7.1
Compiling zstd v0.13.0
Compiling multiversion v0.7.3
Compiling alloc-stdlib v0.2.2
Compiling adler v1.0.2
Compiling fallible-streaming-iterator v0.1.9
Compiling ref-cast v1.0.22
Compiling crc32fast v1.3.2
Compiling xxhash-rust v0.8.8
Compiling percent-encoding v2.3.1
Compiling miniz_oxide v0.7.1
Compiling snap v1.1.1
Compiling brotli-decompressor v2.5.1
Compiling base64 v0.21.7
Compiling parquet-format-safe v0.2.4
Compiling unsafe-libyaml v0.2.10
Compiling streaming-decompression v0.1.2
Compiling linux-raw-sys v0.4.13
Compiling crossbeam-epoch v0.9.18
Compiling crossbeam-channel v0.5.11
Compiling portable-atomic v1.6.0
Compiling unicode-width v0.1.11
Compiling home v0.5.9
Compiling num-traits v0.2.17
Compiling special v0.10.3
Compiling aho-corasick v1.1.2
Compiling wide v0.7.13
Compiling utf8parse v0.2.1
Compiling lazy_static v1.4.0
Compiling bytes v1.5.0
Compiling crossbeam-deque v0.8.5
Compiling anstyle-parse v0.2.3
Compiling number_prefix v0.4.0
Compiling colorchoice v1.0.0
Compiling flate2 v1.0.28
Compiling anstyle v1.0.4
Compiling anstyle-query v1.0.2
Compiling rayon-core v1.12.1
Compiling ciborium-io v0.2.1
Compiling clap_lex v0.6.0
Compiling plotters-backend v0.3.5
Compiling thread-tree v0.3.3
Compiling rustix v0.38.30
Compiling half v1.8.2
Compiling anstream v0.6.11
Compiling strsim v0.10.0
Compiling plotters-svg v0.3.5
Compiling lexical-write-integer v0.8.5
Compiling lexical-parse-integer v0.8.6
Compiling ciborium-ll v0.2.1
Compiling itertools v0.10.5
Compiling clap_builder v4.4.18
Compiling cast v0.3.0
Compiling same-file v1.0.6
Compiling oorandom v11.1.3
Compiling lexical-write-float v0.8.5
Compiling lexical-parse-float v0.8.5
Compiling rayon v1.8.1
Compiling walkdir v2.4.0
Compiling anes v0.1.6
Compiling log v0.4.20
Compiling fastrand v2.0.1
Compiling brotli v3.4.0
Compiling num-integer v0.1.45
Compiling approx v0.5.1
Compiling chrono v0.4.31
Compiling getrandom v0.2.12
Compiling num_cpus v1.16.0
Compiling lz4-sys v1.9.4
Compiling float-cmp v0.9.0
Compiling ahash v0.8.7
Compiling lz4 v1.24.0
Compiling memmap2 v0.7.1
Compiling matrixmultiply v0.3.8
Compiling num-bigint v0.4.4
Compiling num-iter v0.1.43
Compiling lexical-core v0.8.5
Compiling argminmax v0.6.1
Compiling console v0.15.8
Compiling plotters v0.3.5
Compiling option-ext v0.2.0
Compiling hex v0.4.3
Compiling nix v0.27.1
Compiling hashbrown v0.13.2
Compiling dirs-sys v0.4.1
Compiling humansize v2.1.3
Compiling askama_escape v0.10.3
Compiling dirs v5.0.1
Compiling regex-automata v0.4.3
Compiling maplit v1.0.2
Compiling indicatif v0.17.7
Compiling lru v0.9.0
Compiling criterion-plot v0.5.0
Compiling ctrlc v3.4.2
Compiling rand_core v0.6.4
Compiling num-complex v0.4.4
Compiling serde_json v1.0.111
Compiling arrow-format v0.8.1
Compiling halfbrown v0.2.4
Compiling ciborium v0.2.1
Compiling bincode v1.3.3
Compiling is-terminal v0.4.10
Compiling tempfile v3.9.0
Compiling erased-serde v0.3.31
Compiling num-rational v0.4.1
Compiling rand_chacha v0.3.1
Compiling rand_xoshiro v0.6.0
Compiling value-trait v0.8.0
Compiling serde_with v2.3.3
Compiling rand v0.8.5
Compiling simba v0.8.1
Compiling num v0.4.1
Compiling clap v4.4.18
Compiling hashbrown v0.14.3
Compiling simd-json v0.13.7
Compiling tinytemplate v1.2.1
Compiling askama v0.12.1
Compiling regex v1.10.2
Compiling rand_distr v0.4.3
Compiling lace_utils v0.2.0 (/home/zamazan4ik/open_source/lace/lace/lace_utils)
Compiling indexmap v2.1.0
Compiling criterion v0.5.1
Compiling lace_data v0.2.0 (/home/zamazan4ik/open_source/lace/lace/lace_data)
Compiling peroxide v0.32.1
Compiling plotly v0.8.4
Compiling polars-error v0.36.2
Compiling serde_yaml v0.9.30
Compiling polars-utils v0.36.2
Compiling polars-arrow v0.36.2
Compiling nalgebra v0.32.3
Compiling polars-compute v0.36.2
Compiling polars-row v0.36.2
Compiling polars-json v0.36.2
Compiling polars-parquet v0.36.2
Compiling polars-core v0.36.2
Compiling rv v0.16.2
Compiling polars-ops v0.36.2
Compiling polars-io v0.36.2
Compiling lace_consts v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_consts)
Compiling lace_stats v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_stats)
Compiling lace_geweke v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_geweke)
Compiling polars v0.36.2
Compiling lace_codebook v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_codebook)
Compiling lace_cc v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_cc)
Compiling lace_metadata v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_metadata)
Compiling lace v0.6.0 (/home/zamazan4ik/open_source/lace/lace)
Finished bench [optimized] target(s) in 4m 58s
PGO optimized build successfully finished.
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace-d97acfc927aaf8e4)
running 116 tests
test bencher::tests::bencher_from_state_builder_should_return_properly_sized_result ... ignored
test data::init::tests::uses_codebook_categorical_hyper_if_specified ... ignored
test data::init::tests::uses_codebook_continuous_hyper_if_specified ... ignored
test examples::animals::test::columns_convert_properly ... ignored
test examples::animals::test::rows_convert_properly ... ignored
test index::tests::json_cell ... ignored
test index::tests::json_column ... ignored
test index::tests::json_row ... ignored
test index::tests::to_cell ... ignored
test interface::engine::builder::tests::default_build_settings ... ignored
test interface::engine::builder::tests::seeding_engine_works ... ignored
test interface::engine::builder::tests::with_id_offet_3 ... ignored
test interface::engine::builder::tests::with_nstates_0_causes_error ... ignored
test interface::engine::builder::tests::with_nstates_3 ... ignored
test interface::engine::data::tests::append_bool ... ignored
test interface::engine::data::tests::incr_cats_in_codebook_with_suppl_metadata_for_valmap_col ... ignored
test interface::engine::data::tests::incr_cats_in_codebook_without_suppl_metadata_for_no_valmap_col ... ignored
test interface::engine::data::tests::requiring_examples::errors_when_new_column_not_in_col_metadata ... ignored
test interface::engine::data::tests::requiring_examples::errors_when_no_col_metadata_when_new_columns ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_one_existing_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_one_new_and_one_existing_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_one_new_col_in_existing_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_one_new_col_in_new_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_one_new_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_two_new_cols_in_existing_row ... ignored
test interface::engine::data::tests::requiring_examples::tasks_on_two_new_rows ... ignored
test interface::engine::tests::all_update_handler_methods_called ... ignored
test interface::engine::tests::state_timeout_update_handler ... ignored
test interface::metadata::tests::engine_and_oracle_serde_the_same ... ignored
test interface::metadata::tests::engine_can_run_after_serde ... ignored
test interface::metadata::tests::engine_can_update_data_after ... ignored
test interface::metadata::tests::serde_engine ... ignored
test interface::metadata::tests::serde_oracle ... ignored
test interface::oracle::tests::impute_uncertainty_smoke ... ignored
test interface::oracle::tests::mixture_and_oracle_logp_equivalence_categorical ... ignored
test interface::oracle::tests::mixture_and_oracle_logp_equivalence_gaussian ... ignored
test interface::oracle::tests::mutual_information_smoke ... ignored
test interface::oracle::tests::predict_uncertainty_smoke_no_given ... ignored
test interface::oracle::tests::predict_uncertainty_smoke_with_given ... ignored
test interface::oracle::tests::requiring_examples::mi_pw_and_normal_equivalence ... ignored
test interface::oracle::tests::requiring_examples::mixture_and_oracle_logp_equivalence_animals_single_state ... ignored
test interface::oracle::tests::requiring_examples::pw_and_conditional_entropy_equivalence_animals ... ignored
test interface::oracle::tests::requiring_examples::pw_and_info_prop_equivalence_animals ... ignored
test interface::oracle::tests::requiring_examples::recreate_doctest_mi_failure ... ignored
test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree ... ignored
test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_given ... ignored
test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_given_state_ixs ... ignored
test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_state_ixs ... ignored
test interface::oracle::tests::single_continuous_column_logp ... ignored
test interface::oracle::tests::single_continuous_column_logp_duplicated_states ... ignored
test interface::oracle::tests::single_continuous_column_logp_state_0 ... ignored
test interface::oracle::tests::surpisal_value_1 ... ignored
test interface::oracle::tests::surpisal_value_2 ... ignored
test interface::oracle::utils::tests::continuous_predict_with_spread_out_modes ... ignored
test interface::oracle::utils::tests::give_weights_size_check_single_target_column ... ignored
test interface::oracle::utils::tests::multi_state_categorical_gaussian_entropy_0 ... ignored
test interface::oracle::utils::tests::multi_state_categorical_self_entropy ... ignored
test interface::oracle::utils::tests::multi_state_categorical_single_entropy ... ignored
test interface::oracle::utils::tests::multi_state_categorical_single_entropy_vs_old ... ignored
test interface::oracle::utils::tests::multi_state_continuous_impute_1 ... ignored
test interface::oracle::utils::tests::multi_state_continuous_impute_2 ... ignored
test interface::oracle::utils::tests::multi_state_dual_categorical_entropy_1 ... ignored
test interface::oracle::utils::tests::multi_state_dual_categorical_entropy_vs_joint_equiv ... ignored
test interface::oracle::utils::tests::single_continuous_column_weights_given ... ignored
test interface::oracle::utils::tests::single_continuous_column_weights_no_given ... ignored
test interface::oracle::utils::tests::single_state_categorical_entropy ... ignored
test interface::oracle::utils::tests::single_state_categorical_gaussian_entropy_0 ... ignored
test interface::oracle::utils::tests::single_state_categorical_gaussian_entropy_1 ... ignored
test interface::oracle::utils::tests::single_state_categorical_impute_1 ... ignored
test interface::oracle::utils::tests::single_state_categorical_impute_2 ... ignored
test interface::oracle::utils::tests::single_state_categorical_predict_1 ... ignored
test interface::oracle::utils::tests::single_state_categorical_self_entropy ... ignored
test interface::oracle::utils::tests::single_state_continuous_impute_1 ... ignored
test interface::oracle::utils::tests::single_state_continuous_impute_2 ... ignored
test interface::oracle::utils::tests::single_state_count_impute_1 ... ignored
test interface::oracle::utils::tests::single_state_count_impute_2 ... ignored
test interface::oracle::utils::tests::single_state_count_predict ... ignored
test interface::oracle::utils::tests::single_state_dual_categorical_entropy_0 ... ignored
test interface::oracle::utils::tests::single_state_dual_categorical_entropy_1 ... ignored
test interface::oracle::utils::tests::single_state_dual_categorical_entropy_vs_joint_equiv ... ignored
test interface::oracle::utils::tests::single_state_weights_value_check ... ignored
test interface::oracle::utils::tests::single_view_weights_state_0_no_given ... ignored
test interface::oracle::utils::tests::single_view_weights_state_0_with_added_given ... ignored
test interface::oracle::utils::tests::single_view_weights_state_0_with_one_given ... ignored
test interface::oracle::utils::tests::single_view_weights_vs_exp ... ignored
test interface::oracle::utils::tests::single_view_weights_vs_exp_one_given ... ignored
test interface::oracle::utils::tests::sobol_samples ... ignored
test interface::oracle::utils::tests::sobol_single_categorical_entropy_vs_exact ... ignored
test interface::oracle::utils::tests::sobol_single_gaussian_entropy_vs_exact ... ignored
test interface::oracle::utils::tests::state_logp_values_multi_col_multi_view ... ignored
test interface::oracle::utils::tests::state_logp_values_multi_col_multi_view_precomp ... ignored
test interface::oracle::utils::tests::state_logp_values_multi_col_single_view ... ignored
test interface::oracle::utils::tests::state_logp_values_multi_col_single_view_precomp ... ignored
test interface::oracle::utils::tests::state_logp_values_single_col_single_view ... ignored
test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_multi_view ... ignored
test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_multi_view_precomp ... ignored
test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_single_view ... ignored
test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_single_view_precomp ... ignored
test interface::oracle::utils::tests::state_logp_vs_exp_values_single_col_single_view ... ignored
test interface::oracle::validation::tests::given_nothing_is_ok ... ignored
test interface::oracle::validation::tests::good_conditions_no_missing_ok ... ignored
test interface::oracle::validation::tests::incompatible_datum_bad ... ignored
test interface::oracle::validation::tests::target_conflict_bad ... ignored
test interface::oracle::validation::tests::target_index_oob_bad ... ignored
test optimize::scalar::tests::bounded_min_neg_gaussian_loglike ... ignored
test optimize::scalar::tests::bounded_min_neg_x_cubed ... ignored
test optimize::scalar::tests::bounded_min_x_cubed ... ignored
test optimize::scalar::tests::bounded_should_find_global_min ... ignored
test optimize::scalar::tests::brounded_min_x_square ... ignored
test optimize::scalar::tests::brute_force_min_neg_gaussian_loglike ... ignored
test optimize::scalar::tests::brute_force_min_neg_x_cubed ... ignored
test optimize::scalar::tests::brute_force_min_x_cubed ... ignored
test optimize::scalar::tests::brute_force_min_x_square ... ignored
test optimize::scalar::tests::gradient_descent_fn1 ... ignored
test optimize::scalar::tests::newton_fn1 ... ignored
test optimize::scalar::tests::newton_gaussian ... ignored
test result: ok. 0 passed; 0 failed; 116 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running benches/insert_data.rs (target/x86_64-unknown-linux-gnu/release/deps/insert_data-26df042bf99b7af4)
Benchmarking insert_data overwrite only
Benchmarking insert_data overwrite only: Warming up for 3.0000 s
Benchmarking insert_data overwrite only: Collecting 100 samples in estimated 5.0518 s (424k iterations)
Benchmarking insert_data overwrite only: Analyzing
insert_data overwrite only
time: [4.1790 µs 4.1885 µs 4.1965 µs]
change: [-20.482% -20.168% -19.881%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking insert_data append rows
Benchmarking insert_data append rows: Warming up for 3.0000 s
Benchmarking insert_data append rows: Collecting 100 samples in estimated 5.0235 s (268k iterations)
Benchmarking insert_data append rows: Analyzing
insert_data append rows time: [12.541 µs 12.626 µs 12.696 µs]
change: [-16.152% -14.455% -12.815%] (p = 0.00 < 0.05)
Performance has improved.
Running benches/oracle_fns.rs (target/x86_64-unknown-linux-gnu/release/deps/oracle_fns-5a6c41af9794c2dc)
Benchmarking oracle mi categorical-continuous
Benchmarking oracle mi categorical-continuous: Warming up for 3.0000 s
Benchmarking oracle mi categorical-continuous: Collecting 100 samples in estimated 5.2353 s (800 iterations)
Benchmarking oracle mi categorical-continuous: Analyzing
oracle mi categorical-continuous
time: [6.5773 ms 6.5785 ms 6.5798 ms]
change: [-1.1923% -0.9577% -0.8192%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking oracle mi continuous
Benchmarking oracle mi continuous: Warming up for 3.0000 s
Benchmarking oracle mi continuous: Collecting 100 samples in estimated 5.1017 s (1100 iterations)
Benchmarking oracle mi continuous: Analyzing
oracle mi continuous time: [4.6287 ms 4.6336 ms 4.6405 ms]
change: [-2.5970% -2.4686% -2.3179%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking oracle mi categorical
Benchmarking oracle mi categorical: Warming up for 3.0000 s
Benchmarking oracle mi categorical: Collecting 100 samples in estimated 5.0685 s (283k iterations)
Benchmarking oracle mi categorical: Analyzing
oracle mi categorical time: [17.825 µs 17.959 µs 18.163 µs]
change: [-4.2699% -3.7250% -3.0677%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) high mild
6 (6.00%) high severe
Benchmarking oracle ftype
Benchmarking oracle ftype: Warming up for 3.0000 s
Benchmarking oracle ftype: Collecting 100 samples in estimated 5.0000 s (238M iterations)
Benchmarking oracle ftype: Analyzing
oracle ftype time: [20.887 ns 20.989 ns 21.103 ns]
change: [+76.904% +77.573% +78.241%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
7 (7.00%) high mild
Benchmarking oracle ftypes
Benchmarking oracle ftypes: Warming up for 3.0000 s
Benchmarking oracle ftypes: Collecting 100 samples in estimated 5.0022 s (7.9M iterations)
Benchmarking oracle ftypes: Analyzing
oracle ftypes time: [633.79 ns 634.61 ns 635.57 ns]
change: [+4.5688% +5.4840% +6.6600%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking oracle depprob
Benchmarking oracle depprob: Warming up for 3.0000 s
Benchmarking oracle depprob: Collecting 100 samples in estimated 5.0001 s (205M iterations)
Benchmarking oracle depprob: Analyzing
oracle depprob time: [24.193 ns 24.285 ns 24.410 ns]
change: [+48.850% +49.441% +49.984%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
Benchmarking oracle rowsim
Benchmarking oracle rowsim: Warming up for 3.0000 s
Benchmarking oracle rowsim: Collecting 100 samples in estimated 5.0014 s (16M iterations)
Benchmarking oracle rowsim: Analyzing
oracle rowsim time: [338.53 ns 339.75 ns 341.04 ns]
change: [+6.2465% +6.7073% +7.1668%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking oracle novelty
Benchmarking oracle novelty: Warming up for 3.0000 s
Benchmarking oracle novelty: Collecting 100 samples in estimated 5.0022 s (9.3M iterations)
Benchmarking oracle novelty: Analyzing
oracle novelty time: [545.96 ns 548.57 ns 551.17 ns]
change: [+6.6330% +7.1549% +7.6894%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking oracle categorical entropy
Benchmarking oracle categorical entropy: Warming up for 3.0000 s
Benchmarking oracle categorical entropy: Collecting 100 samples in estimated 5.0478 s (202k iterations)
Benchmarking oracle categorical entropy: Analyzing
oracle categorical entropy
time: [25.017 µs 25.085 µs 25.202 µs]
change: [-13.980% -13.805% -13.597%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking oracle predictor search
Benchmarking oracle predictor search: Warming up for 3.0000 s
Benchmarking oracle predictor search: Collecting 100 samples in estimated 6.2805 s (10k iterations)
Benchmarking oracle predictor search: Analyzing
oracle predictor search time: [616.29 µs 619.95 µs 624.35 µs]
change: [-8.1176% -7.1815% -6.3030%] (p = 0.00 < 0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
8 (8.00%) high mild
6 (6.00%) high severe
Benchmarking oracle info prop
Benchmarking oracle info prop: Warming up for 3.0000 s
Benchmarking oracle info prop: Collecting 100 samples in estimated 5.0463 s (121k iterations)
Benchmarking oracle info prop: Analyzing
oracle info prop time: [41.093 µs 41.119 µs 41.146 µs]
change: [-10.233% -10.080% -9.9251%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking oracle conditional entropy
Benchmarking oracle conditional entropy: Warming up for 3.0000 s
Benchmarking oracle conditional entropy: Collecting 100 samples in estimated 5.1173 s (136k iterations)
Benchmarking oracle conditional entropy: Analyzing
oracle conditional entropy
time: [37.371 µs 37.442 µs 37.552 µs]
change: [-12.443% -11.926% -11.440%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
5 (5.00%) high mild
6 (6.00%) high severe
Benchmarking oracle surprisal
Benchmarking oracle surprisal: Warming up for 3.0000 s
Benchmarking oracle surprisal: Collecting 100 samples in estimated 5.0017 s (13M iterations)
Benchmarking oracle surprisal: Analyzing
oracle surprisal time: [384.69 ns 385.86 ns 387.09 ns]
change: [-0.8273% -0.4711% -0.1100%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking oracle self surprisal
Benchmarking oracle self surprisal: Warming up for 3.0000 s
Benchmarking oracle self surprisal: Collecting 100 samples in estimated 5.0014 s (12M iterations)
Benchmarking oracle self surprisal: Analyzing
oracle self surprisal time: [411.16 ns 412.24 ns 413.49 ns]
change: [-6.5539% -6.0416% -5.6029%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking oracle datum
Benchmarking oracle datum: Warming up for 3.0000 s
Benchmarking oracle datum: Collecting 100 samples in estimated 5.0001 s (182M iterations)
Benchmarking oracle datum: Analyzing
oracle datum time: [27.269 ns 27.312 ns 27.358 ns]
change: [-56.567% -56.484% -56.393%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking oracle logp
Benchmarking oracle logp: Warming up for 3.0000 s
Benchmarking oracle logp: Collecting 100 samples in estimated 5.0360 s (596k iterations)
Benchmarking oracle logp: Analyzing
oracle logp time: [8.5401 µs 8.5582 µs 8.5812 µs]
change: [-5.6424% -5.4411% -5.2566%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking oracle simulate
Benchmarking oracle simulate: Warming up for 3.0000 s
Benchmarking oracle simulate: Collecting 100 samples in estimated 5.0467 s (86k iterations)
Benchmarking oracle simulate: Analyzing
oracle simulate time: [58.660 µs 58.703 µs 58.754 µs]
change: [-6.5894% -6.1191% -5.7779%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking oracle draw
Benchmarking oracle draw: Warming up for 3.0000 s
Benchmarking oracle draw: Collecting 100 samples in estimated 5.0606 s (212k iterations)
Benchmarking oracle draw: Analyzing
oracle draw time: [23.555 µs 23.613 µs 23.695 µs]
change: [-2.0238% -1.6931% -1.1901%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
1 (1.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking oracle impute
Benchmarking oracle impute: Warming up for 3.0000 s
Benchmarking oracle impute: Collecting 100 samples in estimated 5.0223 s (601k iterations)
Benchmarking oracle impute: Analyzing
oracle impute time: [8.3593 µs 8.3702 µs 8.3807 µs]
change: [-1.3049% -1.1301% -0.9473%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
Benchmarking oracle predict
Benchmarking oracle predict: Warming up for 3.0000 s
Benchmarking oracle predict: Collecting 100 samples in estimated 5.1174 s (146k iterations)
Benchmarking oracle predict: Analyzing
oracle predict time: [34.756 µs 34.820 µs 34.891 µs]
change: [-2.5074% -2.1893% -1.8661%] (p = 0.00 < 0.05)
Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
9 (9.00%) high mild
4 (4.00%) high severe
Benchmarking oracle predict continuous
Benchmarking oracle predict continuous: Warming up for 3.0000 s
Benchmarking oracle predict continuous: Collecting 100 samples in estimated 5.0001 s (172M iterations)
Benchmarking oracle predict continuous: Analyzing
oracle predict continuous
time: [27.237 ns 27.392 ns 27.651 ns]
change: [-47.512% -47.258% -46.898%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_cc-2c9864178244650b)
running 79 tests
test alg::tests::test_col_alg_from_string_finite_cpu ... ignored
test alg::tests::test_col_alg_from_string_gibbs ... ignored
test alg::tests::test_col_alg_from_string_invalid ... ignored
test alg::tests::test_col_alg_from_string_slice ... ignored
test alg::tests::test_row_alg_from_string_finite_cpu ... ignored
test alg::tests::test_row_alg_from_string_gibbs ... ignored
test alg::tests::test_row_alg_from_string_invalid ... ignored
test alg::tests::test_row_alg_from_string_sams ... ignored
test alg::tests::test_row_alg_from_string_slice ... ignored
test assignment::tests::bad_counts_fails_validation ... ignored
test assignment::tests::dirvec_with_alpha_1 ... ignored
test assignment::tests::dirvec_with_alpha_15 ... ignored
test assignment::tests::dirvec_with_unassigned_entry ... ignored
test assignment::tests::drawn_assignment_should_have_valid_partition ... ignored
test assignment::tests::flat_partition_validation ... ignored
test assignment::tests::from_prior_should_have_valid_alpha_and_proper_length ... ignored
test assignment::tests::from_rng_seed_control_works ... ignored
test assignment::tests::from_vec ... ignored
test assignment::tests::high_n_cats_fails_validation ... ignored
test assignment::tests::lcrp_all_ones ... ignored
test assignment::tests::log_dirvec_with_alpha_1 ... ignored
test assignment::tests::log_dirvec_with_alpha_15 ... ignored
test assignment::tests::low_n_cats_fails_validation ... ignored
test assignment::tests::manual_seed_control_works ... ignored
test assignment::tests::no_zero_cat_fails_validation ... ignored
test assignment::tests::reassign_to_existing_cat ... ignored
test assignment::tests::reassign_to_new_cat ... ignored
test assignment::tests::unassign_non_singleton ... ignored
test assignment::tests::unassign_singleton_high ... ignored
test assignment::tests::unassign_singleton_low ... ignored
test assignment::tests::unassign_singleton_middle ... ignored
test assignment::tests::weights ... ignored
test assignment::tests::with_n_cats_n_cats_doesnt_divides_n ... ignored
test assignment::tests::with_n_cats_n_cats_evenly_divides_n ... ignored
test assignment::tests::zero_count_fails_validation ... ignored
test feature::column::tests::repop_categorical_data_should_put_the_data_back_in ... ignored
test feature::column::tests::repop_continuous_data_should_put_the_data_back_in ... ignored
test feature::column::tests::take_categorical_data_should_leave_col_model_data_empty ... ignored
test feature::column::tests::take_continuous_data_should_leave_col_model_data_empty ... ignored
test feature::column::tests::to_mixture_with_zero_weight_ignores_component ... ignored
test feature::mnar::test::cpnt_likelihood_missing ... ignored
test feature::mnar::test::cpnt_likelihood_present ... ignored
test feature::mnar::test::cpnt_logp_missing ... ignored
test feature::mnar::test::cpnt_logp_present ... ignored
test feature::mnar::test::insert_data_missing_into_missing ... ignored
test feature::mnar::test::insert_data_missing_into_present ... ignored
test feature::mnar::test::insert_data_present_into_missing ... ignored
test feature::mnar::test::insert_data_present_into_present ... ignored
test feature::mnar::test::remove_data_missing ... ignored
test feature::mnar::test::remove_data_present ... ignored
test feature::traits::tests::score_and_asgn_score_equivalency ... ignored
test massflip::tests::naive_matches_matrix_for_same_seed ... ignored
test massflip::tests::serial_and_par_matrix_are_the_same_for_same_seed ... ignored
test misc::tests::sb_slice::should_return_error_for_zero_u_star ... ignored
test misc::tests::sb_slice::should_return_input_weights_if_alpha_is_zero ... ignored
test misc::tests::sb_slice::smoke ... ignored
test state::builder::tests::built_state_should_update ... ignored
test state::builder::tests::n_rows_overriden_by_features ... ignored
test state::builder::tests::seeding_state_works ... ignored
test state::builder::tests::test_dimensions ... ignored
test state::test::extract_ftr_non_singleton ... ignored
test state::test::extract_ftr_singleton_low ... ignored
test state::test::flatten_cols ... ignored
test state::test::geweke_from_prior_all_transitions ... ignored
test state::test::geweke_from_prior_no_alpha_transition ... ignored
test state::test::geweke_from_prior_no_col_transition ... ignored
test state::test::geweke_from_prior_no_row_or_col_transition ... ignored
test state::test::geweke_from_prior_no_row_transition ... ignored
test state::test::gibbs_col_transition_smoke ... ignored
test state::test::gibbs_row_transition_smoke ... ignored
test state::test::update_should_stop_at_max_iters ... ignored
test view::tests::extend_cols_adds_empty_unassigned_rows ... ignored
test view::tests::insert_datum_into_existing_spot_updates_suffstats ... ignored
test view::tests::insert_datum_into_unassigned_spot_does_not_update_suffstats ... ignored
test view::tests::seeding_view_works ... ignored
test view::tests::singleton_reassign_smoke_finite_cpu ... ignored
test view::tests::singleton_reassign_smoke_gibbs ... ignored
test view::tests::singleton_reassign_smoke_sams ... ignored
test view::tests::singleton_reassign_smoke_slice ... ignored
test result: ok. 0 passed; 0 failed; 79 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running benches/all_algs.rs (target/x86_64-unknown-linux-gnu/release/deps/all_algs-06a6783e45d3b491)
Benchmarking genomics-data-finite-finite
Benchmarking genomics-data-finite-finite: Warming up for 3.0000 s
Benchmarking genomics-data-finite-finite: Collecting 100 samples in estimated 5.5816 s (700 iterations)
Benchmarking genomics-data-finite-finite: Analyzing
genomics-data-finite-finite
time: [2.7354 ms 2.7556 ms 2.7765 ms]
change: [-0.2449% +1.0584% +2.4114%] (p = 0.12 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking genomics-data-slice-finite
Benchmarking genomics-data-slice-finite: Warming up for 3.0000 s
Benchmarking genomics-data-slice-finite: Collecting 100 samples in estimated 5.4948 s (700 iterations)
Benchmarking genomics-data-slice-finite: Analyzing
genomics-data-slice-finite
time: [2.8134 ms 2.8363 ms 2.8591 ms]
change: [-1.2916% -0.0705% +1.1370%] (p = 0.90 > 0.05)
No change in performance detected.
Benchmarking genomics-data-gibbs-finite
Benchmarking genomics-data-gibbs-finite: Warming up for 3.0000 s
Benchmarking genomics-data-gibbs-finite: Collecting 100 samples in estimated 7.2276 s (300 iterations)
Benchmarking genomics-data-gibbs-finite: Analyzing
genomics-data-gibbs-finite
time: [15.325 ms 15.581 ms 15.838 ms]
change: [-8.6675% -6.4829% -4.3214%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking genomics-data-sams-finite
Benchmarking genomics-data-sams-finite: Warming up for 3.0000 s
Benchmarking genomics-data-sams-finite: Collecting 100 samples in estimated 7.2279 s (300 iterations)
Benchmarking genomics-data-sams-finite: Analyzing
genomics-data-sams-finite
time: [15.422 ms 15.705 ms 15.996 ms]
change: [-4.9741% -2.5189% +0.0530%] (p = 0.05 > 0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Running benches/feature_prior_update.rs (target/x86_64-unknown-linux-gnu/release/deps/feature_prior_update-4883e5b98ab12bd4)
Benchmarking update continuous prior
Benchmarking update continuous prior: Warming up for 3.0000 s
Benchmarking update continuous prior: Collecting 100 samples in estimated 5.5427 s (25k iterations)
Benchmarking update continuous prior: Analyzing
update continuous prior time: [218.98 µs 219.19 µs 219.42 µs]
change: [-14.662% -14.577% -14.484%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking update categorical prior
Benchmarking update categorical prior: Warming up for 3.0000 s
Benchmarking update categorical prior: Collecting 100 samples in estimated 5.0022 s (752k iterations)
Benchmarking update categorical prior: Analyzing
update categorical prior
time: [6.6593 µs 6.6667 µs 6.6743 µs]
change: [-9.0403% -8.9127% -8.7825%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
Benchmarking update count prior
Benchmarking update count prior: Warming up for 3.0000 s
Benchmarking update count prior: Collecting 100 samples in estimated 5.0096 s (172k iterations)
Benchmarking update count prior: Analyzing
update count prior time: [30.740 µs 31.077 µs 31.402 µs]
change: [-7.2714% -6.1942% -5.0759%] (p = 0.00 < 0.05)
Performance has improved.
Running benches/massflip.rs (target/x86_64-unknown-linux-gnu/release/deps/massflip-5b5606068c42584b)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Collecting 100 samples in estimated 5.0193 s (611k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/100
time: [7.3083 µs 7.3178 µs 7.3325 µs]
change: [-25.250% -25.137% -24.985%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Collecting 100 samples in estimated 5.1024 s (141k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/100
time: [36.484 µs 37.040 µs 37.588 µs]
change: [+0.5727% +3.6081% +6.7085%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 28 outliers among 100 measurements (28.00%)
15 (15.00%) low severe
1 (1.00%) low mild
5 (5.00%) high mild
7 (7.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Collecting 100 samples in estimated 5.1248 s (126k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/500
time: [35.936 µs 36.063 µs 36.169 µs]
change: [-25.989% -25.822% -25.685%] (p = 0.00 < 0.05)
Performance has improved.
Found 20 outliers among 100 measurements (20.00%)
8 (8.00%) low severe
3 (3.00%) low mild
7 (7.00%) high mild
2 (2.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Collecting 100 samples in estimated 5.2819 s (71k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/500
time: [71.306 µs 74.113 µs 77.518 µs]
change: [-5.6765% -1.6863% +2.5601%] (p = 0.45 > 0.05)
No change in performance detected.
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Collecting 100 samples in estimated 5.2357 s (66k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/1000
time: [69.321 µs 69.337 µs 69.354 µs]
change: [-29.140% -29.110% -29.074%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) high mild
3 (3.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Collecting 100 samples in estimated 5.1820 s (45k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/1000
time: [92.783 µs 93.552 µs 94.432 µs]
change: [-2.9548% -0.9864% +1.0017%] (p = 0.32 > 0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Collecting 100 samples in estimated 6.2032 s (15k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/5000
time: [362.72 µs 363.38 µs 364.39 µs]
change: [-25.629% -25.522% -25.412%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Collecting 100 samples in estimated 5.9213 s (15k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/5000
time: [190.96 µs 194.39 µs 197.94 µs]
change: [-3.2126% -1.0521% +1.1905%] (p = 0.35 > 0.05)
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Collecting 100 samples in estimated 8.1440 s (10k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/10000
time: [724.63 µs 724.66 µs 724.69 µs]
change: [-25.643% -25.632% -25.623%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low severe
3 (3.00%) low mild
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Collecting 100 samples in estimated 7.0922 s (10k iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/10000
time: [272.94 µs 276.29 µs 279.69 µs]
change: [-3.0388% -0.6261% +1.7448%] (p = 0.60 > 0.05)
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Collecting 100 samples in estimated 5.2167 s (1300 iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/serial/50000
time: [3.4696 ms 3.4709 ms 3.4730 ms]
change: [-34.869% -34.838% -34.798%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) low mild
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Collecting 100 samples in estimated 5.1470 s (1700 iterations)
Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Analyzing
Compare Parallel vs Serial Massflip (10 cols)/parallel/50000
time: [666.99 µs 675.73 µs 684.55 µs]
change: [-32.951% -29.636% -26.027%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Collecting 100 samples in estimated 5.0203 s (616k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100
time: [6.9219 µs 6.9227 µs 6.9237 µs]
change: [+5.6215% +5.6435% +5.6639%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Collecting 100 samples in estimated 5.0488 s (141k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100
time: [35.051 µs 35.957 µs 36.733 µs]
change: [-7.4830% -4.5044% -1.4259%] (p = 0.01 < 0.05)
Performance has improved.
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Collecting 100 samples in estimated 5.0533 s (126k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500
time: [34.502 µs 34.512 µs 34.525 µs]
change: [+4.8385% +5.2879% +5.6249%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Collecting 100 samples in estimated 5.2251 s (71k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500
time: [72.094 µs 74.687 µs 77.819 µs]
change: [-3.4949% +0.5207% +4.6798%] (p = 0.81 > 0.05)
No change in performance detected.
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Collecting 100 samples in estimated 5.2213 s (66k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000
time: [68.944 µs 68.962 µs 68.985 µs]
change: [+5.7324% +5.8012% +5.8697%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Collecting 100 samples in estimated 5.1457 s (45k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000
time: [94.250 µs 95.176 µs 96.217 µs]
change: [-0.5341% +0.9642% +2.4023%] (p = 0.21 > 0.05)
No change in performance detected.
Found 11 outliers among 100 measurements (11.00%)
7 (7.00%) high mild
4 (4.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Collecting 100 samples in estimated 6.0265 s (15k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000
time: [345.27 µs 345.97 µs 346.99 µs]
change: [+5.9564% +6.0688% +6.1980%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
1 (1.00%) low severe
5 (5.00%) high mild
9 (9.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Collecting 100 samples in estimated 5.9370 s (15k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000
time: [186.04 µs 189.68 µs 193.50 µs]
change: [-0.2952% +2.0901% +4.5785%] (p = 0.10 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Collecting 100 samples in estimated 8.0387 s (10k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000
time: [689.91 µs 689.99 µs 690.08 µs]
change: [+5.8848% +5.9069% +5.9244%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) low mild
6 (6.00%) high mild
3 (3.00%) high severe
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Collecting 100 samples in estimated 6.5617 s (10k iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000
time: [265.19 µs 269.93 µs 274.33 µs]
change: [+0.6023% +3.0068% +5.3645%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Collecting 100 samples in estimated 5.1977 s (1300 iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000
time: [3.4503 ms 3.4507 ms 3.4511 ms]
change: [-7.8712% -7.8508% -7.8319%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Warming up for 3.0000 s
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Collecting 100 samples in estimated 5.1784 s (1700 iterations)
Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Analyzing
Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000
time: [692.01 µs 700.45 µs 709.09 µs]
change: [-39.613% -38.645% -37.675%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Running benches/state_types.rs (target/x86_64-unknown-linux-gnu/release/deps/state_types-499b2c014caa81e1)
Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats)
Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s
Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.4007 s (35k iterations)
Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Analyzing
all-categorical(2) state 20-by-2 (1 views, 5 cats)
time: [138.18 µs 138.76 µs 139.38 µs]
change: [-3.6254% -2.9473% -2.3548%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats)
Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s
Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.5801 s (25k iterations)
Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Analyzing
all-gaussian state 20-by-2 (1 views, 5 cats)
time: [219.14 µs 220.06 µs 220.95 µs]
change: [-14.153% -13.638% -13.109%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking all-count-state 20-by-2 (1 views, 5 cats)
Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s
Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.4038 s (35k iterations)
Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Analyzing
all-count-state 20-by-2 (1 views, 5 cats)
time: [149.88 µs 150.57 µs 151.34 µs]
change: [-3.7483% -3.0427% -2.3749%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_codebook-52f3a7558d973b63)
running 63 tests
test codebook::tests::colmetedatalist::remove_by_index_from_front ... ignored
test codebook::tests::colmetedatalist::remove_by_index_from_middle ... ignored
test codebook::tests::deserialize_metadata_list ... ignored
test codebook::tests::deserialize_metadata_list_with_duplicate_names_fails - should panic ... ignored
test codebook::tests::insert_existing_row_names_returns_error ... ignored
test codebook::tests::insert_into_empty_row_names ... ignored
test codebook::tests::merge_codebooks_produces_correct_ids ... ignored
test codebook::tests::merge_cols_detects_duplicate_columns ... ignored
test codebook::tests::n_cols_returns_number_of_column_metadata ... ignored
test codebook::tests::new_with_duplicate_names_should_fail ... ignored
test codebook::tests::pop_front ... ignored
test codebook::tests::row_names_try_into_repeats_vec ... ignored
test codebook::tests::row_names_try_into_unique_vec ... ignored
test codebook::tests::serialize_metadata_list ... ignored
test codebook::tests::serialize_then_deserialize ... ignored
test codebook::tests::value_map_for_categorical_coltype_check ... ignored
test codebook::tests::value_map_for_continuous_coltype_is_none ... ignored
test data::test::codebook_with_all_types_inferse_correct_types_csv ... ignored
test data::test::inference::bool_data_is_categorical ... ignored
test data::test::inference::count_or_cts_i16 ... ignored
test data::test::inference::count_or_cts_i16_neg ... ignored
test data::test::inference::count_or_cts_i16_neg_small ... ignored
test data::test::inference::count_or_cts_i32 ... ignored
test data::test::inference::count_or_cts_i32_neg ... ignored
test data::test::inference::count_or_cts_i32_neg_small ... ignored
test data::test::inference::count_or_cts_i64 ... ignored
test data::test::inference::count_or_cts_i64_neg ... ignored
test data::test::inference::count_or_cts_i64_neg_small ... ignored
test data::test::inference::count_or_cts_u16 ... ignored
test data::test::inference::count_or_cts_u32 ... ignored
test data::test::inference::count_or_cts_u64 ... ignored
test data::test::inference::exactly_255_string_values_ok ... ignored
test data::test::inference::fewer_than_255_string_values_ok ... ignored
test data::test::inference::greater_than_256_string_values_errors ... ignored
test data::test::inference::i16_1 ... ignored
test data::test::inference::i16_2 ... ignored
test data::test::inference::i16_3 ... ignored
test data::test::inference::i16_4 ... ignored
test data::test::inference::i32_1 ... ignored
test data::test::inference::i32_2 ... ignored
test data::test::inference::i32_3 ... ignored
test data::test::inference::i32_4 ... ignored
test data::test::inference::i64_1 ... ignored
test data::test::inference::i64_2 ... ignored
test data::test::inference::i64_3 ... ignored
test data::test::inference::i64_4 ... ignored
test data::test::inference::i8_1 ... ignored
test data::test::inference::i8_2 ... ignored
test data::test::inference::i8_3 ... ignored
test data::test::inference::i8_4 ... ignored
test data::test::inference::u16_1 ... ignored
test data::test::inference::u16_2 ... ignored
test data::test::inference::u32_1 ... ignored
test data::test::inference::u32_2 ... ignored
test data::test::inference::u64_1 ... ignored
test data::test::inference::u64_2 ... ignored
test data::test::inference::u8_1 ... ignored
test data::test::inference::u8_2 ... ignored
test data::test::string_col_value_map_should_be_sorted_no_null ... ignored
test data::test::string_col_value_map_should_be_sorted_null ... ignored
test value_map::tests::expected_valuemap_bool_iterator ... ignored
test value_map::tests::expected_valuemap_string_iterator ... ignored
test value_map::tests::expected_valuemap_u8_iterator ... ignored
test result: ok. 0 passed; 0 failed; 63 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_consts-68ee503d4564873c)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_data-8fa56e234eedbb5a)
running 67 tests
test data_store::tests::gets_missing_categorical_data ... ignored
test data_store::tests::gets_missing_continuous_data ... ignored
test data_store::tests::gets_present_categorical_data ... ignored
test data_store::tests::gets_present_continuous_data ... ignored
test datum::tests::categorical_datum_try_into_f64_panics - should panic ... ignored
test datum::tests::categorical_datum_try_into_u8 ... ignored
test datum::tests::continuous_datum_try_into_f64 ... ignored
test datum::tests::continuous_datum_try_into_u8_panics - should panic ... ignored
test datum::tests::count_data_into_f64 ... ignored
test datum::tests::count_data_try_into_u32 ... ignored
test datum::tests::count_data_try_into_u8_fails - should panic ... ignored
test datum::tests::missing_datum_try_into_f64_panics - should panic ... ignored
test datum::tests::missing_datum_try_into_u8_panics - should panic ... ignored
test datum::tests::serde_categorical_bool ... ignored
test datum::tests::serde_categorical_string ... ignored
test datum::tests::serde_categorical_u8 ... ignored
test datum::tests::serde_continuous ... ignored
test datum::tests::serde_count ... ignored
test datum::tests::serde_missing ... ignored
test feature::tests::gets_missing_categorical_data ... ignored
test feature::tests::gets_missing_continuous_data ... ignored
test feature::tests::gets_present_categorical_data ... ignored
test feature::tests::gets_present_continuous_data ... ignored
test feature::tests::summarize_categorical_works_one_mode ... ignored
test feature::tests::summarize_categorical_works_two_modes ... ignored
test feature::tests::summarize_categorical_works_with_fixture ... ignored
test feature::tests::summarize_continuous_works_with_fixture ... ignored
test feature::tests::summarize_continuous_works_with_odd_number_data ... ignored
test sparse::test::break_slices_dense ... ignored
test sparse::test::break_slices_dense_large ... ignored
test sparse::test::break_slices_dense_quad ... ignored
test sparse::test::defragment_to_dense ... ignored
test sparse::test::extract_first_from_dense ... ignored
test sparse::test::extract_from_dense ... ignored
test sparse::test::extract_from_sparse ... ignored
test sparse::test::extract_from_sparse_matching_slice_index ... ignored
test sparse::test::extract_last_from_dense ... ignored
test sparse::test::get ... ignored
test sparse::test::get_from_all_missing_is_none ... ignored
test sparse::test::get_oob_panics - should panic ... ignored
test sparse::test::insert_0 ... ignored
test sparse::test::insert_1 ... ignored
test sparse::test::insert_2 ... ignored
test sparse::test::insert_join ... ignored
test sparse::test::insert_oob ... ignored
test sparse::test::pop_front_1_dense ... ignored
test sparse::test::pop_front_1_sparse_first_empty ... ignored
test sparse::test::pop_front_1_sparse_first_occupied ... ignored
test sparse::test::pop_front_2_dense ... ignored
test sparse::test::pop_front_all_then_push_some ... ignored
test sparse::test::pop_front_multiple_sparse ... ignored
test sparse::test::pop_front_some_then_get ... ignored
test sparse::test::push_from_nothing_dense ... ignored
test sparse::test::push_from_nothing_sparse ... ignored
test sparse::test::push_start_missing ... ignored
test sparse::test::push_to_from_vec_ctor ... ignored
test sparse::test::remove_0 ... ignored
test sparse::test::remove_2 ... ignored
test sparse::test::remove_3 ... ignored
test sparse::test::remove_4 ... ignored
test sparse::test::set_missing_0 ... ignored
test sparse::test::set_missing_1 ... ignored
test sparse::test::set_missing_2 ... ignored
test sparse::test::set_missing_middle_one ... ignored
test sparse::test::set_missing_middle_two ... ignored
test sparse::test::slices ... ignored
test sparse::test::with_missing ... ignored
test result: ok. 0 passed; 0 failed; 67 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_geweke-72f691761b9f0a87)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_metadata-99d189c8a316f57e)
running 11 tests
test utils::tests::bad_state_file_errs ... ignored
test utils::tests::finds_codebook_in_directory_with_codebook ... ignored
test utils::tests::finds_codebook_in_no_data_dir ... ignored
test utils::tests::finds_correct_ids_in_no_codebook_dir ... ignored
test utils::tests::finds_correct_ids_in_no_data_dir ... ignored
test utils::tests::finds_correct_state_ids ... ignored
test utils::tests::finds_correct_state_ids_with_dir_with_state_extension ... ignored
test utils::tests::finds_data_in_directory_with_data ... ignored
test utils::tests::finds_data_in_no_codebook_dir ... ignored
test utils::tests::finds_no_codebook_in_no_codebook_dir ... ignored
test utils::tests::finds_no_data_in_no_data_dir ... ignored
test result: ok. 0 passed; 0 failed; 11 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_stats-3401b17cc4280474)
running 52 tests
test chi_square::tests::chi_square_should_be_zero_if_freqs_identical ... ignored
test chi_square::tests::chi_square_simple_value_test_1 ... ignored
test chi_square::tests::chi_square_simple_value_test_2 ... ignored
test integrate::tests::bb_log_marginal_importance ... ignored
test integrate::tests::bb_log_marginal_mh ... ignored
test ks::tests::empirical_cdf_when_xs_all_same_value ... ignored
test ks::tests::empirical_cdf_when_xs_and_vals_same_length ... ignored
test ks::tests::ks2sample_stat_should_be_zero_when_samples_are_identical ... ignored
test ks::tests::ks2sample_stat_simple_value_test_1 ... ignored
test ks::tests::ks2sample_stat_simple_value_test_2 ... ignored
test mh::tests::test_mh_importance_beta ... ignored
test mh::tests::test_mh_prior_gaussian ... ignored
test mh::tests::test_mh_prior_uniform ... ignored
test mh::tests::test_mh_slice_gaussian ... ignored
test mh::tests::test_mh_slice_uniform ... ignored
test mh::tests::test_mh_symrw_adaptive_gaussian ... ignored
test mh::tests::test_mh_symrw_adaptive_mv_normal_gamma_known_var ... ignored
test mh::tests::test_mh_symrw_adaptive_mv_normal_gamma_unknown ... ignored
test mh::tests::test_mh_symrw_adaptive_normal_gamma ... ignored
test mh::tests::test_mh_symrw_mv_normal_gamma_known_var ... ignored
test mh::tests::test_symrw_gaussian ... ignored
test mh::tests::test_symrw_uniform ... ignored
test mixture_type::tests::combine ... ignored
test mixture_type::tests::k ... ignored
test perm::tests::l2_norm_f64_value_check ... ignored
test perm::tests::l2_norm_of_identical_f64_should_be_zero ... ignored
test perm::tests::l2_norm_of_identical_vec_f64_should_be_zero ... ignored
test perm::tests::l2_norm_vec_f64_value_check ... ignored
test perm::tests::perm_data_repartition_smoke_test ... ignored
test perm::tests::perm_data_xs_and_ys ... ignored
test perm::tests::uv_gauss_perm_test_should_be_one_if_xs_is_ys ... ignored
test perm::tests::uv_gauss_perm_test_should_be_zero_if_xs_very_different_from_ys ... ignored
test sample_error::tests::ctgrl_pit_for_samples_from_target_should_have_low_error ... ignored
test sample_error::tests::ctgrl_pit_manual_computation ... ignored
test sample_error::tests::empirical_f64_no_repeats ... ignored
test sample_error::tests::empirical_u8_binary ... ignored
test sample_error::tests::gauss_pit_for_samples_from_narrow_should_have_high_error ... ignored
test sample_error::tests::gauss_pit_for_samples_from_target_should_have_low_error ... ignored
test sample_error::tests::gauss_pit_for_samples_from_wide_should_have_high_error ... ignored
test sample_error::tests::unique_ord_f64_all_unique ... ignored
test sample_error::tests::unique_ord_f64_repeats ... ignored
test seq::sobol::tests::find_first_zero_checks ... ignored
test seq::sobol::tests::most_significant_bit_checks ... ignored
test seq::sobol::tests::pi_approx ... ignored
test seq::sobol::tests::sobol_sequence_matches_reference ... ignored
test seq::sobol::tests::sobol_sequence_set_seed ... ignored
test seq::sobol::tests::sobol_sequence_uniform ... ignored
test seq::sobol::tests::two_sin_integral ... ignored
test uncertainty::test::bernoulli_moving_means_away_increases_tvd ... ignored
test uncertainty::test::categorical_moving_means_away_increases_tvd ... ignored
test uncertainty::test::count_moving_means_away_increases_tvd ... ignored
test uncertainty::test::gauss_moving_means_away_increases_tvd ... ignored
test result: ok. 0 passed; 0 failed; 52 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running benches/seq.rs (target/x86_64-unknown-linux-gnu/release/deps/seq-7747957abdb456da)
Benchmarking Halton(2) 1k numbers
Benchmarking Halton(2) 1k numbers: Warming up for 3.0000 s
Benchmarking Halton(2) 1k numbers: Collecting 100 samples in estimated 5.0085 s (3.0M iterations)
Benchmarking Halton(2) 1k numbers: Analyzing
Halton(2) 1k numbers time: [1.6771 µs 1.6817 µs 1.6876 µs]
change: [-55.583% -55.444% -55.258%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking Sobol(2) 1k numbers
Benchmarking Sobol(2) 1k numbers: Warming up for 3.0000 s
Benchmarking Sobol(2) 1k numbers: Collecting 100 samples in estimated 5.0905 s (227k iterations)
Benchmarking Sobol(2) 1k numbers: Analyzing
Sobol(2) 1k numbers time: [22.370 µs 22.375 µs 22.382 µs]
change: [-16.656% -16.640% -16.621%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
Benchmarking Seq compare/Halton/10
Benchmarking Seq compare/Halton/10: Warming up for 3.0000 s
Benchmarking Seq compare/Halton/10: Collecting 100 samples in estimated 5.0003 s (65M iterations)
Benchmarking Seq compare/Halton/10: Analyzing
Seq compare/Halton/10 time: [77.197 ns 77.391 ns 77.802 ns]
change: [-19.154% -19.058% -18.836%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking Seq compare/Sobol/10
Benchmarking Seq compare/Sobol/10: Warming up for 3.0000 s
Benchmarking Seq compare/Sobol/10: Collecting 100 samples in estimated 5.0043 s (5.7M iterations)
Benchmarking Seq compare/Sobol/10: Analyzing
Seq compare/Sobol/10 time: [879.23 ns 879.32 ns 879.42 ns]
change: [+15.255% +15.742% +16.100%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking Seq compare/Halton/1000
Benchmarking Seq compare/Halton/1000: Warming up for 3.0000 s
Benchmarking Seq compare/Halton/1000: Collecting 100 samples in estimated 5.0033 s (2.7M iterations)
Benchmarking Seq compare/Halton/1000: Analyzing
Seq compare/Halton/1000 time: [1.8603 µs 1.8648 µs 1.8696 µs]
change: [-53.100% -52.959% -52.837%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking Seq compare/Sobol/1000
Benchmarking Seq compare/Sobol/1000: Warming up for 3.0000 s
Benchmarking Seq compare/Sobol/1000: Collecting 100 samples in estimated 5.0404 s (217k iterations)
Benchmarking Seq compare/Sobol/1000: Analyzing
Seq compare/Sobol/1000 time: [22.663 µs 22.665 µs 22.666 µs]
change: [-11.234% -11.220% -11.207%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking Seq compare/Halton/100000
Benchmarking Seq compare/Halton/100000: Warming up for 3.0000 s
Benchmarking Seq compare/Halton/100000: Collecting 100 samples in estimated 5.2026 s (30k iterations)
Benchmarking Seq compare/Halton/100000: Analyzing
Seq compare/Halton/100000
time: [171.43 µs 171.50 µs 171.58 µs]
change: [-56.845% -56.744% -56.675%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
Benchmarking Seq compare/Sobol/100000
Benchmarking Seq compare/Sobol/100000: Warming up for 3.0000 s
Benchmarking Seq compare/Sobol/100000: Collecting 100 samples in estimated 5.0353 s (1500 iterations)
Benchmarking Seq compare/Sobol/100000: Analyzing
Seq compare/Sobol/100000
time: [3.3311 ms 3.3449 ms 3.3618 ms]
change: [-9.2589% -8.8750% -8.4157%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) high mild
6 (6.00%) high severe
Running benches/simplex.rs (target/x86_64-unknown-linux-gnu/release/deps/simplex-4570313ce9a6833d)
Benchmarking Sobol to 3-simplex over NDims/new alloc/3
Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Collecting 100 samples in estimated 5.0001 s (64M iterations)
Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Analyzing
Sobol to 3-simplex over NDims/new alloc/3
time: [19.615 ns 19.622 ns 19.629 ns]
change: [-18.201% -18.101% -18.005%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) low mild
Benchmarking Sobol to 3-simplex over NDims/update inplace/3
Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Collecting 100 samples in estimated 5.0003 s (75M iterations)
Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Analyzing
Sobol to 3-simplex over NDims/update inplace/3
time: [6.5632 ns 6.6066 ns 6.6499 ns]
change: [-52.620% -52.403% -52.186%] (p = 0.00 < 0.05)
Performance has improved.
Found 20 outliers among 100 measurements (20.00%)
1 (1.00%) low severe
1 (1.00%) low mild
2 (2.00%) high mild
16 (16.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/new alloc/5
Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Collecting 100 samples in estimated 5.0001 s (55M iterations)
Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Analyzing
Sobol to 3-simplex over NDims/new alloc/5
time: [28.880 ns 28.892 ns 28.912 ns]
change: [-18.948% -10.938% +4.9551%] (p = 0.14 > 0.05)
No change in performance detected.
Found 17 outliers among 100 measurements (17.00%)
10 (10.00%) high mild
7 (7.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/update inplace/5
Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Collecting 100 samples in estimated 5.0001 s (69M iterations)
Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Analyzing
Sobol to 3-simplex over NDims/update inplace/5
time: [12.609 ns 12.616 ns 12.626 ns]
change: [-31.965% -31.803% -31.634%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) high mild
4 (4.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/new alloc/10
Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Collecting 100 samples in estimated 5.0002 s (25M iterations)
Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Analyzing
Sobol to 3-simplex over NDims/new alloc/10
time: [130.44 ns 130.48 ns 130.54 ns]
change: [+0.4820% +0.6042% +0.7381%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/update inplace/10
Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Collecting 100 samples in estimated 5.0007 s (26M iterations)
Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Analyzing
Sobol to 3-simplex over NDims/update inplace/10
time: [106.11 ns 106.18 ns 106.30 ns]
change: [-2.0067% -1.9092% -1.8107%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/new alloc/20
Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Collecting 100 samples in estimated 5.0011 s (11M iterations)
Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Analyzing
Sobol to 3-simplex over NDims/new alloc/20
time: [366.69 ns 366.93 ns 367.26 ns]
change: [-4.0397% -3.9433% -3.8271%] (p = 0.00 < 0.05)
Performance has improved.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) low severe
4 (4.00%) low mild
4 (4.00%) high mild
4 (4.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/update inplace/20
Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Collecting 100 samples in estimated 5.0017 s (12M iterations)
Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Analyzing
Sobol to 3-simplex over NDims/update inplace/20
time: [287.40 ns 287.72 ns 288.21 ns]
change: [+3.5547% +3.6398% +3.7469%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/new alloc/30
Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Collecting 100 samples in estimated 5.0032 s (6.7M iterations)
Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Analyzing
Sobol to 3-simplex over NDims/new alloc/30
time: [639.67 ns 640.12 ns 640.72 ns]
change: [-1.4001% -1.2919% -1.1585%] (p = 0.00 < 0.05)
Performance has improved.
Found 18 outliers among 100 measurements (18.00%)
13 (13.00%) low mild
5 (5.00%) high severe
Benchmarking Sobol to 3-simplex over NDims/update inplace/30
Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Warming up for 3.0000 s
Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Collecting 100 samples in estimated 5.0027 s (6.6M iterations)
Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Analyzing
Sobol to 3-simplex over NDims/update inplace/30
time: [592.81 ns 593.80 ns 595.17 ns]
change: [+0.7903% +0.9184% +1.0784%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 15 outliers among 100 measurements (15.00%)
2 (2.00%) high mild
13 (13.00%) high severe
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_utils-93cc6a6439fb6062)
running 62 tests
test misc::tests::argmax_should_panic_given_empty_container - should panic ... ignored
test misc::tests::argmax_should_return_0_if_max_value_is_in_0_index ... ignored
test misc::tests::argmax_should_return_index_of_first_max_value_if_repeats ... ignored
test misc::tests::argmax_should_return_last_index_if_max_value_is_last ... ignored
test misc::tests::argmax_should_work_on_unique_values ... ignored
test misc::tests::argmin_normal ... ignored
test misc::tests::argmin_should_panic_given_empty_container - should panic ... ignored
test misc::tests::argmin_should_return_0_if_min_value_is_in_0_index ... ignored
test misc::tests::argmin_should_return_index_of_first_min_value_if_repeats ... ignored
test misc::tests::argmin_should_return_last_index_if_min_value_is_last ... ignored
test misc::tests::bincount_should_count_occupied ... ignored
test misc::tests::bincount_should_count_with_zeros ... ignored
test misc::tests::cumsum_should_return_empty_if_given_empty ... ignored
test misc::tests::cumsum_should_work_do_nothing_to_one_length_vector ... ignored
test misc::tests::cumsum_should_work_on_f64 ... ignored
test misc::tests::cumsum_should_work_on_u16 ... ignored
test misc::tests::cumsum_should_work_on_u8 ... ignored
test misc::tests::is_index_col_tests ... ignored
test misc::tests::minmax_on_repeated ... ignored
test misc::tests::minmax_on_reverse_unique_slice ... ignored
test misc::tests::minmax_on_sorted_unique_slice ... ignored
test misc::tests::minmax_should_copy_the_entry_for_a_single_element_slice ... ignored
test misc::tests::minmax_should_sort_two_element_slice_1 ... ignored
test misc::tests::minmax_should_sort_two_element_slice_2 ... ignored
test misc::tests::nan_sign_is_nan ... ignored
test misc::tests::neg_sign_is_neg ... ignored
test misc::tests::parse_empty_is_none ... ignored
test misc::tests::parse_result_f64 ... ignored
test misc::tests::parse_result_u8 ... ignored
test misc::tests::parse_result_u8_too_large_fail - should panic ... ignored
test misc::tests::pos_sign_is_pos ... ignored
test misc::tests::small_neg_sign_is_neg ... ignored
test misc::tests::small_pos_sign_is_pos ... ignored
test misc::tests::tanspose_mapvec ... ignored
test misc::tests::transpose_rect ... ignored
test misc::tests::transpose_square ... ignored
test misc::tests::unused_components_none_unused_should_return_empty ... ignored
test misc::tests::unused_components_should_return_unused_indices_in_descending_order ... ignored
test misc::tests::zero_sign_is_zero ... ignored
test numbers::tests::bell_n ... ignored
test numbers::tests::binom_nk ... ignored
test numbers::tests::ccnum_1_1 ... ignored
test numbers::tests::ccnum_1_2 ... ignored
test numbers::tests::ccnum_2_1 ... ignored
test numbers::tests::ccnums ... ignored
test numbers::tests::factorial_0_should_be_1 ... ignored
test numbers::tests::factorial_11 ... ignored
test numbers::tests::factorial_1_should_be_1 ... ignored
test numbers::tests::factorial_2_should_be_2 ... ignored
test numbers::tests::stirling_nk ... ignored
test quad::tests::quadp_of_sin ... ignored
test quad::tests::quadp_of_x2 ... ignored
test random::tests::choose2ixs_should_return_different_ixs ... ignored
test stats::tests::mean_1 ... ignored
test stats::tests::mean_2 ... ignored
test stats::tests::std_1 ... ignored
test stats::tests::std_2 ... ignored
test stats::tests::var_1 ... ignored
test stats::tests::var_2 ... ignored
test tests::cartprod_dual ... ignored
test tests::cartprod_single ... ignored
test tests::cartprod_triple ... ignored
test result: ok. 0 passed; 0 failed; 62 ignored; 0 measured; 0 filtered out; finished in 0.00s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment