Created
January 28, 2024 01:51
-
-
Save zamazan4ik/446ac5486058cb3bb9a12c100a8c3e56 to your computer and use it in GitHub Desktop.
lace: Instrumented to Release
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cargo pgo bench -- --all-features --workspace | |
| [2024-01-28T01:16:42Z INFO cargo_pgo::pgo::instrument] PGO profile directory will be cleared. | |
| [2024-01-28T01:16:42Z INFO cargo_pgo::pgo::instrument] PGO profiles will be stored into /home/zamazan4ik/open_source/lace/lace/target/pgo-profiles. | |
| Compiling cfg-if v1.0.0 | |
| Compiling once_cell v1.19.0 | |
| Compiling zerocopy v0.7.32 | |
| Compiling either v1.9.0 | |
| Compiling itoa v1.0.10 | |
| Compiling ryu v1.0.16 | |
| Compiling static_assertions v1.1.0 | |
| Compiling ppv-lite86 v0.2.17 | |
| Compiling memchr v2.7.1 | |
| Compiling regex-syntax v0.8.2 | |
| Compiling allocator-api2 v0.2.16 | |
| Compiling libc v0.2.152 | |
| Compiling serde v1.0.195 | |
| Compiling libm v0.2.8 | |
| Compiling crossbeam-utils v0.8.19 | |
| Compiling rayon-core v1.12.1 | |
| Compiling thiserror v1.0.56 | |
| Compiling num-traits v0.2.17 | |
| Compiling ahash v0.8.7 | |
| Compiling num-integer v0.1.45 | |
| Compiling equivalent v1.0.1 | |
| Compiling bytemuck v1.14.0 | |
| Compiling num-bigint v0.4.4 | |
| Compiling serde_json v1.0.111 | |
| Compiling zstd-sys v2.0.9+zstd.1.5.5 | |
| Compiling bitflags v2.4.2 | |
| Compiling array-init-cursor v0.2.0 | |
| Compiling num-rational v0.4.1 | |
| Compiling matrixmultiply v0.3.8 | |
| Compiling rawpointer v0.2.1 | |
| Compiling simdutf8 v0.1.4 | |
| Compiling typenum v1.17.0 | |
| Compiling num-iter v0.1.43 | |
| Compiling smartstring v1.0.1 | |
| Compiling planus v0.3.1 | |
| Compiling lz4-sys v1.9.4 | |
| Compiling target-features v0.1.5 | |
| Compiling doc-comment v0.3.3 | |
| Compiling peroxide v0.32.1 | |
| Compiling polars-utils v0.36.2 | |
| Compiling puruspe v0.2.0 | |
| Compiling dyn-clone v1.0.16 | |
| Compiling order-stat v0.1.3 | |
| Compiling polars-arrow v0.36.2 | |
| Compiling lexical-util v0.8.5 | |
| Compiling strength_reduce v0.2.4 | |
| Compiling safe_arch v0.7.1 | |
| Compiling streaming-iterator v0.1.9 | |
| Compiling ethnum v1.5.0 | |
| Compiling fast-float v0.2.0 | |
| Compiling foreign_vec v0.1.0 | |
| Compiling atoi_simd v0.15.6 | |
| Compiling itertools v0.12.0 | |
| Compiling alloc-no-stdlib v2.0.4 | |
| Compiling ref-cast v1.0.22 | |
| Compiling crc32fast v1.3.2 | |
| Compiling polars-compute v0.36.2 | |
| Compiling adler v1.0.2 | |
| Compiling alloc-stdlib v0.2.2 | |
| Compiling fallible-streaming-iterator v0.1.9 | |
| Compiling polars-core v0.36.2 | |
| Compiling snap v1.1.1 | |
| Compiling xxhash-rust v0.8.8 | |
| Compiling multiversion v0.7.3 | |
| Compiling brotli-decompressor v2.5.1 | |
| Compiling miniz_oxide v0.7.1 | |
| Compiling percent-encoding v2.3.1 | |
| Compiling rustix v0.38.30 | |
| Compiling linux-raw-sys v0.4.13 | |
| Compiling parquet-format-safe v0.2.4 | |
| Compiling streaming-decompression v0.1.2 | |
| Compiling crossbeam-epoch v0.9.18 | |
| Compiling crossbeam-channel v0.5.11 | |
| Compiling unsafe-libyaml v0.2.10 | |
| Compiling base64 v0.21.7 | |
| Compiling portable-atomic v1.6.0 | |
| Compiling aho-corasick v1.1.2 | |
| Compiling wide v0.7.13 | |
| Compiling special v0.10.3 | |
| Compiling polars-ops v0.36.2 | |
| Compiling bytes v1.5.0 | |
| Compiling crossbeam-deque v0.8.5 | |
| Compiling unicode-width v0.1.11 | |
| Compiling utf8parse v0.2.1 | |
| Compiling lazy_static v1.4.0 | |
| Compiling flate2 v1.0.28 | |
| Compiling home v0.5.9 | |
| Compiling anstyle-parse v0.2.3 | |
| Compiling polars v0.36.2 | |
| Compiling anstyle-query v1.0.2 | |
| Compiling thread-tree v0.3.3 | |
| Compiling colorchoice v1.0.0 | |
| Compiling number_prefix v0.4.0 | |
| Compiling anstyle v1.0.4 | |
| Compiling plotters-backend v0.3.5 | |
| Compiling half v1.8.2 | |
| Compiling ciborium-io v0.2.1 | |
| Compiling clap_lex v0.6.0 | |
| Compiling strsim v0.10.0 | |
| Compiling lexical-parse-integer v0.8.6 | |
| Compiling lexical-write-integer v0.8.5 | |
| Compiling anstream v0.6.11 | |
| Compiling ciborium-ll v0.2.1 | |
| Compiling plotters-svg v0.3.5 | |
| Compiling itertools v0.10.5 | |
| Compiling rayon v1.8.1 | |
| Compiling same-file v1.0.6 | |
| Compiling lexical-parse-float v0.8.5 | |
| Compiling lexical-write-float v0.8.5 | |
| Compiling clap_builder v4.4.18 | |
| Compiling cast v0.3.0 | |
| Compiling walkdir v2.4.0 | |
| Compiling anes v0.1.6 | |
| Compiling approx v0.5.1 | |
| Compiling getrandom v0.2.12 | |
| Compiling num_cpus v1.16.0 | |
| Compiling chrono v0.4.31 | |
| Compiling float-cmp v0.9.0 | |
| Compiling brotli v3.4.0 | |
| Compiling memmap2 v0.7.1 | |
| Compiling argminmax v0.6.1 | |
| Compiling console v0.15.8 | |
| Compiling lexical-core v0.8.5 | |
| Compiling plotters v0.3.5 | |
| Compiling oorandom v11.1.3 | |
| Compiling fastrand v2.0.1 | |
| Compiling option-ext v0.2.0 | |
| Compiling hashbrown v0.13.2 | |
| Compiling log v0.4.20 | |
| Compiling hex v0.4.3 | |
| Compiling dirs-sys v0.4.1 | |
| Compiling nix v0.27.1 | |
| Compiling regex-automata v0.4.3 | |
| Compiling humansize v2.1.3 | |
| Compiling askama_escape v0.10.3 | |
| Compiling indicatif v0.17.7 | |
| Compiling dirs v5.0.1 | |
| Compiling lace v0.6.0 (/home/zamazan4ik/open_source/lace/lace) | |
| Compiling maplit v1.0.2 | |
| Compiling lru v0.9.0 | |
| Compiling criterion-plot v0.5.0 | |
| Compiling lz4 v1.24.0 | |
| Compiling rand_core v0.6.4 | |
| Compiling num-complex v0.4.4 | |
| Compiling arrow-format v0.8.1 | |
| Compiling halfbrown v0.2.4 | |
| Compiling ciborium v0.2.1 | |
| Compiling bincode v1.3.3 | |
| Compiling erased-serde v0.3.31 | |
| Compiling is-terminal v0.4.10 | |
| Compiling tempfile v3.9.0 | |
| Compiling serde_with v2.3.3 | |
| Compiling rand_chacha v0.3.1 | |
| Compiling hashbrown v0.14.3 | |
| Compiling rand v0.8.5 | |
| Compiling simba v0.8.1 | |
| Compiling value-trait v0.8.0 | |
| Compiling clap v4.4.18 | |
| Compiling rand_xoshiro v0.6.0 | |
| Compiling ctrlc v3.4.2 | |
| Compiling num v0.4.1 | |
| Compiling simd-json v0.13.7 | |
| Compiling tinytemplate v1.2.1 | |
| Compiling askama v0.12.1 | |
| Compiling zstd-safe v7.0.0 | |
| Compiling indexmap v2.1.0 | |
| Compiling regex v1.10.2 | |
| Compiling rand_distr v0.4.3 | |
| Compiling lace_utils v0.2.0 (/home/zamazan4ik/open_source/lace/lace/lace_utils) | |
| Compiling zstd v0.13.0 | |
| Compiling lace_data v0.2.0 (/home/zamazan4ik/open_source/lace/lace/lace_data) | |
| Compiling criterion v0.5.1 | |
| Compiling serde_yaml v0.9.30 | |
| Compiling plotly v0.8.4 | |
| Compiling polars-error v0.36.2 | |
| Compiling nalgebra v0.32.3 | |
| Compiling polars-row v0.36.2 | |
| Compiling polars-json v0.36.2 | |
| Compiling polars-parquet v0.36.2 | |
| Compiling rv v0.16.2 | |
| Compiling lace_consts v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_consts) | |
| Compiling lace_stats v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_stats) | |
| Compiling polars-io v0.36.2 | |
| Compiling lace_geweke v0.2.1 (/home/zamazan4ik/open_source/lace/lace/lace_geweke) | |
| Compiling lace_codebook v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_codebook) | |
| Compiling lace_cc v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_cc) | |
| Compiling lace_metadata v0.5.0 (/home/zamazan4ik/open_source/lace/lace/lace_metadata) | |
| Finished bench [optimized] target(s) in 8m 19s | |
| [2024-01-28T01:25:02Z INFO cargo_pgo::pgo::instrument] PGO instrumentation build finished successfully. | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace-d97acfc927aaf8e4) | |
| running 116 tests | |
| test bencher::tests::bencher_from_state_builder_should_return_properly_sized_result ... ignored | |
| test data::init::tests::uses_codebook_categorical_hyper_if_specified ... ignored | |
| test data::init::tests::uses_codebook_continuous_hyper_if_specified ... ignored | |
| test examples::animals::test::columns_convert_properly ... ignored | |
| test examples::animals::test::rows_convert_properly ... ignored | |
| test index::tests::json_cell ... ignored | |
| test index::tests::json_column ... ignored | |
| test index::tests::json_row ... ignored | |
| test index::tests::to_cell ... ignored | |
| test interface::engine::builder::tests::default_build_settings ... ignored | |
| test interface::engine::builder::tests::seeding_engine_works ... ignored | |
| test interface::engine::builder::tests::with_id_offet_3 ... ignored | |
| test interface::engine::builder::tests::with_nstates_0_causes_error ... ignored | |
| test interface::engine::builder::tests::with_nstates_3 ... ignored | |
| test interface::engine::data::tests::append_bool ... ignored | |
| test interface::engine::data::tests::incr_cats_in_codebook_with_suppl_metadata_for_valmap_col ... ignored | |
| test interface::engine::data::tests::incr_cats_in_codebook_without_suppl_metadata_for_no_valmap_col ... ignored | |
| test interface::engine::data::tests::requiring_examples::errors_when_new_column_not_in_col_metadata ... ignored | |
| test interface::engine::data::tests::requiring_examples::errors_when_no_col_metadata_when_new_columns ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_one_existing_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_one_new_and_one_existing_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_one_new_col_in_existing_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_one_new_col_in_new_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_one_new_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_two_new_cols_in_existing_row ... ignored | |
| test interface::engine::data::tests::requiring_examples::tasks_on_two_new_rows ... ignored | |
| test interface::engine::tests::all_update_handler_methods_called ... ignored | |
| test interface::engine::tests::state_timeout_update_handler ... ignored | |
| test interface::metadata::tests::engine_and_oracle_serde_the_same ... ignored | |
| test interface::metadata::tests::engine_can_run_after_serde ... ignored | |
| test interface::metadata::tests::engine_can_update_data_after ... ignored | |
| test interface::metadata::tests::serde_engine ... ignored | |
| test interface::metadata::tests::serde_oracle ... ignored | |
| test interface::oracle::tests::impute_uncertainty_smoke ... ignored | |
| test interface::oracle::tests::mixture_and_oracle_logp_equivalence_categorical ... ignored | |
| test interface::oracle::tests::mixture_and_oracle_logp_equivalence_gaussian ... ignored | |
| test interface::oracle::tests::mutual_information_smoke ... ignored | |
| test interface::oracle::tests::predict_uncertainty_smoke_no_given ... ignored | |
| test interface::oracle::tests::predict_uncertainty_smoke_with_given ... ignored | |
| test interface::oracle::tests::requiring_examples::mi_pw_and_normal_equivalence ... ignored | |
| test interface::oracle::tests::requiring_examples::mixture_and_oracle_logp_equivalence_animals_single_state ... ignored | |
| test interface::oracle::tests::requiring_examples::pw_and_conditional_entropy_equivalence_animals ... ignored | |
| test interface::oracle::tests::requiring_examples::pw_and_info_prop_equivalence_animals ... ignored | |
| test interface::oracle::tests::requiring_examples::recreate_doctest_mi_failure ... ignored | |
| test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree ... ignored | |
| test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_given ... ignored | |
| test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_given_state_ixs ... ignored | |
| test interface::oracle::tests::requiring_examples::seeded_simulate_and_simulator_agree_state_ixs ... ignored | |
| test interface::oracle::tests::single_continuous_column_logp ... ignored | |
| test interface::oracle::tests::single_continuous_column_logp_duplicated_states ... ignored | |
| test interface::oracle::tests::single_continuous_column_logp_state_0 ... ignored | |
| test interface::oracle::tests::surpisal_value_1 ... ignored | |
| test interface::oracle::tests::surpisal_value_2 ... ignored | |
| test interface::oracle::utils::tests::continuous_predict_with_spread_out_modes ... ignored | |
| test interface::oracle::utils::tests::give_weights_size_check_single_target_column ... ignored | |
| test interface::oracle::utils::tests::multi_state_categorical_gaussian_entropy_0 ... ignored | |
| test interface::oracle::utils::tests::multi_state_categorical_self_entropy ... ignored | |
| test interface::oracle::utils::tests::multi_state_categorical_single_entropy ... ignored | |
| test interface::oracle::utils::tests::multi_state_categorical_single_entropy_vs_old ... ignored | |
| test interface::oracle::utils::tests::multi_state_continuous_impute_1 ... ignored | |
| test interface::oracle::utils::tests::multi_state_continuous_impute_2 ... ignored | |
| test interface::oracle::utils::tests::multi_state_dual_categorical_entropy_1 ... ignored | |
| test interface::oracle::utils::tests::multi_state_dual_categorical_entropy_vs_joint_equiv ... ignored | |
| test interface::oracle::utils::tests::single_continuous_column_weights_given ... ignored | |
| test interface::oracle::utils::tests::single_continuous_column_weights_no_given ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_entropy ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_gaussian_entropy_0 ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_gaussian_entropy_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_impute_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_impute_2 ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_predict_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_categorical_self_entropy ... ignored | |
| test interface::oracle::utils::tests::single_state_continuous_impute_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_continuous_impute_2 ... ignored | |
| test interface::oracle::utils::tests::single_state_count_impute_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_count_impute_2 ... ignored | |
| test interface::oracle::utils::tests::single_state_count_predict ... ignored | |
| test interface::oracle::utils::tests::single_state_dual_categorical_entropy_0 ... ignored | |
| test interface::oracle::utils::tests::single_state_dual_categorical_entropy_1 ... ignored | |
| test interface::oracle::utils::tests::single_state_dual_categorical_entropy_vs_joint_equiv ... ignored | |
| test interface::oracle::utils::tests::single_state_weights_value_check ... ignored | |
| test interface::oracle::utils::tests::single_view_weights_state_0_no_given ... ignored | |
| test interface::oracle::utils::tests::single_view_weights_state_0_with_added_given ... ignored | |
| test interface::oracle::utils::tests::single_view_weights_state_0_with_one_given ... ignored | |
| test interface::oracle::utils::tests::single_view_weights_vs_exp ... ignored | |
| test interface::oracle::utils::tests::single_view_weights_vs_exp_one_given ... ignored | |
| test interface::oracle::utils::tests::sobol_samples ... ignored | |
| test interface::oracle::utils::tests::sobol_single_categorical_entropy_vs_exact ... ignored | |
| test interface::oracle::utils::tests::sobol_single_gaussian_entropy_vs_exact ... ignored | |
| test interface::oracle::utils::tests::state_logp_values_multi_col_multi_view ... ignored | |
| test interface::oracle::utils::tests::state_logp_values_multi_col_multi_view_precomp ... ignored | |
| test interface::oracle::utils::tests::state_logp_values_multi_col_single_view ... ignored | |
| test interface::oracle::utils::tests::state_logp_values_multi_col_single_view_precomp ... ignored | |
| test interface::oracle::utils::tests::state_logp_values_single_col_single_view ... ignored | |
| test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_multi_view ... ignored | |
| test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_multi_view_precomp ... ignored | |
| test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_single_view ... ignored | |
| test interface::oracle::utils::tests::state_logp_vs_exp_values_multi_col_single_view_precomp ... ignored | |
| test interface::oracle::utils::tests::state_logp_vs_exp_values_single_col_single_view ... ignored | |
| test interface::oracle::validation::tests::given_nothing_is_ok ... ignored | |
| test interface::oracle::validation::tests::good_conditions_no_missing_ok ... ignored | |
| test interface::oracle::validation::tests::incompatible_datum_bad ... ignored | |
| test interface::oracle::validation::tests::target_conflict_bad ... ignored | |
| test interface::oracle::validation::tests::target_index_oob_bad ... ignored | |
| test optimize::scalar::tests::bounded_min_neg_gaussian_loglike ... ignored | |
| test optimize::scalar::tests::bounded_min_neg_x_cubed ... ignored | |
| test optimize::scalar::tests::bounded_min_x_cubed ... ignored | |
| test optimize::scalar::tests::bounded_should_find_global_min ... ignored | |
| test optimize::scalar::tests::brounded_min_x_square ... ignored | |
| test optimize::scalar::tests::brute_force_min_neg_gaussian_loglike ... ignored | |
| test optimize::scalar::tests::brute_force_min_neg_x_cubed ... ignored | |
| test optimize::scalar::tests::brute_force_min_x_cubed ... ignored | |
| test optimize::scalar::tests::brute_force_min_x_square ... ignored | |
| test optimize::scalar::tests::gradient_descent_fn1 ... ignored | |
| test optimize::scalar::tests::newton_fn1 ... ignored | |
| test optimize::scalar::tests::newton_gaussian ... ignored | |
| test result: ok. 0 passed; 0 failed; 116 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running benches/insert_data.rs (target/x86_64-unknown-linux-gnu/release/deps/insert_data-26df042bf99b7af4) | |
| Benchmarking insert_data overwrite only | |
| Benchmarking insert_data overwrite only: Warming up for 3.0000 s | |
| Benchmarking insert_data overwrite only: Collecting 100 samples in estimated 5.0578 s (354k iterations) | |
| Benchmarking insert_data overwrite only: Analyzing | |
| insert_data overwrite only | |
| time: [6.2361 µs 6.2442 µs 6.2515 µs] | |
| change: [+19.767% +20.005% +20.230%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking insert_data append rows | |
| Benchmarking insert_data append rows: Warming up for 3.0000 s | |
| Benchmarking insert_data append rows: Collecting 100 samples in estimated 5.1188 s (212k iterations) | |
| Benchmarking insert_data append rows: Analyzing | |
| insert_data append rows time: [17.254 µs 17.332 µs 17.395 µs] | |
| change: [+18.146% +19.993% +22.005%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Running benches/oracle_fns.rs (target/x86_64-unknown-linux-gnu/release/deps/oracle_fns-5a6c41af9794c2dc) | |
| Benchmarking oracle mi categorical-continuous | |
| Benchmarking oracle mi categorical-continuous: Warming up for 3.0000 s | |
| Benchmarking oracle mi categorical-continuous: Collecting 100 samples in estimated 5.4255 s (800 iterations) | |
| Benchmarking oracle mi categorical-continuous: Analyzing | |
| oracle mi categorical-continuous | |
| time: [6.7888 ms 6.7921 ms 6.7959 ms] | |
| change: [+2.3990% +2.4542% +2.5142%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking oracle mi continuous | |
| Benchmarking oracle mi continuous: Warming up for 3.0000 s | |
| Benchmarking oracle mi continuous: Collecting 100 samples in estimated 5.4585 s (900 iterations) | |
| Benchmarking oracle mi continuous: Analyzing | |
| oracle mi continuous time: [6.0519 ms 6.0591 ms 6.0695 ms] | |
| change: [+23.594% +24.576% +25.475%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking oracle mi categorical | |
| Benchmarking oracle mi categorical: Warming up for 3.0000 s | |
| Benchmarking oracle mi categorical: Collecting 100 samples in estimated 5.1061 s (202k iterations) | |
| Benchmarking oracle mi categorical: Analyzing | |
| oracle mi categorical time: [25.378 µs 25.411 µs 25.443 µs] | |
| change: [+36.196% +36.840% +37.604%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking oracle ftype | |
| Benchmarking oracle ftype: Warming up for 3.0000 s | |
| Benchmarking oracle ftype: Collecting 100 samples in estimated 5.0001 s (177M iterations) | |
| Benchmarking oracle ftype: Analyzing | |
| oracle ftype time: [28.270 ns 28.332 ns 28.417 ns] | |
| change: [+139.66% +141.50% +143.88%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking oracle ftypes | |
| Benchmarking oracle ftypes: Warming up for 3.0000 s | |
| Benchmarking oracle ftypes: Collecting 100 samples in estimated 5.0005 s (4.5M iterations) | |
| Benchmarking oracle ftypes: Analyzing | |
| oracle ftypes time: [1.1205 µs 1.1258 µs 1.1350 µs] | |
| change: [+81.273% +83.011% +84.263%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| Benchmarking oracle depprob | |
| Benchmarking oracle depprob: Warming up for 3.0000 s | |
| Benchmarking oracle depprob: Collecting 100 samples in estimated 5.0000 s (181M iterations) | |
| Benchmarking oracle depprob: Analyzing | |
| oracle depprob time: [27.638 ns 27.684 ns 27.737 ns] | |
| change: [+71.410% +72.711% +74.524%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 7 (7.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking oracle rowsim | |
| Benchmarking oracle rowsim: Warming up for 3.0000 s | |
| Benchmarking oracle rowsim: Collecting 100 samples in estimated 5.0012 s (13M iterations) | |
| Benchmarking oracle rowsim: Analyzing | |
| oracle rowsim time: [400.30 ns 401.58 ns 402.92 ns] | |
| change: [+23.642% +24.416% +25.415%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| Benchmarking oracle novelty | |
| Benchmarking oracle novelty: Warming up for 3.0000 s | |
| Benchmarking oracle novelty: Collecting 100 samples in estimated 5.0026 s (8.7M iterations) | |
| Benchmarking oracle novelty: Analyzing | |
| oracle novelty time: [575.70 ns 578.62 ns 581.75 ns] | |
| change: [+8.6546% +9.2808% +10.052%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking oracle categorical entropy | |
| Benchmarking oracle categorical entropy: Warming up for 3.0000 s | |
| Benchmarking oracle categorical entropy: Collecting 100 samples in estimated 5.1851 s (136k iterations) | |
| Benchmarking oracle categorical entropy: Analyzing | |
| oracle categorical entropy | |
| time: [38.113 µs 38.189 µs 38.290 µs] | |
| change: [+31.854% +33.568% +36.204%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 12 (12.00%) high severe | |
| Benchmarking oracle predictor search | |
| Benchmarking oracle predictor search: Warming up for 3.0000 s | |
| Benchmarking oracle predictor search: Collecting 100 samples in estimated 5.0486 s (200 iterations) | |
| Benchmarking oracle predictor search: Analyzing | |
| oracle predictor search time: [25.249 ms 25.282 ms 25.316 ms] | |
| change: [+3598.2% +3629.5% +3657.3%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking oracle info prop | |
| Benchmarking oracle info prop: Warming up for 3.0000 s | |
| Benchmarking oracle info prop: Collecting 100 samples in estimated 5.2375 s (86k iterations) | |
| Benchmarking oracle info prop: Analyzing | |
| oracle info prop time: [61.098 µs 61.174 µs 61.277 µs] | |
| change: [+33.776% +34.904% +36.289%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking oracle conditional entropy | |
| Benchmarking oracle conditional entropy: Warming up for 3.0000 s | |
| Benchmarking oracle conditional entropy: Collecting 100 samples in estimated 5.1882 s (91k iterations) | |
| Benchmarking oracle conditional entropy: Analyzing | |
| oracle conditional entropy | |
| time: [56.945 µs 57.067 µs 57.234 µs] | |
| change: [+33.935% +34.508% +35.266%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking oracle surprisal | |
| Benchmarking oracle surprisal: Warming up for 3.0000 s | |
| Benchmarking oracle surprisal: Collecting 100 samples in estimated 5.0013 s (9.3M iterations) | |
| Benchmarking oracle surprisal: Analyzing | |
| oracle surprisal time: [546.29 ns 548.15 ns 550.12 ns] | |
| change: [+38.826% +40.453% +42.245%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking oracle self surprisal | |
| Benchmarking oracle self surprisal: Warming up for 3.0000 s | |
| Benchmarking oracle self surprisal: Collecting 100 samples in estimated 5.0001 s (8.1M iterations) | |
| Benchmarking oracle self surprisal: Analyzing | |
| oracle self surprisal time: [618.27 ns 621.20 ns 625.22 ns] | |
| change: [+38.043% +39.275% +40.671%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking oracle datum | |
| Benchmarking oracle datum: Warming up for 3.0000 s | |
| Benchmarking oracle datum: Collecting 100 samples in estimated 5.0001 s (61M iterations) | |
| Benchmarking oracle datum: Analyzing | |
| oracle datum time: [81.674 ns 81.883 ns 82.105 ns] | |
| change: [+30.836% +31.903% +33.060%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking oracle logp | |
| Benchmarking oracle logp: Warming up for 3.0000 s | |
| Benchmarking oracle logp: Collecting 100 samples in estimated 5.0428 s (449k iterations) | |
| Benchmarking oracle logp: Analyzing | |
| oracle logp time: [11.203 µs 11.221 µs 11.244 µs] | |
| change: [+22.668% +23.883% +25.356%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| Benchmarking oracle simulate | |
| Benchmarking oracle simulate: Warming up for 3.0000 s | |
| Benchmarking oracle simulate: Collecting 100 samples in estimated 5.3644 s (71k iterations) | |
| Benchmarking oracle simulate: Analyzing | |
| oracle simulate time: [75.977 µs 76.084 µs 76.242 µs] | |
| change: [+21.122% +21.941% +23.067%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking oracle draw | |
| Benchmarking oracle draw: Warming up for 3.0000 s | |
| Benchmarking oracle draw: Collecting 100 samples in estimated 5.0574 s (192k iterations) | |
| Benchmarking oracle draw: Analyzing | |
| oracle draw time: [26.518 µs 26.621 µs 26.755 µs] | |
| change: [+10.779% +11.413% +12.259%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 5 (5.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking oracle impute | |
| Benchmarking oracle impute: Warming up for 3.0000 s | |
| Benchmarking oracle impute: Collecting 100 samples in estimated 5.0094 s (545k iterations) | |
| Benchmarking oracle impute: Analyzing | |
| oracle impute time: [9.1734 µs 9.2093 µs 9.2616 µs] | |
| change: [+8.2387% +9.3643% +10.685%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking oracle predict | |
| Benchmarking oracle predict: Warming up for 3.0000 s | |
| Benchmarking oracle predict: Collecting 100 samples in estimated 5.1740 s (131k iterations) | |
| Benchmarking oracle predict: Analyzing | |
| oracle predict time: [39.439 µs 39.569 µs 39.763 µs] | |
| change: [+11.951% +12.659% +13.497%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 6 (6.00%) low mild | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking oracle predict continuous | |
| Benchmarking oracle predict continuous: Warming up for 3.0000 s | |
| Benchmarking oracle predict continuous: Collecting 100 samples in estimated 5.0001 s (74M iterations) | |
| Benchmarking oracle predict continuous: Analyzing | |
| oracle predict continuous | |
| time: [67.245 ns 67.425 ns 67.652 ns] | |
| change: [+30.683% +32.531% +34.379%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 10 (10.00%) high severe | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_cc-2c9864178244650b) | |
| running 79 tests | |
| test alg::tests::test_col_alg_from_string_finite_cpu ... ignored | |
| test alg::tests::test_col_alg_from_string_gibbs ... ignored | |
| test alg::tests::test_col_alg_from_string_invalid ... ignored | |
| test alg::tests::test_col_alg_from_string_slice ... ignored | |
| test alg::tests::test_row_alg_from_string_finite_cpu ... ignored | |
| test alg::tests::test_row_alg_from_string_gibbs ... ignored | |
| test alg::tests::test_row_alg_from_string_invalid ... ignored | |
| test alg::tests::test_row_alg_from_string_sams ... ignored | |
| test alg::tests::test_row_alg_from_string_slice ... ignored | |
| test assignment::tests::bad_counts_fails_validation ... ignored | |
| test assignment::tests::dirvec_with_alpha_1 ... ignored | |
| test assignment::tests::dirvec_with_alpha_15 ... ignored | |
| test assignment::tests::dirvec_with_unassigned_entry ... ignored | |
| test assignment::tests::drawn_assignment_should_have_valid_partition ... ignored | |
| test assignment::tests::flat_partition_validation ... ignored | |
| test assignment::tests::from_prior_should_have_valid_alpha_and_proper_length ... ignored | |
| test assignment::tests::from_rng_seed_control_works ... ignored | |
| test assignment::tests::from_vec ... ignored | |
| test assignment::tests::high_n_cats_fails_validation ... ignored | |
| test assignment::tests::lcrp_all_ones ... ignored | |
| test assignment::tests::log_dirvec_with_alpha_1 ... ignored | |
| test assignment::tests::log_dirvec_with_alpha_15 ... ignored | |
| test assignment::tests::low_n_cats_fails_validation ... ignored | |
| test assignment::tests::manual_seed_control_works ... ignored | |
| test assignment::tests::no_zero_cat_fails_validation ... ignored | |
| test assignment::tests::reassign_to_existing_cat ... ignored | |
| test assignment::tests::reassign_to_new_cat ... ignored | |
| test assignment::tests::unassign_non_singleton ... ignored | |
| test assignment::tests::unassign_singleton_high ... ignored | |
| test assignment::tests::unassign_singleton_low ... ignored | |
| test assignment::tests::unassign_singleton_middle ... ignored | |
| test assignment::tests::weights ... ignored | |
| test assignment::tests::with_n_cats_n_cats_doesnt_divides_n ... ignored | |
| test assignment::tests::with_n_cats_n_cats_evenly_divides_n ... ignored | |
| test assignment::tests::zero_count_fails_validation ... ignored | |
| test feature::column::tests::repop_categorical_data_should_put_the_data_back_in ... ignored | |
| test feature::column::tests::repop_continuous_data_should_put_the_data_back_in ... ignored | |
| test feature::column::tests::take_categorical_data_should_leave_col_model_data_empty ... ignored | |
| test feature::column::tests::take_continuous_data_should_leave_col_model_data_empty ... ignored | |
| test feature::column::tests::to_mixture_with_zero_weight_ignores_component ... ignored | |
| test feature::mnar::test::cpnt_likelihood_missing ... ignored | |
| test feature::mnar::test::cpnt_likelihood_present ... ignored | |
| test feature::mnar::test::cpnt_logp_missing ... ignored | |
| test feature::mnar::test::cpnt_logp_present ... ignored | |
| test feature::mnar::test::insert_data_missing_into_missing ... ignored | |
| test feature::mnar::test::insert_data_missing_into_present ... ignored | |
| test feature::mnar::test::insert_data_present_into_missing ... ignored | |
| test feature::mnar::test::insert_data_present_into_present ... ignored | |
| test feature::mnar::test::remove_data_missing ... ignored | |
| test feature::mnar::test::remove_data_present ... ignored | |
| test feature::traits::tests::score_and_asgn_score_equivalency ... ignored | |
| test massflip::tests::naive_matches_matrix_for_same_seed ... ignored | |
| test massflip::tests::serial_and_par_matrix_are_the_same_for_same_seed ... ignored | |
| test misc::tests::sb_slice::should_return_error_for_zero_u_star ... ignored | |
| test misc::tests::sb_slice::should_return_input_weights_if_alpha_is_zero ... ignored | |
| test misc::tests::sb_slice::smoke ... ignored | |
| test state::builder::tests::built_state_should_update ... ignored | |
| test state::builder::tests::n_rows_overriden_by_features ... ignored | |
| test state::builder::tests::seeding_state_works ... ignored | |
| test state::builder::tests::test_dimensions ... ignored | |
| test state::test::extract_ftr_non_singleton ... ignored | |
| test state::test::extract_ftr_singleton_low ... ignored | |
| test state::test::flatten_cols ... ignored | |
| test state::test::geweke_from_prior_all_transitions ... ignored | |
| test state::test::geweke_from_prior_no_alpha_transition ... ignored | |
| test state::test::geweke_from_prior_no_col_transition ... ignored | |
| test state::test::geweke_from_prior_no_row_or_col_transition ... ignored | |
| test state::test::geweke_from_prior_no_row_transition ... ignored | |
| test state::test::gibbs_col_transition_smoke ... ignored | |
| test state::test::gibbs_row_transition_smoke ... ignored | |
| test state::test::update_should_stop_at_max_iters ... ignored | |
| test view::tests::extend_cols_adds_empty_unassigned_rows ... ignored | |
| test view::tests::insert_datum_into_existing_spot_updates_suffstats ... ignored | |
| test view::tests::insert_datum_into_unassigned_spot_does_not_update_suffstats ... ignored | |
| test view::tests::seeding_view_works ... ignored | |
| test view::tests::singleton_reassign_smoke_finite_cpu ... ignored | |
| test view::tests::singleton_reassign_smoke_gibbs ... ignored | |
| test view::tests::singleton_reassign_smoke_sams ... ignored | |
| test view::tests::singleton_reassign_smoke_slice ... ignored | |
| test result: ok. 0 passed; 0 failed; 79 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running benches/all_algs.rs (target/x86_64-unknown-linux-gnu/release/deps/all_algs-06a6783e45d3b491) | |
| Benchmarking genomics-data-finite-finite | |
| Benchmarking genomics-data-finite-finite: Warming up for 3.0000 s | |
| Benchmarking genomics-data-finite-finite: Collecting 100 samples in estimated 5.1828 s (300 iterations) | |
| Benchmarking genomics-data-finite-finite: Analyzing | |
| genomics-data-finite-finite | |
| time: [11.550 ms 11.644 ms 11.752 ms] | |
| change: [+319.60% +324.09% +329.09%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking genomics-data-slice-finite | |
| Benchmarking genomics-data-slice-finite: Warming up for 3.0000 s | |
| Benchmarking genomics-data-slice-finite: Collecting 100 samples in estimated 5.7349 s (300 iterations) | |
| Benchmarking genomics-data-slice-finite: Analyzing | |
| genomics-data-slice-finite | |
| time: [13.444 ms 13.540 ms 13.644 ms] | |
| change: [+370.41% +375.37% +380.70%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking genomics-data-gibbs-finite | |
| Benchmarking genomics-data-gibbs-finite: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 29.2s, or reduce sample count to 10. | |
| Benchmarking genomics-data-gibbs-finite: Collecting 100 samples in estimated 29.171 s (100 iterations) | |
| Benchmarking genomics-data-gibbs-finite: Analyzing | |
| genomics-data-gibbs-finite | |
| time: [280.65 ms 283.87 ms 286.97 ms] | |
| change: [+1528.5% +1561.2% +1593.2%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking genomics-data-sams-finite | |
| Benchmarking genomics-data-sams-finite: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 29.5s, or reduce sample count to 10. | |
| Benchmarking genomics-data-sams-finite: Collecting 100 samples in estimated 29.516 s (100 iterations) | |
| Benchmarking genomics-data-sams-finite: Analyzing | |
| genomics-data-sams-finite | |
| time: [280.28 ms 283.23 ms 286.04 ms] | |
| change: [+1515.2% +1546.1% +1577.3%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| Running benches/feature_prior_update.rs (target/x86_64-unknown-linux-gnu/release/deps/feature_prior_update-4883e5b98ab12bd4) | |
| Benchmarking update continuous prior | |
| Benchmarking update continuous prior: Warming up for 3.0000 s | |
| Benchmarking update continuous prior: Collecting 100 samples in estimated 5.2878 s (15k iterations) | |
| Benchmarking update continuous prior: Analyzing | |
| update continuous prior time: [349.13 µs 349.55 µs 349.96 µs] | |
| change: [+35.864% +36.023% +36.180%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking update categorical prior | |
| Benchmarking update categorical prior: Warming up for 3.0000 s | |
| Benchmarking update categorical prior: Collecting 100 samples in estimated 5.0400 s (520k iterations) | |
| Benchmarking update categorical prior: Analyzing | |
| update categorical prior | |
| time: [9.6449 µs 9.6729 µs 9.7079 µs] | |
| change: [+31.886% +32.417% +33.296%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 5 (5.00%) low mild | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking update count prior | |
| Benchmarking update count prior: Warming up for 3.0000 s | |
| Benchmarking update count prior: Collecting 100 samples in estimated 5.1871 s (121k iterations) | |
| Benchmarking update count prior: Analyzing | |
| update count prior time: [41.866 µs 42.266 µs 42.629 µs] | |
| change: [+25.456% +26.934% +28.430%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) low mild | |
| Running benches/massflip.rs (target/x86_64-unknown-linux-gnu/release/deps/massflip-5b5606068c42584b) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Collecting 100 samples in estimated 5.0002 s (621k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/100: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/100 | |
| time: [6.9822 µs 7.0021 µs 7.0284 µs] | |
| change: [-28.350% -28.072% -27.684%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 8 (8.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Collecting 100 samples in estimated 5.5803 s (20k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/100: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/100 | |
| time: [267.94 µs 269.28 µs 270.60 µs] | |
| change: [+686.48% +709.45% +734.03%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Collecting 100 samples in estimated 5.1167 s (131k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/500: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/500 | |
| time: [34.799 µs 34.804 µs 34.809 µs] | |
| change: [-28.498% -28.486% -28.474%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low severe | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Collecting 100 samples in estimated 7.0964 s (15k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/500: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/500 | |
| time: [431.77 µs 434.83 µs 438.19 µs] | |
| change: [+401.08% +416.32% +432.38%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 1 (1.00%) low severe | |
| 5 (5.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Collecting 100 samples in estimated 5.0794 s (66k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/1000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/1000 | |
| time: [69.511 µs 69.518 µs 69.524 µs] | |
| change: [-28.549% -28.535% -28.523%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Collecting 100 samples in estimated 6.3818 s (10k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/1000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/1000 | |
| time: [560.12 µs 563.25 µs 566.75 µs] | |
| change: [+488.04% +495.93% +503.80%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Collecting 100 samples in estimated 5.8580 s (15k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/5000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/5000 | |
| time: [348.85 µs 350.18 µs 352.00 µs] | |
| change: [-28.964% -28.434% -27.999%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.0s, enable flat sampling, or reduce sample count to 50. | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Collecting 100 samples in estimated 8.0123 s (5050 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/5000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/5000 | |
| time: [1.3556 ms 1.3681 ms 1.3820 ms] | |
| change: [+576.85% +591.99% +607.46%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 5 (5.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Collecting 100 samples in estimated 7.8309 s (10k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/10000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/10000 | |
| time: [696.84 µs 697.11 µs 697.67 µs] | |
| change: [-28.476% -28.396% -28.278%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low mild | |
| 7 (7.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Collecting 100 samples in estimated 5.0703 s (1900 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/10000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/10000 | |
| time: [2.1537 ms 2.1806 ms 2.2125 ms] | |
| change: [+659.33% +676.07% +694.23%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) high mild | |
| 10 (10.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Collecting 100 samples in estimated 5.0591 s (1300 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/serial/50000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/serial/50000 | |
| time: [3.4817 ms 3.4820 ms 3.4823 ms] | |
| change: [-34.508% -34.494% -34.482%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000 | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Collecting 100 samples in estimated 5.0238 s (600 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip (10 cols)/parallel/50000: Analyzing | |
| Compare Parallel vs Serial Massflip (10 cols)/parallel/50000 | |
| time: [6.4357 ms 6.5089 ms 6.5857 ms] | |
| change: [+564.13% +596.52% +632.20%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Collecting 100 samples in estimated 5.0158 s (641k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/100 | |
| time: [6.7652 µs 6.7682 µs 6.7714 µs] | |
| change: [+3.4704% +3.5293% +3.5837%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Collecting 100 samples in estimated 5.4812 s (20k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/100 | |
| time: [265.97 µs 266.87 µs 267.78 µs] | |
| change: [+677.21% +699.35% +723.19%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Collecting 100 samples in estimated 5.1629 s (136k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/500 | |
| time: [33.630 µs 33.636 µs 33.642 µs] | |
| change: [+3.0286% +3.0699% +3.1134%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 10 (10.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Collecting 100 samples in estimated 7.2636 s (15k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/500 | |
| time: [448.87 µs 452.21 µs 455.89 µs] | |
| change: [+426.34% +441.96% +458.93%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Collecting 100 samples in estimated 5.3130 s (71k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/1000 | |
| time: [67.220 µs 67.234 µs 67.250 µs] | |
| change: [+3.2631% +3.3042% +3.3460%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Collecting 100 samples in estimated 6.6963 s (10k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/1000 | |
| time: [590.71 µs 596.14 µs 602.36 µs] | |
| change: [+518.46% +528.04% +537.42%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 1 (1.00%) low mild | |
| 7 (7.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Collecting 100 samples in estimated 5.7044 s (15k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/5000 | |
| time: [336.76 µs 336.93 µs 337.10 µs] | |
| change: [+3.3415% +3.3793% +3.4151%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.4s, enable flat sampling, or reduce sample count to 50. | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Collecting 100 samples in estimated 8.3949 s (5050 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/5000 | |
| time: [1.4270 ms 1.4414 ms 1.4574 ms] | |
| change: [+638.12% +651.36% +664.68%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 7 (7.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Collecting 100 samples in estimated 7.5854 s (10k iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/10000 | |
| time: [673.76 µs 673.97 µs 674.20 µs] | |
| change: [+3.0404% +3.2261% +3.3761%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 13 (13.00%) high mild | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Collecting 100 samples in estimated 5.0211 s (1800 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/10000 | |
| time: [2.2721 ms 2.2993 ms 2.3316 ms] | |
| change: [+732.56% +750.68% +769.53%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Collecting 100 samples in estimated 5.3007 s (1400 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/serial/50000 | |
| time: [3.3742 ms 3.3754 ms 3.3768 ms] | |
| change: [-10.543% -10.079% -9.7708%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000 | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Warming up for 3.0000 s | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Collecting 100 samples in estimated 5.3023 s (600 iterations) | |
| Benchmarking Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000: Analyzing | |
| Compare Parallel vs Serial Massflip Slice (10 cols)/parallel par/50000 | |
| time: [6.8569 ms 6.9127 ms 6.9715 ms] | |
| change: [+485.77% +493.86% +501.60%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Running benches/state_types.rs (target/x86_64-unknown-linux-gnu/release/deps/state_types-499b2c014caa81e1) | |
| Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats) | |
| Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s | |
| Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.5645 s (20k iterations) | |
| Benchmarking all-categorical(2) state 20-by-2 (1 views, 5 cats): Analyzing | |
| all-categorical(2) state 20-by-2 (1 views, 5 cats) | |
| time: [262.45 µs 268.51 µs 273.96 µs] | |
| change: [+88.287% +91.561% +94.649%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 8 (8.00%) low severe | |
| 7 (7.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats) | |
| Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s | |
| Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.4627 s (10k iterations) | |
| Benchmarking all-gaussian state 20-by-2 (1 views, 5 cats): Analyzing | |
| all-gaussian state 20-by-2 (1 views, 5 cats) | |
| time: [526.38 µs 540.06 µs 553.03 µs] | |
| change: [+118.70% +124.15% +128.66%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 2 (2.00%) low severe | |
| 12 (12.00%) low mild | |
| Benchmarking all-count-state 20-by-2 (1 views, 5 cats) | |
| Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Warming up for 3.0000 s | |
| Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Collecting 100 samples in estimated 5.0902 s (15k iterations) | |
| Benchmarking all-count-state 20-by-2 (1 views, 5 cats): Analyzing | |
| all-count-state 20-by-2 (1 views, 5 cats) | |
| time: [330.31 µs 336.77 µs 342.43 µs] | |
| change: [+109.04% +113.73% +118.11%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_codebook-52f3a7558d973b63) | |
| running 63 tests | |
| test codebook::tests::colmetedatalist::remove_by_index_from_front ... ignored | |
| test codebook::tests::colmetedatalist::remove_by_index_from_middle ... ignored | |
| test codebook::tests::deserialize_metadata_list ... ignored | |
| test codebook::tests::deserialize_metadata_list_with_duplicate_names_fails - should panic ... ignored | |
| test codebook::tests::insert_existing_row_names_returns_error ... ignored | |
| test codebook::tests::insert_into_empty_row_names ... ignored | |
| test codebook::tests::merge_codebooks_produces_correct_ids ... ignored | |
| test codebook::tests::merge_cols_detects_duplicate_columns ... ignored | |
| test codebook::tests::n_cols_returns_number_of_column_metadata ... ignored | |
| test codebook::tests::new_with_duplicate_names_should_fail ... ignored | |
| test codebook::tests::pop_front ... ignored | |
| test codebook::tests::row_names_try_into_repeats_vec ... ignored | |
| test codebook::tests::row_names_try_into_unique_vec ... ignored | |
| test codebook::tests::serialize_metadata_list ... ignored | |
| test codebook::tests::serialize_then_deserialize ... ignored | |
| test codebook::tests::value_map_for_categorical_coltype_check ... ignored | |
| test codebook::tests::value_map_for_continuous_coltype_is_none ... ignored | |
| test data::test::codebook_with_all_types_inferse_correct_types_csv ... ignored | |
| test data::test::inference::bool_data_is_categorical ... ignored | |
| test data::test::inference::count_or_cts_i16 ... ignored | |
| test data::test::inference::count_or_cts_i16_neg ... ignored | |
| test data::test::inference::count_or_cts_i16_neg_small ... ignored | |
| test data::test::inference::count_or_cts_i32 ... ignored | |
| test data::test::inference::count_or_cts_i32_neg ... ignored | |
| test data::test::inference::count_or_cts_i32_neg_small ... ignored | |
| test data::test::inference::count_or_cts_i64 ... ignored | |
| test data::test::inference::count_or_cts_i64_neg ... ignored | |
| test data::test::inference::count_or_cts_i64_neg_small ... ignored | |
| test data::test::inference::count_or_cts_u16 ... ignored | |
| test data::test::inference::count_or_cts_u32 ... ignored | |
| test data::test::inference::count_or_cts_u64 ... ignored | |
| test data::test::inference::exactly_255_string_values_ok ... ignored | |
| test data::test::inference::fewer_than_255_string_values_ok ... ignored | |
| test data::test::inference::greater_than_256_string_values_errors ... ignored | |
| test data::test::inference::i16_1 ... ignored | |
| test data::test::inference::i16_2 ... ignored | |
| test data::test::inference::i16_3 ... ignored | |
| test data::test::inference::i16_4 ... ignored | |
| test data::test::inference::i32_1 ... ignored | |
| test data::test::inference::i32_2 ... ignored | |
| test data::test::inference::i32_3 ... ignored | |
| test data::test::inference::i32_4 ... ignored | |
| test data::test::inference::i64_1 ... ignored | |
| test data::test::inference::i64_2 ... ignored | |
| test data::test::inference::i64_3 ... ignored | |
| test data::test::inference::i64_4 ... ignored | |
| test data::test::inference::i8_1 ... ignored | |
| test data::test::inference::i8_2 ... ignored | |
| test data::test::inference::i8_3 ... ignored | |
| test data::test::inference::i8_4 ... ignored | |
| test data::test::inference::u16_1 ... ignored | |
| test data::test::inference::u16_2 ... ignored | |
| test data::test::inference::u32_1 ... ignored | |
| test data::test::inference::u32_2 ... ignored | |
| test data::test::inference::u64_1 ... ignored | |
| test data::test::inference::u64_2 ... ignored | |
| test data::test::inference::u8_1 ... ignored | |
| test data::test::inference::u8_2 ... ignored | |
| test data::test::string_col_value_map_should_be_sorted_no_null ... ignored | |
| test data::test::string_col_value_map_should_be_sorted_null ... ignored | |
| test value_map::tests::expected_valuemap_bool_iterator ... ignored | |
| test value_map::tests::expected_valuemap_string_iterator ... ignored | |
| test value_map::tests::expected_valuemap_u8_iterator ... ignored | |
| test result: ok. 0 passed; 0 failed; 63 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_consts-68ee503d4564873c) | |
| running 0 tests | |
| test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_data-8fa56e234eedbb5a) | |
| running 67 tests | |
| test data_store::tests::gets_missing_categorical_data ... ignored | |
| test data_store::tests::gets_missing_continuous_data ... ignored | |
| test data_store::tests::gets_present_categorical_data ... ignored | |
| test data_store::tests::gets_present_continuous_data ... ignored | |
| test datum::tests::categorical_datum_try_into_f64_panics - should panic ... ignored | |
| test datum::tests::categorical_datum_try_into_u8 ... ignored | |
| test datum::tests::continuous_datum_try_into_f64 ... ignored | |
| test datum::tests::continuous_datum_try_into_u8_panics - should panic ... ignored | |
| test datum::tests::count_data_into_f64 ... ignored | |
| test datum::tests::count_data_try_into_u32 ... ignored | |
| test datum::tests::count_data_try_into_u8_fails - should panic ... ignored | |
| test datum::tests::missing_datum_try_into_f64_panics - should panic ... ignored | |
| test datum::tests::missing_datum_try_into_u8_panics - should panic ... ignored | |
| test datum::tests::serde_categorical_bool ... ignored | |
| test datum::tests::serde_categorical_string ... ignored | |
| test datum::tests::serde_categorical_u8 ... ignored | |
| test datum::tests::serde_continuous ... ignored | |
| test datum::tests::serde_count ... ignored | |
| test datum::tests::serde_missing ... ignored | |
| test feature::tests::gets_missing_categorical_data ... ignored | |
| test feature::tests::gets_missing_continuous_data ... ignored | |
| test feature::tests::gets_present_categorical_data ... ignored | |
| test feature::tests::gets_present_continuous_data ... ignored | |
| test feature::tests::summarize_categorical_works_one_mode ... ignored | |
| test feature::tests::summarize_categorical_works_two_modes ... ignored | |
| test feature::tests::summarize_categorical_works_with_fixture ... ignored | |
| test feature::tests::summarize_continuous_works_with_fixture ... ignored | |
| test feature::tests::summarize_continuous_works_with_odd_number_data ... ignored | |
| test sparse::test::break_slices_dense ... ignored | |
| test sparse::test::break_slices_dense_large ... ignored | |
| test sparse::test::break_slices_dense_quad ... ignored | |
| test sparse::test::defragment_to_dense ... ignored | |
| test sparse::test::extract_first_from_dense ... ignored | |
| test sparse::test::extract_from_dense ... ignored | |
| test sparse::test::extract_from_sparse ... ignored | |
| test sparse::test::extract_from_sparse_matching_slice_index ... ignored | |
| test sparse::test::extract_last_from_dense ... ignored | |
| test sparse::test::get ... ignored | |
| test sparse::test::get_from_all_missing_is_none ... ignored | |
| test sparse::test::get_oob_panics - should panic ... ignored | |
| test sparse::test::insert_0 ... ignored | |
| test sparse::test::insert_1 ... ignored | |
| test sparse::test::insert_2 ... ignored | |
| test sparse::test::insert_join ... ignored | |
| test sparse::test::insert_oob ... ignored | |
| test sparse::test::pop_front_1_dense ... ignored | |
| test sparse::test::pop_front_1_sparse_first_empty ... ignored | |
| test sparse::test::pop_front_1_sparse_first_occupied ... ignored | |
| test sparse::test::pop_front_2_dense ... ignored | |
| test sparse::test::pop_front_all_then_push_some ... ignored | |
| test sparse::test::pop_front_multiple_sparse ... ignored | |
| test sparse::test::pop_front_some_then_get ... ignored | |
| test sparse::test::push_from_nothing_dense ... ignored | |
| test sparse::test::push_from_nothing_sparse ... ignored | |
| test sparse::test::push_start_missing ... ignored | |
| test sparse::test::push_to_from_vec_ctor ... ignored | |
| test sparse::test::remove_0 ... ignored | |
| test sparse::test::remove_2 ... ignored | |
| test sparse::test::remove_3 ... ignored | |
| test sparse::test::remove_4 ... ignored | |
| test sparse::test::set_missing_0 ... ignored | |
| test sparse::test::set_missing_1 ... ignored | |
| test sparse::test::set_missing_2 ... ignored | |
| test sparse::test::set_missing_middle_one ... ignored | |
| test sparse::test::set_missing_middle_two ... ignored | |
| test sparse::test::slices ... ignored | |
| test sparse::test::with_missing ... ignored | |
| test result: ok. 0 passed; 0 failed; 67 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_geweke-72f691761b9f0a87) | |
| running 0 tests | |
| test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_metadata-99d189c8a316f57e) | |
| running 11 tests | |
| test utils::tests::bad_state_file_errs ... ignored | |
| test utils::tests::finds_codebook_in_directory_with_codebook ... ignored | |
| test utils::tests::finds_codebook_in_no_data_dir ... ignored | |
| test utils::tests::finds_correct_ids_in_no_codebook_dir ... ignored | |
| test utils::tests::finds_correct_ids_in_no_data_dir ... ignored | |
| test utils::tests::finds_correct_state_ids ... ignored | |
| test utils::tests::finds_correct_state_ids_with_dir_with_state_extension ... ignored | |
| test utils::tests::finds_data_in_directory_with_data ... ignored | |
| test utils::tests::finds_data_in_no_codebook_dir ... ignored | |
| test utils::tests::finds_no_codebook_in_no_codebook_dir ... ignored | |
| test utils::tests::finds_no_data_in_no_data_dir ... ignored | |
| test result: ok. 0 passed; 0 failed; 11 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_stats-3401b17cc4280474) | |
| running 52 tests | |
| test chi_square::tests::chi_square_should_be_zero_if_freqs_identical ... ignored | |
| test chi_square::tests::chi_square_simple_value_test_1 ... ignored | |
| test chi_square::tests::chi_square_simple_value_test_2 ... ignored | |
| test integrate::tests::bb_log_marginal_importance ... ignored | |
| test integrate::tests::bb_log_marginal_mh ... ignored | |
| test ks::tests::empirical_cdf_when_xs_all_same_value ... ignored | |
| test ks::tests::empirical_cdf_when_xs_and_vals_same_length ... ignored | |
| test ks::tests::ks2sample_stat_should_be_zero_when_samples_are_identical ... ignored | |
| test ks::tests::ks2sample_stat_simple_value_test_1 ... ignored | |
| test ks::tests::ks2sample_stat_simple_value_test_2 ... ignored | |
| test mh::tests::test_mh_importance_beta ... ignored | |
| test mh::tests::test_mh_prior_gaussian ... ignored | |
| test mh::tests::test_mh_prior_uniform ... ignored | |
| test mh::tests::test_mh_slice_gaussian ... ignored | |
| test mh::tests::test_mh_slice_uniform ... ignored | |
| test mh::tests::test_mh_symrw_adaptive_gaussian ... ignored | |
| test mh::tests::test_mh_symrw_adaptive_mv_normal_gamma_known_var ... ignored | |
| test mh::tests::test_mh_symrw_adaptive_mv_normal_gamma_unknown ... ignored | |
| test mh::tests::test_mh_symrw_adaptive_normal_gamma ... ignored | |
| test mh::tests::test_mh_symrw_mv_normal_gamma_known_var ... ignored | |
| test mh::tests::test_symrw_gaussian ... ignored | |
| test mh::tests::test_symrw_uniform ... ignored | |
| test mixture_type::tests::combine ... ignored | |
| test mixture_type::tests::k ... ignored | |
| test perm::tests::l2_norm_f64_value_check ... ignored | |
| test perm::tests::l2_norm_of_identical_f64_should_be_zero ... ignored | |
| test perm::tests::l2_norm_of_identical_vec_f64_should_be_zero ... ignored | |
| test perm::tests::l2_norm_vec_f64_value_check ... ignored | |
| test perm::tests::perm_data_repartition_smoke_test ... ignored | |
| test perm::tests::perm_data_xs_and_ys ... ignored | |
| test perm::tests::uv_gauss_perm_test_should_be_one_if_xs_is_ys ... ignored | |
| test perm::tests::uv_gauss_perm_test_should_be_zero_if_xs_very_different_from_ys ... ignored | |
| test sample_error::tests::ctgrl_pit_for_samples_from_target_should_have_low_error ... ignored | |
| test sample_error::tests::ctgrl_pit_manual_computation ... ignored | |
| test sample_error::tests::empirical_f64_no_repeats ... ignored | |
| test sample_error::tests::empirical_u8_binary ... ignored | |
| test sample_error::tests::gauss_pit_for_samples_from_narrow_should_have_high_error ... ignored | |
| test sample_error::tests::gauss_pit_for_samples_from_target_should_have_low_error ... ignored | |
| test sample_error::tests::gauss_pit_for_samples_from_wide_should_have_high_error ... ignored | |
| test sample_error::tests::unique_ord_f64_all_unique ... ignored | |
| test sample_error::tests::unique_ord_f64_repeats ... ignored | |
| test seq::sobol::tests::find_first_zero_checks ... ignored | |
| test seq::sobol::tests::most_significant_bit_checks ... ignored | |
| test seq::sobol::tests::pi_approx ... ignored | |
| test seq::sobol::tests::sobol_sequence_matches_reference ... ignored | |
| test seq::sobol::tests::sobol_sequence_set_seed ... ignored | |
| test seq::sobol::tests::sobol_sequence_uniform ... ignored | |
| test seq::sobol::tests::two_sin_integral ... ignored | |
| test uncertainty::test::bernoulli_moving_means_away_increases_tvd ... ignored | |
| test uncertainty::test::categorical_moving_means_away_increases_tvd ... ignored | |
| test uncertainty::test::count_moving_means_away_increases_tvd ... ignored | |
| test uncertainty::test::gauss_moving_means_away_increases_tvd ... ignored | |
| test result: ok. 0 passed; 0 failed; 52 ignored; 0 measured; 0 filtered out; finished in 0.00s | |
| Running benches/seq.rs (target/x86_64-unknown-linux-gnu/release/deps/seq-7747957abdb456da) | |
| Benchmarking Halton(2) 1k numbers | |
| Benchmarking Halton(2) 1k numbers: Warming up for 3.0000 s | |
| Benchmarking Halton(2) 1k numbers: Collecting 100 samples in estimated 5.0074 s (1.3M iterations) | |
| Benchmarking Halton(2) 1k numbers: Analyzing | |
| Halton(2) 1k numbers time: [3.7703 µs 3.7759 µs 3.7854 µs] | |
| change: [-0.1609% -0.0951% +0.0097%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Sobol(2) 1k numbers | |
| Benchmarking Sobol(2) 1k numbers: Warming up for 3.0000 s | |
| Benchmarking Sobol(2) 1k numbers: Collecting 100 samples in estimated 5.0354 s (187k iterations) | |
| Benchmarking Sobol(2) 1k numbers: Analyzing | |
| Sobol(2) 1k numbers time: [26.944 µs 26.945 µs 26.947 µs] | |
| change: [+5.7334% +5.7634% +5.7901%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking Seq compare/Halton/10 | |
| Benchmarking Seq compare/Halton/10: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Halton/10: Collecting 100 samples in estimated 5.0000 s (51M iterations) | |
| Benchmarking Seq compare/Halton/10: Analyzing | |
| Seq compare/Halton/10 time: [97.206 ns 97.248 ns 97.293 ns] | |
| change: [-0.1225% +0.1388% +0.2960%] (p = 0.27 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Seq compare/Sobol/10 | |
| Benchmarking Seq compare/Sobol/10: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Sobol/10: Collecting 100 samples in estimated 5.0036 s (6.8M iterations) | |
| Benchmarking Seq compare/Sobol/10: Analyzing | |
| Seq compare/Sobol/10 time: [733.33 ns 733.46 ns 733.60 ns] | |
| change: [+6.1278% +6.1503% +6.1785%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Seq compare/Halton/1000 | |
| Benchmarking Seq compare/Halton/1000: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Halton/1000: Collecting 100 samples in estimated 5.0082 s (1.3M iterations) | |
| Benchmarking Seq compare/Halton/1000: Analyzing | |
| Seq compare/Halton/1000 time: [3.9348 µs 3.9353 µs 3.9358 µs] | |
| change: [+0.3710% +0.6110% +0.7890%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| Benchmarking Seq compare/Sobol/1000 | |
| Benchmarking Seq compare/Sobol/1000: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Sobol/1000: Collecting 100 samples in estimated 5.0249 s (187k iterations) | |
| Benchmarking Seq compare/Sobol/1000: Analyzing | |
| Seq compare/Sobol/1000 time: [26.891 µs 26.893 µs 26.896 µs] | |
| change: [-0.2958% -0.1661% -0.0669%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking Seq compare/Halton/100000 | |
| Benchmarking Seq compare/Halton/100000: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Halton/100000: Collecting 100 samples in estimated 5.8987 s (15k iterations) | |
| Benchmarking Seq compare/Halton/100000: Analyzing | |
| Seq compare/Halton/100000 | |
| time: [386.96 µs 387.50 µs 388.19 µs] | |
| change: [-2.0854% -1.9823% -1.8357%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking Seq compare/Sobol/100000 | |
| Benchmarking Seq compare/Sobol/100000: Warming up for 3.0000 s | |
| Benchmarking Seq compare/Sobol/100000: Collecting 100 samples in estimated 5.3366 s (1400 iterations) | |
| Benchmarking Seq compare/Sobol/100000: Analyzing | |
| Seq compare/Sobol/100000 | |
| time: [3.7922 ms 3.7936 ms 3.7951 ms] | |
| change: [-2.2692% -2.0741% -1.9288%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Running benches/simplex.rs (target/x86_64-unknown-linux-gnu/release/deps/simplex-4570313ce9a6833d) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/3 | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Collecting 100 samples in estimated 5.0000 s (57M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/3: Analyzing | |
| Sobol to 3-simplex over NDims/new alloc/3 | |
| time: [25.732 ns 25.742 ns 25.755 ns] | |
| change: [+8.0432% +8.1253% +8.2069%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/3 | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Collecting 100 samples in estimated 5.0000 s (67M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/3: Analyzing | |
| Sobol to 3-simplex over NDims/update inplace/3 | |
| time: [14.476 ns 14.484 ns 14.491 ns] | |
| change: [+5.5682% +5.9304% +6.1725%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/5 | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Collecting 100 samples in estimated 5.0001 s (48M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/5: Analyzing | |
| Sobol to 3-simplex over NDims/new alloc/5 | |
| time: [37.461 ns 37.539 ns 37.608 ns] | |
| change: [+4.6417% +4.8819% +5.1450%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/5 | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Collecting 100 samples in estimated 5.0001 s (59M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/5: Analyzing | |
| Sobol to 3-simplex over NDims/update inplace/5 | |
| time: [23.394 ns 23.412 ns 23.432 ns] | |
| change: [+26.161% +26.563% +26.856%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/10 | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Collecting 100 samples in estimated 5.0005 s (23M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/10: Analyzing | |
| Sobol to 3-simplex over NDims/new alloc/10 | |
| time: [140.20 ns 140.27 ns 140.35 ns] | |
| change: [+8.0268% +8.1762% +8.3122%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/10 | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Collecting 100 samples in estimated 5.0006 s (24M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/10: Analyzing | |
| Sobol to 3-simplex over NDims/update inplace/10 | |
| time: [113.73 ns 113.81 ns 113.91 ns] | |
| change: [+4.9949% +5.1239% +5.2547%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/20 | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Collecting 100 samples in estimated 5.0026 s (9.6M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/20: Analyzing | |
| Sobol to 3-simplex over NDims/new alloc/20 | |
| time: [414.34 ns 414.37 ns 414.41 ns] | |
| change: [+8.0905% +8.2408% +8.3620%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/20 | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Collecting 100 samples in estimated 5.0017 s (12M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/20: Analyzing | |
| Sobol to 3-simplex over NDims/update inplace/20 | |
| time: [302.91 ns 303.49 ns 304.22 ns] | |
| change: [+9.2054% +9.3907% +9.6283%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/30 | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Collecting 100 samples in estimated 5.0006 s (6.0M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/new alloc/30: Analyzing | |
| Sobol to 3-simplex over NDims/new alloc/30 | |
| time: [693.42 ns 693.50 ns 693.58 ns] | |
| change: [+6.5551% +6.6022% +6.6469%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/30 | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Warming up for 3.0000 s | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Collecting 100 samples in estimated 5.0031 s (6.6M iterations) | |
| Benchmarking Sobol to 3-simplex over NDims/update inplace/30: Analyzing | |
| Sobol to 3-simplex over NDims/update inplace/30 | |
| time: [629.78 ns 629.85 ns 629.94 ns] | |
| change: [+6.8511% +6.8963% +6.9394%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high severe | |
| Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/lace_utils-93cc6a6439fb6062) | |
| running 62 tests | |
| test misc::tests::argmax_should_panic_given_empty_container - should panic ... ignored | |
| test misc::tests::argmax_should_return_0_if_max_value_is_in_0_index ... ignored | |
| test misc::tests::argmax_should_return_index_of_first_max_value_if_repeats ... ignored | |
| test misc::tests::argmax_should_return_last_index_if_max_value_is_last ... ignored | |
| test misc::tests::argmax_should_work_on_unique_values ... ignored | |
| test misc::tests::argmin_normal ... ignored | |
| test misc::tests::argmin_should_panic_given_empty_container - should panic ... ignored | |
| test misc::tests::argmin_should_return_0_if_min_value_is_in_0_index ... ignored | |
| test misc::tests::argmin_should_return_index_of_first_min_value_if_repeats ... ignored | |
| test misc::tests::argmin_should_return_last_index_if_min_value_is_last ... ignored | |
| test misc::tests::bincount_should_count_occupied ... ignored | |
| test misc::tests::bincount_should_count_with_zeros ... ignored | |
| test misc::tests::cumsum_should_return_empty_if_given_empty ... ignored | |
| test misc::tests::cumsum_should_work_do_nothing_to_one_length_vector ... ignored | |
| test misc::tests::cumsum_should_work_on_f64 ... ignored | |
| test misc::tests::cumsum_should_work_on_u16 ... ignored | |
| test misc::tests::cumsum_should_work_on_u8 ... ignored | |
| test misc::tests::is_index_col_tests ... ignored | |
| test misc::tests::minmax_on_repeated ... ignored | |
| test misc::tests::minmax_on_reverse_unique_slice ... ignored | |
| test misc::tests::minmax_on_sorted_unique_slice ... ignored | |
| test misc::tests::minmax_should_copy_the_entry_for_a_single_element_slice ... ignored | |
| test misc::tests::minmax_should_sort_two_element_slice_1 ... ignored | |
| test misc::tests::minmax_should_sort_two_element_slice_2 ... ignored | |
| test misc::tests::nan_sign_is_nan ... ignored | |
| test misc::tests::neg_sign_is_neg ... ignored | |
| test misc::tests::parse_empty_is_none ... ignored | |
| test misc::tests::parse_result_f64 ... ignored | |
| test misc::tests::parse_result_u8 ... ignored | |
| test misc::tests::parse_result_u8_too_large_fail - should panic ... ignored | |
| test misc::tests::pos_sign_is_pos ... ignored | |
| test misc::tests::small_neg_sign_is_neg ... ignored | |
| test misc::tests::small_pos_sign_is_pos ... ignored | |
| test misc::tests::tanspose_mapvec ... ignored | |
| test misc::tests::transpose_rect ... ignored | |
| test misc::tests::transpose_square ... ignored | |
| test misc::tests::unused_components_none_unused_should_return_empty ... ignored | |
| test misc::tests::unused_components_should_return_unused_indices_in_descending_order ... ignored | |
| test misc::tests::zero_sign_is_zero ... ignored | |
| test numbers::tests::bell_n ... ignored | |
| test numbers::tests::binom_nk ... ignored | |
| test numbers::tests::ccnum_1_1 ... ignored | |
| test numbers::tests::ccnum_1_2 ... ignored | |
| test numbers::tests::ccnum_2_1 ... ignored | |
| test numbers::tests::ccnums ... ignored | |
| test numbers::tests::factorial_0_should_be_1 ... ignored | |
| test numbers::tests::factorial_11 ... ignored | |
| test numbers::tests::factorial_1_should_be_1 ... ignored | |
| test numbers::tests::factorial_2_should_be_2 ... ignored | |
| test numbers::tests::stirling_nk ... ignored | |
| test quad::tests::quadp_of_sin ... ignored | |
| test quad::tests::quadp_of_x2 ... ignored | |
| test random::tests::choose2ixs_should_return_different_ixs ... ignored | |
| test stats::tests::mean_1 ... ignored | |
| test stats::tests::mean_2 ... ignored | |
| test stats::tests::std_1 ... ignored | |
| test stats::tests::std_2 ... ignored | |
| test stats::tests::var_1 ... ignored | |
| test stats::tests::var_2 ... ignored | |
| test tests::cartprod_dual ... ignored | |
| test tests::cartprod_single ... ignored | |
| test tests::cartprod_triple ... ignored | |
| test result: ok. 0 passed; 0 failed; 62 ignored; 0 measured; 0 filtered out; finished in 0.00s |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment