Skip to content

Instantly share code, notes, and snippets.

View js8544's full-sized avatar

Jin Shang js8544

43 followers · 28 following
View GitHub Profile
@js8544
js8544 / index_in_benchmark.md
Created October 24, 2023 09:58
swiss_table_index_in_proof_of_concept

Before

image

After

image

@js8544
js8544 / pr38394.txt
Created October 23, 2023 07:02
ARROW PR 38394: Dictionary ChunkedArray hash kernels optimization benchmark
### Before
-----------------------------------------------------------------------------------------
Benchmark Time CPU Iterations UserCounters...
-----------------------------------------------------------------------------------------
ValueCountsDictionaryChunks/0 8112938 ns 8112013 ns 87 bytes_per_second=4.81539Gi/s items_per_second=517.048M/s null_percent=0 num_unique=100
ValueCountsDictionaryChunks/1 8563428 ns 8563225 ns 82 bytes_per_second=4.56166Gi/s items_per_second=489.804M/s null_percent=0.1 num_unique=100
ValueCountsDictionaryChunks/2 9591335 ns 9590370 ns 72 bytes_per_second=4.0731Gi/s items_per_second=437.345M/s null_percent=1 num_unique=100
ValueCountsDictionaryChunks/3 12068706 ns 12066611 ns 55 bytes_per_second=3.23724Gi/s items_per_second=347.596M/s null_percent=10 num_unique=100
ValueCountsDictionaryChunks/4 22068866 ns 22068960 ns 32 bytes_per_second=1.7700
@js8544
js8544 / ARROW-18185-benchmark.log
Created October 28, 2022 03:59
ARROW-18185-benchmark
----------------------------------------------------------------------------------------------------
Benchmark Time CPU Iterations UserCounters...
----------------------------------------------------------------------------------------------------
FilterInt64FilterNoNulls/262144/0/0 73795 ns 73864 ns 9581 bytes_per_second=3.30528G/s data null%=0 mask null%=0 option=0 select%=99.9 size=262.144k
FilterInt64FilterNoNulls/262144/0/1 71842 ns 71910 ns 9643 bytes_per_second=3.39507G/s data null%=0 mask null%=0 option=1 select%=99.9 size=262.144k
FilterInt64FilterNoNulls/262144/0/2 42188 ns 42223 ns 16538 bytes_per_second=5.78212G/s data null%=0 mask null%=0 option=2 select%=99.9 size=262.144k
FilterInt64FilterNoNulls/262144/1/0 375322 ns 375612 ns 1831 bytes_per_second=665.58M/s data null%=0 mask null%=0 option=0 select%=50 size=262.144k
FilterInt64FilterNoNulls
@js8544
js8544 / benchmark.cc
Created August 26, 2022 15:01
#include <cstdint>
#include <iostream>
#include <memory>
#include <numeric>
#include <vector>
#include "arrow/api.h"
#include "arrow/compute/api.h"
#define ANKERL_NANOBENCH_IMPLEMENT
#include "nanobench.h"