Skip to content

Instantly share code, notes, and snippets.

View cbuescher's full-sized avatar
💭
Ding Dong Toller Tom.

Christoph Büscher cbuescher

💭
Ding Dong Toller Tom.
  • Berlin
View GitHub Profile
@cbuescher
cbuescher / gist:28560388ddb35d598c7e07de19034512
Last active July 14, 2020 17:10
Some things to try with new version field
DELETE test
PUT /test
{
"mappings": {
"properties": {
"semVer" : {
"type" : "version"
}
}
@cbuescher
cbuescher / 00_Simple example
Last active January 21, 2021 16:53
Retrieving nested fields with fields API
# Retrieving nested fields with "fields API"
# simple example
DELETE my_index
PUT my_index
{
"mappings": {
"properties": {
"obj": {
DELETE my_index
PUT my_index
{
"mappings": {
"properties": {
"user": {
"type": "nested",
"properties": {
"name" : {
@cbuescher
cbuescher / gist:92da030e869065d31504bea27e26c719
Last active October 20, 2021 15:25
Aggregation on _ignored field using runtime mappings
DELETE test*
PUT test
{
"mappings": {
"properties": {
"f1" : {
"type" : "keyword",
"ignore_above": 5
},
DELETE test
PUT /test
{
"settings": {
"index": {
"analysis": {
"analyzer": {
"synonym": {
"tokenizer": "standard",
@cbuescher
cbuescher / gist:eb5e6903d7d1d49c81414d8b15a824cc
Last active December 6, 2023 10:45
Esbench elastic/logs concurrent vs. non-concurrent
Baseline: without concurrency (worker_threads_enabled: false)
Contender: with concurrency enabled (worker_threads_enabled: true)
./rally --skip-update compare --baseline 9082e0c5-59db-4d99-ad9a-92cdd74f6340 --contender ea836fe1-900c-4a83-bb56-be9edd5cc87c --report-file="compare_concurrency_experiments.md"
@cbuescher
cbuescher / compare_discosearch.md
Created December 7, 2023 12:44
Rally compare results
Metric Task Baseline Contender Diff Unit Diff %
Cumulative indexing time of primary shards 36.3556 35.7109 -0.64477 min -1.77%
Min cumulative indexing time across primary shard 0.273017 0.273467 0.00045 min +0.16%
Median cumulative indexing time across primary shard 1.01327 1.0024 -0.01087 min -1.07%
Max cumulative indexing time across primary shard 17.4919 16.898
@cbuescher
cbuescher / params-concurrent.json
Last active December 11, 2023 16:50
Concurrency stress test parameters
{
"loaddriver.instance.name": "gcp::n2_standard-32-128-16x1500GiB_nvme_local",
"elasticsearch.instance.name": "gcp::n2d_standard-16-68-4x375GiB_nvme_local",
"elasticsearch.remote.repo.url": "https://github.com/cbuescher/elasticsearch.git",
"elasticsearch.remote.repo.revision": "add-slice-logging-8-12",
"elasticsearch.architecture": {
"node": {
"count": 1,
"instance.name": "gcp::n2d_standard-16-68-4x375GiB_nvme_local",
"heap.size": "30g",
@cbuescher
cbuescher / Different_client_numbers.md
Last active December 12, 2023 10:25
Full data runs 11.12.23

Full data size runs

search_clients: 10

Amrum:~/workspace/elasticsearch-benchmarks [master|…2]$ esbench info --env-id=442d0b7f-214b-44d9-bd90-e11003b6670b

Environment id:

442d0b7f-214b-44d9-bd90-e11003b6670b

elasticsearch (default)