Skip to content

chore: testing new scenario#344

Closed
cheb0 wants to merge 1 commit intomainfrom
0-testing-logbench
Closed

chore: testing new scenario#344
cheb0 wants to merge 1 commit intomainfrom
0-testing-logbench

Conversation

@cheb0
Copy link
Member

@cheb0 cheb0 commented Feb 6, 2026

Description


  • I have read and followed all requirements in CONTRIBUTING.md;
  • I used LLM/AI assistance to make this pull request;

@cheb0 cheb0 marked this pull request as draft February 6, 2026 12:19
@cheb0
Copy link
Member Author

cheb0 commented Feb 6, 2026

@seqbenchbot up main search-logbench

@seqbenchbot
Copy link

seqbenchbot commented Feb 6, 2026

Oh-oh, @cheb0 ('>o.o)'>!

Something went wrong and I couldn't process your request.
Please take a closer look at error message:

<scenario> must be one of "bulk","mixed","search-keyword-exact-match","search-keyword-exact-match-cold" but got "search-logbench"

@github-actions
Copy link
Contributor

github-actions bot commented Feb 6, 2026

🔴 Performance Degradation

Some benchmarks have degraded compared to the previous run.
Click on Show table button to see full list of degraded benchmarks.

Show table
Name Previous Current Ratio Verdict
FindSequence_Random/large-4 6ae568 ab7fa0
12778.42 MB/s 11597.78 MB/s 0.91 🔴
FindSequence_Random/medium-4 6ae568 ab7fa0
13517.73 MB/s 11160.30 MB/s 0.83 🔴
75.75 ns/op 91.75 ns/op 1.21 🔴

@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.49%. Comparing base (77fae2c) to head (7f4ef51).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #344      +/-   ##
==========================================
- Coverage   71.59%   71.49%   -0.11%     
==========================================
  Files         204      204              
  Lines       14770    14857      +87     
==========================================
+ Hits        10575    10622      +47     
- Misses       3441     3471      +30     
- Partials      754      764      +10     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@cheb0
Copy link
Member Author

cheb0 commented Feb 6, 2026

@seqbenchbot up main search-logbench

@seqbenchbot
Copy link

seqbenchbot commented Feb 6, 2026

Nice, @cheb0 <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - ebd021aa.

Here is a list of helpful links:

Have a great time!

@seqbenchbot
Copy link

Nice, @cheb0 <(-^,^-)=b!

The benchmark with identificator ebd021aa was finished.

Take a look at the benchmark report:

Query Type Baseline avg (µs) Comparison avg (µs) Diff % Baseline fetched Comparison fetched
service:payment-backend-us cold 55038 ± 11180 54255 ± 7572 -1.4% 100 100
service:payment-backend-us warm 3919 ± 514 3909 ± 540 -0.3% 100 100
service:payment-backend-us AND level:[0 to 3] cold 290964 ± 29890 403859 ± 92535 38.8% 100 100
service:payment-backend-us AND level:[0 to 3] warm 8228 ± 651 8503 ± 695 3.3% 100 100
find errors + filter out cold 595476 ± 39564 602537 ± 126514 1.2% 100 100
find errors + filter out warm 19038 ± 1217 19454 ± 585 2.2% 100 100
find service logs + filter out more cold 115524 ± 3906 125535 ± 11994 8.7% 100 100
find service logs + filter out more warm 4533 ± 345 4581 ± 293 1.1% 100 100
find errors (not found) cold 0 ± 0 0 ± 0 0 0
find errors (not found) warm 0 ± 0 0 ± 0 0 0
k8s_pod:payment-backend-us-* AND transaction_id:'tx-needle00-0000' cold 482815 ± 39785 472267 ± 55057 -2.2% 27 27
k8s_pod:payment-backend-us-* AND transaction_id:'tx-needle00-0000' warm 12410 ± 788 12445 ± 1330 0.3% 27 27
k8s_pod:payment-backend-us-* AND transaction_id:'tx-needle99-0000' cold 373266 ± 69871 346463 ± 67356 -7.2% 0 0
k8s_pod:payment-backend-us-* AND transaction_id:'tx-needle99-0000' warm 3254 ± 379 3090 ± 368 -5.0% 0 0
k8s_pod:payment-backend-us-* AND transaction_id:'needle' cold 684219 ± 64934 702664 ± 119080 2.7% 100 100
k8s_pod:payment-backend-us-* AND transaction_id:'needle' warm 33872 ± 3136 33882 ± 2782 0.0% 100 100
service:api-gateway-us AND resource:'/assets/css/bootstrap.css' AND method:'GET' AND status:200 AND size:[990 TO *] cold 914036 ± 136980 879213 ± 154560 -3.8% 44 44
service:api-gateway-us AND resource:'/assets/css/bootstrap.css' AND method:'GET' AND status:200 AND size:[990 TO *] warm 27915 ± 3466 28198 ± 3059 1.0% 44 44
service:*, hist 10s cold 2727094 ± 354078 2610771 ± 146990 -4.3% 100 100
service:*, hist 10s warm 469291 ± 37226 474932 ± 52153 1.2% 100 100
k8s_namespace:prod AND level:[0 to 3], hist 10s cold 2338192 ± 216849 2360383 ± 161680 0.9% 100 100
k8s_namespace:prod AND level:[0 to 3], hist 10s warm 106390 ± 18437 104367 ± 18048 -1.9% 100 100
service:payment-backend-eu, 10s cold 2173579 ± 212120 2180500 ± 385745 0.3% 100 100
service:payment-backend-eu, 10s warm 85809 ± 14234 85785 ± 12876 -0.0% 100 100
service:payment-backend-eu AND level:[0 to 3], hist 10s cold 707702 ± 103403 671106 ± 77290 -5.2% 100 100
service:payment-backend-eu AND level:[0 to 3], hist 10s warm 14932 ± 1379 15749 ± 6719 5.5% 100 100
service:payment-backend-eu, group by k8s_pod count(*) cold 1071320 ± 45072 1065506 ± 67026 -0.5% 100 100
service:payment-backend-eu, group by k8s_pod count(*) warm 461933 ± 29026 468526 ± 32396 1.4% 100 100
service:payment-backend-eu, group by (10s) k8s_pod count(*) cold 2983625 ± 222635 2868378 ± 246063 -3.9% 100 100
service:payment-backend-eu, group by (10s) k8s_pod count(*) warm 528298 ± 36801 539372 ± 43302 2.1% 100 100
service:payment-backend-eu, group by k8s_pod min(level) cold 1324277 ± 66419 1283361 ± 42055 -3.1% 100 100
service:payment-backend-eu, group by k8s_pod min(level) warm 614497 ± 42804 608823 ± 41172 -0.9% 100 100
service:payment-backend-eu, group by (10s) k8s_pod min(level) cold 3180712 ± 177532 3038349 ± 223036 -4.5% 100 100
service:payment-backend-eu, group by (10s) k8s_pod min(level) warm 671932 ± 44827 681484 ± 42007 1.4% 100 100
service:api-gateway-us, group by method avg(size) cold 1029241 ± 79566 1072327 ± 99882 4.2% 100 100
service:api-gateway-us, group by method avg(size) warm 355893 ± 22565 385628 ± 33301 8.4% 100 100
service:api-gateway-us AND resource:'/api/v1/audit/' AND status:404, group by client_ip count() cold 1804307 ± 63443 1754531 ± 128217 -2.8% 100 100
service:api-gateway-us AND resource:'/api/v1/audit/' AND status:404, group by client_ip count() warm 931058 ± 29956 951346 ± 34735 2.2% 100 100

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 9, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

Hey, @dkharms *\ (^_^)!

You request was enqueued and I will process it as soon as possible.
Meanwhile, if you want to learn more about commands I support write following:

@seqbenchbot --help

@dkharms
Copy link
Member

dkharms commented Feb 9, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

seqbenchbot commented Feb 9, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - 5d5ff861.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 9, 2026

@seqbenchbot down 5d5ff861

@seqbenchbot
Copy link

seqbenchbot commented Feb 9, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator 5d5ff861 was finished.

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 10, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

seqbenchbot commented Feb 10, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - 67c985d6.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 10, 2026

@seqbenchbot down 67c985d6

@seqbenchbot
Copy link

seqbenchbot commented Feb 10, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator 67c985d6 was finished.

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - 18f4c3a8.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down 18f4c3a8

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator 18f4c3a8 was finished.

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - b6cf7d0a.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down b6cf7d0a

@seqbenchbot
Copy link

Hey, @dkharms *\ (^_^)!

Your request was enqueued and I will process it as soon as possible.
Meanwhile, if you want to learn more about commands I support write following:

@seqbenchbot --help

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down b6cf7d0a

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator b6cf7d0a was finished.

Take a look at the benchmark report:

Query Type iterations mean (ms) stddev (ms) p(50) (ms) p(95) (ms) p(99) (ms)
base comp diff base comp diff base comp diff base comp diff base comp diff base comp diff
k8s_namespace:*
AND k8s_container:*
warm 1919.00 1912.00 -0.36% 38.15 37.98 -0.45% 13.58 13.59 +0.07% 36.00 36.00 0.00% 63.00 63.50 +0.79% 70.50 70.00 -0.71%

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - eb2d3a33.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down eb2d3a33

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator eb2d3a33 was finished.
I've prepared a summary for you. Click on Show summary button to see it:

Show summary
Query Type iterations mean (ms) stddev (ms) p(50) (ms) p(95) (ms) p(99) (ms)
base comp diff base comp diff base comp diff base comp diff base comp diff base comp diff
k8s_namespace:*
AND k8s_container:*
warm 1337.00 1331.00 -0.45% 40.38 40.54 +0.42% 15.27 15.35 +0.50% 39.00 40.00 +2.56% 66.00 66.00 0.00% 73.00 73.00 0.00%

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-logbench

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - d13995c9.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-logbench

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - 62089d88.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@seqbenchbot
Copy link

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator 62089d88 was finished.
I've prepared a summary for you. Click on Show summary button to see it:

Show summary
Query Type iterations mean (ms) stddev (ms) p(50) (ms) p(95) (ms) p(99) (ms)
base comp diff base comp diff base comp diff base comp diff base comp diff base comp diff
service:payment-backend-us
warm 5.00 5.00 0.00% 4.00 3.60 -10.00% 1.73 0.89 -48.36% 3.00 3.00 0.00% 5.50 4.50 -18.18% 5.50 4.50 -18.18%
service:payment-backend-us
AND level:[0 to 3]
warm 5.00 5.00 0.00% 1.00 1.00 0.00% 0.00 0.00 0.00% 1.00 1.00 0.00% 1.00 1.00 0.00% 1.00 1.00 0.00%
k8s_pod:payment-backend-us-*
AND level:[0 to 3]
AND NOT message:'Health check failed'
AND NOT message:'slow query detected'
warm 5.00 5.00 0.00% 1.00 1.00 0.00% 0.00 0.00 0.00% 1.00 1.00 0.00% 1.00 1.00 0.00% 1.00 1.00 0.00%
service:payment-backend-us
AND NOT message:'Health check failed'
AND NOT message:'slow query detected'
AND NOT message:'Database query executed'
AND NOT message:'API rate limit'
AND NOT message:'Fraud detection'
AND NOT message:'Configuration reload completed'
AND NOT message:'SSL certificate'
warm 5.00 5.00 0.00% 3.80 4.00 +5.26% 0.84 1.00 +19.52% 3.50 3.50 0.00% 4.50 5.00 +11.11% 4.50 5.00 +11.11%
service:payment-backend-us
cold 1.00 1.00 0.00% 56.00 51.00 -8.93% N/A N/A N/A 56.00 51.00 -8.93% 56.00 51.00 -8.93% 56.00 51.00 -8.93%
service:payment-backend-us
AND level:[0 to 3]
cold 1.00 1.00 0.00% 32.00 39.00 +21.88% N/A N/A N/A 32.00 39.00 +21.88% 32.00 39.00 +21.88% 32.00 39.00 +21.88%
k8s_pod:payment-backend-us-*
AND level:[0 to 3]
AND NOT message:'Health check failed'
AND NOT message:'slow query detected'
cold 1.00 1.00 0.00% 53.00 57.00 +7.55% N/A N/A N/A 53.00 57.00 +7.55% 53.00 57.00 +7.55% 53.00 57.00 +7.55%
service:payment-backend-us
AND NOT message:'Health check failed'
AND NOT message:'slow query detected'
AND NOT message:'Database query executed'
AND NOT message:'API rate limit'
AND NOT message:'Fraud detection'
AND NOT message:'Configuration reload completed'
AND NOT message:'SSL certificate'
cold 1.00 1.00 0.00% 123.00 86.00 -30.08% N/A N/A N/A 123.00 86.00 -30.08% 123.00 86.00 -30.08% 123.00 86.00 -30.08%

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match-cold

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - d6c50665.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down d6c50665

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Oh-oh, @dkharms ('>o.o)'>!

Something went wrong and I couldn't process your request.
Please take a closer look at error message:

failed to render report: EOF

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match-cold

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Oh-oh, @dkharms ('>o.o)'>!

Something went wrong and I couldn't process your request.
Please take a closer look at error message:

cannot run several comparison benchmarks concurrently

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down d6c50665

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Oh-oh, @dkharms ('>o.o)'>!

Something went wrong and I couldn't process your request.
Please take a closer look at error message:

failed to render report: EOF

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down d6c50665

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator d6c50665 was finished.
I've prepared a summary for you. Click on Show summary button to see it:

Show summary

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main search-keyword-exact-match-cold

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - bb39497d.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down bb39497d

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator bb39497d was finished.
I've prepared a summary for you. Click on Show summary button to see it:

Show summary
Query Type iterations mean (ms) stddev (ms) p(50) (ms) p(95) (ms) p(99) (ms)
base comp diff base comp diff base comp diff base comp diff base comp diff base comp diff
service:payment-backend-eu
AND k8s_namespace:prod
cold 12.00 12.00 0.00% 209.25 225.92 +7.96% 27.16 37.04 +36.40% 204.00 216.00 +5.88% 256.00 283.00 +10.55% 256.00 283.00 +10.55%

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot up main bulk

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

Your request was successfully served.
Identificator for your ongoing benchmark - b3995e58.

Here is a list of helpful links:

  • Take a look at Grafana dashboard;
  • Live-tailing logs are also available;

Have a great time!

@dkharms
Copy link
Member

dkharms commented Feb 11, 2026

@seqbenchbot down b3995e58

@seqbenchbot
Copy link

seqbenchbot commented Feb 11, 2026

Nice, @dkharms <(-^,^-)=b!

The benchmark with identificator b3995e58 was finished.
I've prepared a summary for you. Click on Show summary button to see it:

Show summary
Query Type iterations mean (ms) stddev (ms) p(50) (ms) p(95) (ms) p(99) (ms)
base comp diff base comp diff base comp diff base comp diff base comp diff base comp diff
bulk
warm 2743.00 2763.00 +0.73% 54.81 53.91 -1.64% 26.04 24.34 -6.53% 46.00 46.00 0.00% 108.00 105.50 -2.31% 141.00 135.00 -4.26%

Have a great time!

@cheb0 cheb0 closed this Feb 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants