Skip to content

Conversation

@paullegranddc
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Nov 20, 2025

Benchmarks

Comparison

Benchmark execution time: 2026-01-14 13:58:55

Comparing candidate commit ff3e2d5 in PR branch paullgdc/data-pipeline/runtime_agnostisc_code with baseline commit 65a5d9a in branch main.

Found 4 performance improvements and 12 performance regressions! Performance is the same for 39 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟩 execution_time [-3.671µs; -3.398µs] or [-4.475%; -4.143%]
  • 🟩 throughput [+528093.240op/s; +570982.224op/s] or [+4.332%; +4.684%]

scenario:credit_card/is_card_number/378282246310005

  • 🟩 execution_time [-3.268µs; -3.085µs] or [-4.536%; -4.283%]
  • 🟩 throughput [+622402.184op/s; +660662.174op/s] or [+4.484%; +4.759%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+537.349ns; +551.022ns] or [+9.119%; +9.351%]
  • 🟥 throughput [-14555481.265op/s; -14162934.362op/s] or [-8.576%; -8.345%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+524.452ns; +539.557ns] or [+8.877%; +9.132%]
  • 🟥 throughput [-14211037.602op/s; -13780202.192op/s] or [-8.395%; -8.141%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟥 execution_time [+19.481µs; +19.610µs] or [+10.428%; +10.497%]
  • 🟥 throughput [-508697.126op/s; -505312.392op/s] or [-9.503%; -9.440%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟥 execution_time [+714.042ns; +732.738ns] or [+7.023%; +7.207%]
  • 🟥 throughput [-6611831.265op/s; -6451003.260op/s] or [-6.722%; -6.558%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟥 execution_time [+38.421µs; +38.590µs] or [+7.744%; +7.778%]
  • 🟥 throughput [-145499.669op/s; -144844.676op/s] or [-7.219%; -7.186%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟥 execution_time [+26.467µs; +26.590µs] or [+15.569%; +15.641%]
  • 🟥 throughput [-795847.400op/s; -792246.806op/s] or [-13.529%; -13.468%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.707µs 534.627µs ± 0.348µs 534.601µs ± 0.251µs 534.859µs 535.215µs 535.392µs 535.521µs 0.17% 0.121 -0.436 0.06% 0.025µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1867341.634op/s 1870464.024op/s ± 1217.935op/s 1870553.515op/s ± 879.580op/s 1871423.775op/s 1872286.307op/s 1873175.331op/s 1873688.487op/s 0.17% -0.118 -0.436 0.06% 86.121op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.137µs 380.945µs ± 0.375µs 380.928µs ± 0.230µs 381.169µs 381.501µs 381.754µs 383.410µs 0.65% 1.419 8.259 0.10% 0.026µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2608172.539op/s 2625054.745op/s ± 2577.280op/s 2625169.359op/s ± 1583.792op/s 2626584.755op/s 2628838.218op/s 2630168.918op/s 2630630.837op/s 0.21% -1.395 8.083 0.10% 182.241op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.875µs 196.527µs ± 0.340µs 196.517µs ± 0.139µs 196.644µs 196.811µs 196.955µs 200.415µs 1.98% 7.479 84.239 0.17% 0.024µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 4989643.863op/s 5088372.899op/s ± 8679.570op/s 5088626.805op/s ± 3613.431op/s 5092286.128op/s 5097684.822op/s 5100562.147op/s 5105285.085op/s 0.33% -7.323 81.938 0.17% 613.738op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.684µs 36.922µs ± 0.090µs 36.923µs ± 0.059µs 36.978µs 37.072µs 37.174µs 37.177µs 0.69% 0.120 0.113 0.24% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26898107.155op/s 27084467.488op/s ± 66315.226op/s 27083246.895op/s ± 42924.200op/s 27127663.467op/s 27194340.596op/s 27229263.657op/s 27259680.951op/s 0.65% -0.104 0.103 0.24% 4689.195op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.950µs 45.077µs ± 0.060µs 45.076µs ± 0.044µs 45.119µs 45.181µs 45.215µs 45.275µs 0.44% 0.377 0.059 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22087286.135op/s 22184081.872op/s ± 29742.997op/s 22184911.721op/s ± 21836.147op/s 22207657.308op/s 22230040.049op/s 22236756.516op/s 22246988.432op/s 0.28% -0.370 0.045 0.13% 2103.147op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.579µs; 534.675µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1870295.230op/s; 1870632.818op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.893µs; 380.997µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2624697.559op/s; 2625411.931op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [196.480µs; 196.574µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5087169.994op/s; 5089575.804op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.909µs; 36.934µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27075276.836op/s; 27093658.141op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.069µs; 45.086µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22179959.779op/s; 22188203.966op/s] or [-0.019%; +0.019%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.800ms 14.857ms ± 0.032ms 14.850ms ± 0.014ms 14.866ms 14.918ms 14.982ms 15.039ms 1.27% 2.527 8.613 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.853ms; 14.862ms] or [-0.030%; +0.030%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.988µs 34.642µs ± 1.090µs 34.155µs ± 0.047µs 34.213µs 36.993µs 37.037µs 37.642µs 10.21% 1.708 0.955 3.14% 0.077µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.491µs; 34.793µs] or [-0.436%; +0.436%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.017µs 5.082µs ± 0.037µs 5.083µs ± 0.032µs 5.116µs 5.131µs 5.137µs 5.138µs 1.07% -0.214 -1.248 0.72% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.077µs; 5.088µs] or [-0.100%; +0.100%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.932µs 206.360µs ± 0.325µs 206.327µs ± 0.125µs 206.444µs 206.708µs 206.895µs 209.991µs 1.78% 7.074 75.733 0.16% 0.023µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4762099.659op/s 4845911.650op/s ± 7558.564op/s 4846664.313op/s ± 2932.011op/s 4849630.807op/s 4852620.569op/s 4855284.722op/s 4855977.610op/s 0.19% -6.944 73.789 0.16% 534.471op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.189µs 18.303µs ± 0.086µs 18.279µs ± 0.029µs 18.311µs 18.497µs 18.521µs 18.554µs 1.50% 1.253 0.770 0.47% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53895659.814op/s 54638077.971op/s ± 256028.838op/s 54706632.267op/s ± 87432.430op/s 54790124.475op/s 54966734.040op/s 54974779.858op/s 54977013.602op/s 0.49% -1.236 0.735 0.47% 18103.973op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.685µs 10.890µs ± 0.063µs 10.893µs ± 0.040µs 10.935µs 10.982µs 11.033µs 11.062µs 1.55% -0.224 0.075 0.58% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 90399943.257op/s 91831370.215op/s ± 533745.243op/s 91803663.132op/s ± 339338.584op/s 92140944.459op/s 92767572.469op/s 92969225.374op/s 93586987.665op/s 1.94% 0.259 0.102 0.58% 37741.488op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.315µs; 206.405µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4844864.106op/s; 4846959.195op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.291µs; 18.315µs] or [-0.065%; +0.065%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54602594.837op/s; 54673561.106op/s] or [-0.065%; +0.065%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.881µs; 10.899µs] or [-0.080%; +0.080%] None None None
normalization/normalize_name/normalize_name/good throughput [91757398.258op/s; 91905342.172op/s] or [-0.081%; +0.081%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.621µs 161.709µs ± 0.669µs 161.632µs ± 0.151µs 161.813µs 162.128µs 162.441µs 170.400µs 5.42% 11.047 141.195 0.41% 0.047µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.617µs; 161.802µs] or [-0.057%; +0.057%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.107ms 6.378ms ± 0.073ms 6.395ms ± 0.018ms 6.410ms 6.433ms 6.522ms 6.708ms 4.90% -1.398 5.721 1.14% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.368ms; 6.388ms] or [-0.158%; +0.158%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.648µs 25.576µs ± 9.561µs 17.947µs ± 0.215µs 34.450µs 42.898µs 43.857µs 59.469µs 231.36% 0.744 -0.562 37.29% 0.676µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.251µs; 26.901µs] or [-5.181%; +5.181%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.280µs 89.482µs ± 0.163µs 89.459µs ± 0.054µs 89.525µs 89.619µs 90.007µs 91.283µs 2.04% 7.124 73.656 0.18% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.460µs; 89.505µs] or [-0.025%; +0.025%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.125ns 192.231ns ± 2.556ns 191.956ns ± 1.401ns 193.165ns 196.285ns 199.074ns 211.143ns 10.00% 2.672 14.605 1.33% 0.181ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.877ns; 192.585ns] or [-0.184%; +0.184%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.311ns 253.570ns ± 12.633ns 248.951ns ± 3.268ns 254.754ns 282.292ns 295.079ns 297.155ns 19.36% 1.985 3.144 4.97% 0.893ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.819ns; 255.321ns] or [-0.690%; +0.690%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.411µs 2.457µs ± 0.018µs 2.453µs ± 0.008µs 2.463µs 2.499µs 2.506µs 2.537µs 3.43% 1.279 2.634 0.72% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.454µs; 2.459µs] or [-0.100%; +0.100%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.554ms 10.591ms ± 0.014ms 10.588ms ± 0.007ms 10.595ms 10.617ms 10.637ms 10.642ms 0.51% 0.928 1.617 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.589ms; 10.593ms] or [-0.018%; +0.018%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.209µs 3.232µs ± 1.430µs 3.004µs ± 0.026µs 3.034µs 3.674µs 14.117µs 14.795µs 392.56% 7.290 54.520 44.13% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.034µs; 3.430µs] or [-6.131%; +6.131%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.921µs 3.923µs 0.21% -1.379 10.425 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254888217.301op/s 255410970.933op/s ± 184200.343op/s 255416351.168op/s ± 107648.233op/s 255523987.314op/s 255649236.565op/s 255736702.221op/s 256696255.892op/s 0.50% 1.402 10.601 0.07% 13024.931op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.699µs 78.496µs ± 0.781µs 78.431µs ± 0.490µs 78.972µs 79.727µs 80.327µs 81.777µs 4.27% 0.481 0.989 0.99% 0.055µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12228399.368op/s 12740770.925op/s ± 126289.903op/s 12750042.148op/s ± 79627.757op/s 12824005.286op/s 12937639.606op/s 13025655.360op/s 13037969.010op/s 2.26% -0.401 0.799 0.99% 8930.045op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.886µs 72.307µs ± 0.734µs 72.264µs ± 0.543µs 72.798µs 73.578µs 74.165µs 74.384µs 2.93% 0.411 -0.186 1.01% 0.052µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13443734.441op/s 13831256.274op/s ± 139924.224op/s 13838189.656op/s ± 103523.762op/s 13940613.496op/s 14041387.160op/s 14101161.170op/s 14107165.131op/s 1.94% -0.361 -0.246 1.01% 9894.137op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.919µs 3.921µs 3.924µs 0.23% -1.299 9.800 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254863097.120op/s 255447875.811op/s ± 184346.587op/s 255437341.220op/s ± 102111.232op/s 255551129.397op/s 255707884.118op/s 255771075.910op/s 256707681.287op/s 0.50% 1.321 9.956 0.07% 13035.272op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.494µs 68.862µs ± 0.642µs 68.811µs ± 0.440µs 69.270µs 70.027µs 70.188µs 70.328µs 2.20% 0.149 -0.537 0.93% 0.045µs 1 200
credit_card/is_card_number/378282246310005 throughput 14219168.023op/s 14522995.051op/s ± 135303.221op/s 14532613.781op/s ± 92862.596op/s 14622040.961op/s 14732878.636op/s 14802343.917op/s 14816133.308op/s 1.95% -0.109 -0.543 0.93% 9567.383op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.726µs 53.024µs ± 0.121µs 53.076µs ± 0.102µs 53.124µs 53.185µs 53.246µs 53.278µs 0.38% -0.167 -1.257 0.23% 0.009µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18769546.024op/s 18859625.704op/s ± 43052.760op/s 18840988.142op/s ± 36081.008op/s 18900126.631op/s 18926253.749op/s 18932300.864op/s 18965862.752op/s 0.66% 0.172 -1.256 0.23% 3044.290op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.428µs 6.437µs ± 0.004µs 6.436µs ± 0.003µs 6.439µs 6.444µs 6.449µs 6.453µs 0.26% 0.783 1.253 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154967995.718op/s 155358227.720op/s ± 100877.169op/s 155365291.394op/s ± 62219.282op/s 155422563.471op/s 155493913.680op/s 155551765.016op/s 155568667.549op/s 0.13% -0.778 1.238 0.06% 7133.093op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.921µs 3.922µs 3.931µs 0.43% -0.507 12.103 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254361098.183op/s 255424845.591op/s ± 213341.254op/s 255455882.774op/s ± 95725.874op/s 255533462.178op/s 255660636.706op/s 255736076.168op/s 256873838.350op/s 0.56% 0.542 12.257 0.08% 15085.505op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.871µs 65.167µs ± 0.157µs 65.118µs ± 0.082µs 65.229µs 65.490µs 65.600µs 65.693µs 0.88% 0.987 0.576 0.24% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15222431.855op/s 15345327.448op/s ± 36992.888op/s 15356678.045op/s ± 19384.554op/s 15371416.087op/s 15387787.896op/s 15408025.655op/s 15415111.434op/s 0.38% -0.975 0.549 0.24% 2615.792op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.607µs 58.931µs ± 0.218µs 58.859µs ± 0.112µs 59.077µs 59.368µs 59.511µs 59.698µs 1.42% 1.029 0.474 0.37% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16751049.256op/s 16969155.614op/s ± 62593.268op/s 16989688.109op/s ± 32299.470op/s 17015191.163op/s 17041127.398op/s 17058403.677op/s 17062720.856op/s 0.43% -1.013 0.426 0.37% 4426.012op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.916µs ± 0.004µs 3.915µs ± 0.002µs 3.918µs 3.921µs 3.926µs 3.933µs 0.46% 0.455 5.231 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254276472.470op/s 255391948.044op/s ± 241186.890op/s 255434659.815op/s ± 141332.528op/s 255540132.587op/s 255690110.711op/s 255741888.864op/s 256612646.775op/s 0.46% -0.435 5.244 0.09% 17054.489op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 55.287µs 55.650µs ± 0.169µs 55.620µs ± 0.098µs 55.734µs 55.972µs 56.173µs 56.297µs 1.22% 1.187 1.798 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17762841.202op/s 17969752.872op/s ± 54291.388op/s 17979027.562op/s ± 31836.595op/s 18008592.351op/s 18035412.624op/s 18046262.119op/s 18087403.761op/s 0.60% -1.165 1.729 0.30% 3838.981op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 53.061µs 53.130µs ± 0.037µs 53.125µs ± 0.022µs 53.151µs 53.193µs 53.241µs 53.278µs 0.29% 0.896 1.504 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18769374.538op/s 18821732.529op/s ± 13030.334op/s 18823369.124op/s ± 7790.746op/s 18830506.018op/s 18840736.182op/s 18844946.111op/s 18846333.182op/s 0.12% -0.890 1.487 0.07% 921.384op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.428µs 6.440µs ± 0.010µs 6.438µs ± 0.003µs 6.442µs 6.457µs 6.474µs 6.520µs 1.27% 3.921 23.209 0.16% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 153380668.257op/s 155277386.366op/s ± 245865.310op/s 155331345.064op/s ± 81665.011op/s 155409028.794op/s 155492817.381op/s 155535965.667op/s 155577519.309op/s 0.16% -3.875 22.725 0.16% 17385.303op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255385442.537op/s; 255436499.329op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.388µs; 78.604µs] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12723268.359op/s; 12758273.491op/s] or [-0.137%; +0.137%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.206µs; 72.409µs] or [-0.141%; +0.141%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13811864.122op/s; 13850648.425op/s] or [-0.140%; +0.140%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255422327.147op/s; 255473424.475op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.773µs; 68.951µs] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/378282246310005 throughput [14504243.326op/s; 14541746.776op/s] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [53.007µs; 53.040µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [18853659.006op/s; 18865592.403op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.436µs; 6.437µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 throughput [155344247.114op/s; 155372208.325op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255395278.545op/s; 255454412.637op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.145µs; 65.189µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15340200.590op/s; 15350454.307op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.901µs; 58.961µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16960480.789op/s; 16977830.439op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.916µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255358521.861op/s; 255425374.227op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.626µs; 55.673µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17962228.608op/s; 17977277.137op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [53.125µs; 53.135µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [18819926.650op/s; 18823538.408op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.439µs; 6.442µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155243311.798op/s; 155311460.933op/s] or [-0.022%; +0.022%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.034ms 61.513ms ± 2.136ms 61.231ms ± 0.069ms 61.310ms 61.591ms 67.477ms 83.167ms 35.82% 8.983 82.677 3.46% 0.151ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.217ms; 61.810ms] or [-0.481%; +0.481%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ff3e2d5 1768398198 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.011µs 146.397µs ± 1.629µs 146.204µs ± 0.541µs 146.730µs 147.986µs 151.878µs 160.489µs 9.77% 4.842 34.391 1.11% 0.115µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.171µs; 146.623µs] or [-0.154%; +0.154%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 78.80435% with 78 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.93%. Comparing base (6e559d7) to head (211d2d3).
⚠️ Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1358      +/-   ##
==========================================
- Coverage   70.96%   70.93%   -0.03%     
==========================================
  Files         390      393       +3     
  Lines       62588    62712     +124     
==========================================
+ Hits        44416    44486      +70     
- Misses      18172    18226      +54     
Components Coverage Δ
libdd-crashtracker 60.01% <ø> (+2.35%) ⬆️
libdd-crashtracker-ffi 16.60% <ø> (+2.35%) ⬆️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.57% <75.58%> (-0.53%) ⬇️
libdd-data-pipeline-ffi 77.32% <100.00%> (-0.84%) ⬇️
libdd-common 81.15% <96.96%> (+0.22%) ⬆️
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (-0.11%) ⬇️
libdd-profiling 79.69% <ø> (+0.01%) ⬆️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 35.18% <100.00%> (-1.00%) ⬇️
datdog-sidecar-ffi 7.32% <ø> (-5.00%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.06% <88.57%> (-0.01%) ⬇️
datadog-tracer-flare 62.06% <ø> (+1.00%) ⬆️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@paullegranddc paullegranddc changed the title Paullgdc/data pipeline/runtime agnostisc code Paullgdc/data pipeline/runtime agnostic code Nov 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants