Skip to content

[crashtracking] Document runtime stacks collection #1410

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
gyuheon0h wants to merge 2 commits into
base: main
Choose a base branch
from
Open

[crashtracking] Document runtime stacks collection #1410

gyuheon0h wants to merge 2 commits into from
+84 −0

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Dec 15, 2025 •
edited
Loading

What does this PR do?

We should document high level motivation and decisions made around runtime stack collection callback registration

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Dec 15, 2025

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title General runtime stacks background [crashtracking] Document runtime stacks collection Dec 15, 2025
@codecov-commenter
Copy link

codecov-commenter commented Dec 15, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.42%. Comparing base (e13f239) to head (0ae0fc3).

Additional details and impacted files 
@@           Coverage Diff           @@
##             main    #1410   +/-   ##
=======================================
  Coverage   71.41%   71.42%           
=======================================
  Files         411      411           
  Lines       66047    66047           
=======================================
+ Hits        47168    47173    +5     
+ Misses      18879    18874    -5
Components Coverage Δ
libdd-crashtracker 58.72% <ø> (+0.06%) ⬆️
libdd-crashtracker-ffi 14.72% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.01% <ø> (ø)
libdd-data-pipeline-ffi 77.74% <ø> (ø)
libdd-common 81.33% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.95% <ø> (+0.03%) ⬆️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 81.70% <ø> (ø)
libdd-profiling-ffi 67.83% <ø> (ø)
datadog-sidecar 35.88% <ø> (ø)
datdog-sidecar-ffi 10.88% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.92% <ø> (ø)
datadog-tracer-flare 62.06% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 15, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-01-06 15:09:53

Comparing candidate commit 0ae0fc3 in PR branch gyuheon0h/prof-13287-document-runtime-stacks with baseline commit e13f239 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.581µs 35.079µs ± 0.793µs 34.738µs ± 0.055µs 34.818µs 36.681µs 36.732µs 39.407µs 13.44% 2.094 4.246 2.25% 0.056µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.969µs; 35.189µs] or [-0.313%; +0.313%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.009µs 161.853µs ± 0.300µs 161.787µs ± 0.145µs 161.980µs 162.432µs 162.994µs 163.119µs 0.82% 1.261 3.005 0.19% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.812µs; 161.895µs] or [-0.026%; +0.026%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.454µs 2.480µs ± 0.018µs 2.477µs ± 0.008µs 2.485µs 2.516µs 2.533µs 2.577µs 4.04% 1.740 4.880 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.477µs; 2.482µs] or [-0.099%; +0.099%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.647ms 10.684ms ± 0.017ms 10.684ms ± 0.010ms 10.693ms 10.711ms 10.724ms 10.773ms 0.83% 1.104 4.192 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.682ms; 10.686ms] or [-0.022%; +0.022%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.930ms 3.937ms ± 0.007ms 3.936ms ± 0.002ms 3.938ms 3.945ms 3.948ms 4.029ms 2.36% 9.635 115.687 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.936ms; 3.938ms] or [-0.026%; +0.026%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.805µs 89.037µs ± 0.148µs 89.009µs ± 0.059µs 89.078µs 89.216µs 89.425µs 90.475µs 1.65% 5.041 43.803 0.17% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.016µs; 89.057µs] or [-0.023%; +0.023%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.917µs 3.920µs 0.20% -1.003 6.552 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255127417.537op/s 255638571.537op/s ± 184906.769op/s 255637586.126op/s ± 107667.999op/s 255743597.890op/s 255895161.004op/s 256002455.940op/s 256799177.520op/s 0.45% 1.019 6.658 0.07% 13074.883op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.400µs 78.376µs ± 0.497µs 78.378µs ± 0.348µs 78.681µs 79.151µs 79.775µs 80.001µs 2.07% 0.448 0.294 0.63% 0.035µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12499855.959op/s 12759476.737op/s ± 80737.181op/s 12758628.908op/s ± 56648.977op/s 12820223.917op/s 12885143.936op/s 12912841.965op/s 12919943.588op/s 1.26% -0.409 0.226 0.63% 5708.981op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.857µs 71.710µs ± 0.517µs 71.641µs ± 0.343µs 72.006µs 72.644µs 73.046µs 73.803µs 3.02% 0.779 0.689 0.72% 0.037µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13549583.394op/s 13945820.469op/s ± 100045.813op/s 13958546.636op/s ± 67139.519op/s 14022708.768op/s 14086376.329op/s 14100708.542op/s 14112981.473op/s 1.11% -0.735 0.554 0.72% 7074.307op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.900µs 3.912µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.918µs 3.919µs 3.921µs 0.24% 0.375 1.109 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255061682.633op/s 255652168.817op/s ± 194000.251op/s 255670316.676op/s ± 102205.817op/s 255773899.477op/s 255919205.036op/s 255948133.783op/s 256426404.719op/s 0.30% -0.368 1.116 0.08% 13717.889op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.001µs 68.593µs ± 0.314µs 68.553µs ± 0.205µs 68.777µs 69.147µs 69.434µs 69.598µs 1.52% 0.550 -0.075 0.46% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 14368168.170op/s 14579020.024op/s ± 66601.012op/s 14587148.793op/s ± 43674.201op/s 14628178.363op/s 14672830.208op/s 14688045.858op/s 14705712.011op/s 0.81% -0.528 -0.116 0.46% 4709.403op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.575µs 44.933µs ± 0.115µs 44.943µs ± 0.075µs 45.011µs 45.100µs 45.145µs 45.190µs 0.55% -0.456 0.042 0.25% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 22129006.950op/s 22255688.970op/s ± 56865.329op/s 22250437.151op/s ± 37049.825op/s 22289498.870op/s 22353508.490op/s 22393561.757op/s 22434099.832op/s 0.83% 0.470 0.065 0.25% 4020.986op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.692µs 5.700µs ± 0.006µs 5.699µs ± 0.003µs 5.703µs 5.706µs 5.708µs 5.764µs 1.14% 6.146 63.632 0.11% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 173484920.602op/s 175441084.181op/s ± 183646.370op/s 175469205.179op/s ± 95780.699op/s 175541243.417op/s 175636902.820op/s 175684811.462op/s 175693121.880op/s 0.13% -6.059 62.402 0.10% 12985.759op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.918µs 3.918µs 0.15% -0.976 6.971 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255253536.040op/s 255641374.154op/s ± 159364.555op/s 255640627.465op/s ± 76431.646op/s 255716301.915op/s 255876031.195op/s 255951306.605op/s 256646306.260op/s 0.39% 0.991 7.064 0.06% 11268.776op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 59.899µs 62.004µs ± 0.999µs 62.021µs ± 0.633µs 62.535µs 64.115µs 64.406µs 64.643µs 4.23% 0.588 -0.032 1.61% 0.071µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15469679.914op/s 16132050.919op/s ± 257558.572op/s 16123684.927op/s ± 165982.704op/s 16322100.552op/s 16496015.665op/s 16552199.250op/s 16694636.307op/s 3.54% -0.510 -0.136 1.59% 18212.141op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.296µs 53.851µs ± 0.124µs 53.852µs ± 0.083µs 53.938µs 54.035µs 54.089µs 54.128µs 0.51% -0.616 1.350 0.23% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18474744.924op/s 18569862.399op/s ± 42679.198op/s 18569354.997op/s ± 28548.376op/s 18595102.050op/s 18641185.426op/s 18663821.576op/s 18763215.583op/s 1.04% 0.637 1.421 0.23% 3017.875op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.920µs 3.921µs 0.22% -0.615 4.444 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255060750.561op/s 255609350.661op/s ± 200000.719op/s 255618992.491op/s ± 130259.679op/s 255742998.700op/s 255874944.024op/s 255976959.628op/s 256756921.010op/s 0.45% 0.629 4.518 0.08% 14142.186op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.179µs 50.493µs ± 0.127µs 50.495µs ± 0.066µs 50.550µs 50.655µs 50.988µs 51.063µs 1.12% 1.433 5.116 0.25% 0.009µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19583817.311op/s 19805010.233op/s ± 49677.882op/s 19803927.190op/s ± 25890.431op/s 19835709.490op/s 19877142.786op/s 19899580.226op/s 19928679.362op/s 0.63% -1.395 4.968 0.25% 3512.757op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.562µs 44.939µs ± 0.136µs 44.969µs ± 0.100µs 45.052µs 45.117µs 45.132µs 45.154µs 0.41% -0.638 -0.329 0.30% 0.010µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 22146601.564op/s 22252527.332op/s ± 67375.375op/s 22237716.610op/s ± 49400.389op/s 22299858.399op/s 22377757.184op/s 22431878.885op/s 22440569.974op/s 0.91% 0.650 -0.307 0.30% 4764.158op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.691µs 5.699µs ± 0.004µs 5.699µs ± 0.002µs 5.701µs 5.708µs 5.711µs 5.713µs 0.26% 0.778 1.100 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 175027652.873op/s 175468214.051op/s ± 131725.441op/s 175477986.288op/s ± 65962.987op/s 175542665.650op/s 175661046.048op/s 175704102.991op/s 175730945.609op/s 0.14% -0.773 1.088 0.07% 9314.395op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255612945.237op/s; 255664197.837op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.307µs; 78.445µs] or [-0.088%; +0.088%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12748287.340op/s; 12770666.133op/s] or [-0.088%; +0.088%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.638µs; 71.781µs] or [-0.100%; +0.100%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13931955.082op/s; 13959685.857op/s] or [-0.099%; +0.099%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255625282.248op/s; 255679055.386op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.550µs; 68.637µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/378282246310005 throughput [14569789.765op/s; 14588250.284op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [44.917µs; 44.949µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22247807.983op/s; 22263569.958op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.699µs; 5.701µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/x371413321323331 throughput [175415632.560op/s; 175466535.801op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255619287.759op/s; 255663460.548op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [61.866µs; 62.143µs] or [-0.223%; +0.223%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [16096355.778op/s; 16167746.060op/s] or [-0.221%; +0.221%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.834µs; 53.868µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18563947.473op/s; 18575777.326op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255581632.485op/s; 255637068.837op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.475µs; 50.510µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19798125.356op/s; 19811895.109op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [44.920µs; 44.958µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22243189.753op/s; 22261864.911op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.698µs; 5.700µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [175449958.172op/s; 175486469.930op/s] or [-0.010%; +0.010%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.066ms 60.853ms ± 2.375ms 60.571ms ± 0.102ms 60.683ms 60.883ms 79.199ms 80.985ms 33.70% 7.896 61.008 3.89% 0.168ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.524ms; 61.182ms] or [-0.541%; +0.541%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 186.237ns 189.385ns ± 2.398ns 189.180ns ± 1.726ns 190.633ns 193.525ns 195.531ns 201.977ns 6.76% 1.227 3.029 1.26% 0.170ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [189.052ns; 189.717ns] or [-0.176%; +0.176%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.774µs 534.693µs ± 0.452µs 534.646µs ± 0.323µs 535.010µs 535.378µs 535.548µs 537.193µs 0.48% 0.814 3.331 0.08% 0.032µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1861529.167op/s 1870233.993op/s ± 1579.034op/s 1870395.458op/s ± 1129.732op/s 1871383.448op/s 1872537.795op/s 1873209.695op/s 1873451.647op/s 0.16% -0.802 3.264 0.08% 111.655op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.214µs 380.862µs ± 0.303µs 380.827µs ± 0.187µs 381.041µs 381.452µs 381.583µs 381.834µs 0.26% 0.438 0.036 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2618935.691op/s 2625621.220op/s ± 2090.074op/s 2625863.611op/s ± 1291.588op/s 2626945.108op/s 2628695.668op/s 2629654.494op/s 2630098.416op/s 0.16% -0.433 0.030 0.08% 147.791op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.667µs 190.246µs ± 0.290µs 190.259µs ± 0.224µs 190.466µs 190.659µs 190.911µs 191.164µs 0.48% 0.197 -0.304 0.15% 0.020µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5231103.444op/s 5256365.571op/s ± 8003.232op/s 5256004.480op/s ± 6177.874op/s 5262999.508op/s 5268885.016op/s 5270621.109op/s 5272388.488op/s 0.31% -0.190 -0.318 0.15% 565.914op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.889µs 37.261µs ± 0.133µs 37.294µs ± 0.091µs 37.370µs 37.415µs 37.445µs 37.456µs 0.43% -0.981 0.458 0.36% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26698218.525op/s 26838014.490op/s ± 96438.526op/s 26814134.905op/s ± 65430.332op/s 26893558.115op/s 27065978.614op/s 27097259.289op/s 27108528.099op/s 1.10% 0.997 0.496 0.36% 6819.234op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.784µs 45.921µs ± 0.061µs 45.916µs ± 0.041µs 45.958µs 46.020µs 46.076µs 46.158µs 0.53% 0.569 0.467 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21664841.673op/s 21776649.510op/s ± 28817.068op/s 21778792.113op/s ± 19424.535op/s 21797673.875op/s 21815729.686op/s 21827726.025op/s 21841498.568op/s 0.29% -0.560 0.446 0.13% 2037.674op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.630µs; 534.755µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1870015.154op/s; 1870452.832op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.820µs; 380.905µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2625331.555op/s; 2625910.884op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.206µs; 190.286µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5255256.399op/s; 5257474.742op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.243µs; 37.280µs] or [-0.050%; +0.050%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26824649.038op/s; 26851379.942op/s] or [-0.050%; +0.050%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.912µs; 45.929µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21772655.742op/s; 21780643.278op/s] or [-0.018%; +0.018%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.722ms 9.953ms ± 0.063ms 9.955ms ± 0.029ms 9.981ms 10.042ms 10.129ms 10.199ms 2.45% -0.076 3.005 0.64% 0.004ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.944ms; 9.961ms] or [-0.088%; +0.088%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 242.891ns 258.135ns ± 14.821ns 250.040ns ± 5.481ns 271.454ns 282.848ns 297.206ns 297.371ns 18.93% 0.948 -0.262 5.73% 1.048ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [256.081ns; 260.189ns] or [-0.796%; +0.796%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 147.002µs 148.851µs ± 1.886µs 148.568µs ± 0.462µs 149.044µs 150.309µs 156.919µs 168.566µs 13.46% 7.021 63.521 1.26% 0.133µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [148.589µs; 149.112µs] or [-0.176%; +0.176%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.984µs 5.070µs ± 0.043µs 5.052µs ± 0.024µs 5.100µs 5.149µs 5.154µs 5.157µs 2.08% 0.450 -0.767 0.84% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.064µs; 5.076µs] or [-0.117%; +0.117%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.804ms 13.853ms ± 0.031ms 13.849ms ± 0.016ms 13.863ms 13.919ms 13.961ms 14.011ms 1.17% 1.904 5.328 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.849ms; 13.857ms] or [-0.031%; +0.031%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 521.631µs 522.929µs ± 0.626µs 522.877µs ± 0.407µs 523.321µs 524.119µs 524.364µs 524.699µs 0.35% 0.315 -0.161 0.12% 0.044µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [522.842µs; 523.015µs] or [-0.017%; +0.017%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.178µs 3.184µs ± 1.434µs 3.010µs ± 0.026µs 3.036µs 3.395µs 13.782µs 15.257µs 406.87% 7.493 56.866 44.91% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.985µs; 3.382µs] or [-6.240%; +6.240%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.457µs 24.088µs ± 9.009µs 19.340µs ± 0.281µs 28.126µs 44.056µs 50.482µs 69.109µs 257.34% 1.800 3.036 37.31% 0.637µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.839µs; 25.336µs] or [-5.183%; +5.183%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0ae0fc3 1767711216 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.314µs 205.073µs ± 0.490µs 205.026µs ± 0.296µs 205.326µs 205.867µs 206.347µs 208.125µs 1.51% 1.732 6.945 0.24% 0.035µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4804796.070op/s 4876335.168op/s ± 11598.982op/s 4877433.395op/s ± 7050.938op/s 4884373.513op/s 4890304.942op/s 4892851.661op/s 4894434.327op/s 0.35% -1.690 6.634 0.24% 820.172op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.595µs 18.670µs ± 0.061µs 18.649µs ± 0.021µs 18.683µs 18.813µs 18.872µs 18.883µs 1.26% 1.764 2.584 0.32% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52956926.272op/s 53562243.545op/s ± 173243.876op/s 53622677.770op/s ± 60833.164op/s 53670224.670op/s 53729101.301op/s 53757876.542op/s 53778853.152op/s 0.29% -1.750 2.532 0.32% 12250.192op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.837µs 10.933µs ± 0.046µs 10.932µs ± 0.030µs 10.962µs 11.014µs 11.062µs 11.107µs 1.60% 0.537 0.844 0.42% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90033374.679op/s 91467303.061op/s ± 379875.943op/s 91473411.514op/s ± 253625.087op/s 91727275.765op/s 92094279.894op/s 92213016.597op/s 92280717.944op/s 0.88% -0.505 0.773 0.41% 26861.286op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.005µs; 205.141µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4874727.660op/s; 4877942.675op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.662µs; 18.678µs] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53538233.609op/s; 53586253.480op/s] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.927µs; 10.939µs] or [-0.058%; +0.058%] None None None
normalization/normalize_name/normalize_name/good throughput [91414655.908op/s; 91519950.213op/s] or [-0.058%; +0.058%] None None None

Baseline

Omitted due to size.

@gyuheon0h gyuheon0h force-pushed the gyuheon0h/prof-13287-document-runtime-stacks branch from 0a8b343 to 59977fb Compare December 15, 2025 20:19
@gyuheon0h gyuheon0h marked this pull request as ready for review December 15, 2025 20:20
@gyuheon0h gyuheon0h requested a review from a team as a code owner December 15, 2025 20:20
@gyuheon0h gyuheon0h requested a review from gleocadie December 15, 2025 20:21
@dd-octo-sts
Copy link

dd-octo-sts bot commented Jan 6, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.50 MB 7.50 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 87.06 MB 87.06 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.86 MB 58.86 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.49 MB 8.49 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.62 MB 9.62 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.74 MB 100.74 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 20.05 MB 20.05 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.00 MB 142.01 MB +.01% (+16.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 747.80 MB 747.80 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.41 MB 6.41 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 74.31 KB 74.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.89 MB 19.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.98 MB 38.98 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 17.11 MB 17.11 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 144.70 MB 144.72 MB +.01% (+16.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 736.69 MB 736.69 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.92 MB 4.92 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 75.46 KB 75.46 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 21.17 MB 21.17 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.78 MB 36.78 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 75.34 MB 75.34 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.93 MB 8.93 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 60.20 MB 60.20 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.54 MB 9.54 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.90 MB 94.90 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.35 MB 10.35 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gleocadie gleocadie Awaiting requested review from gleocadie

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@gyuheon0h @codecov-commenter