forked from MihaZupan/runtime-utils
-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Description
Job completed in 1 hour 55 minutes (remote runner delay: 1 minute 29 seconds).
Using arguments: benchmark Regex_Industry https://github.com/MihaZupan/performance/tree/compiled-regex-only -medium -NoPRLink
Main commit: dotnet/runtime@14a9c69
PR commit: MihaZupan/runtime@193f892
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 11.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=Default IterationCount=15
LaunchCount=2 MemoryRandomization=Default MinIterationCount=3
WarmupCount=10
| Method | Toolchain | Options | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Count | Main | Compiled | 288.0 ms | 1.07 ms | 1.00 | 224 B | 1.00 |
| Count | PR | Compiled | 288.4 ms | 1.46 ms | 1.00 | 392 B | 1.75 |
| Count | Main | IgnoreCase, Compiled | 332.9 ms | 0.17 ms | 1.00 | 1072 B | 1.00 |
| Count | PR | IgnoreCase, Compiled | 332.9 ms | 0.80 ms | 1.00 | 1072 B | 1.00 |
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 11.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=DontRemove IterationCount=15
LaunchCount=2 MemoryRandomization=True WarmupCount=10
| Method | Toolchain | Pattern | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Count | Main | .* | 533,303.08 ns | 1,134.010 ns | 1.00 | 2 B | 1.00 |
| Count | PR | .* | 533,501.52 ns | 1,549.514 ns | 1.00 | 2 B | 1.00 |
| Count | Main | (?i)Holmes | 41,996.58 ns | 106.641 ns | 1.00 | - | NA |
| Count | PR | (?i)Holmes | 41,815.87 ns | 95.881 ns | 1.00 | - | NA |
| Count | Main | (?i)Sher[a-z]+|Hol[a-z]+ | 122,178.42 ns | 23,466.562 ns | 1.08 | 1 B | 1.00 |
| Count | PR | (?i)Sher[a-z]+|Hol[a-z]+ | 58,402.94 ns | 151.541 ns | 0.52 | - | 0.00 |
| Count | Main | (?i)Sherlock | 33,967.07 ns | 122.688 ns | 1.00 | - | NA |
| Count | PR | (?i)Sherlock | 33,998.18 ns | 99.949 ns | 1.00 | - | NA |
| Count | Main | (?i)Sherlock Holmes | 33,824.21 ns | 94.147 ns | 1.00 | - | NA |
| Count | PR | (?i)Sherlock Holmes | 33,828.07 ns | 101.517 ns | 1.00 | - | NA |
| Count | Main | (?i)Sherlock|Holmes|Watson | 120,967.09 ns | 24,389.716 ns | 1.09 | 1 B | 1.00 |
| Count | PR | (?i)Sherlock|Holmes|Watson | 121,381.71 ns | 24,225.214 ns | 1.10 | - | 0.00 |
| Count | Main | (?i)Sherlock|(...)er|John|Baker [49] | 189,926.18 ns | 21,807.792 ns | 1.03 | 1 B | 1.00 |
| Count | PR | (?i)Sherlock|(...)er|John|Baker [49] | 191,961.32 ns | 22,080.865 ns | 1.04 | 1 B | 1.00 |
| Count | Main | (?i)the | 207,327.96 ns | 5,151.880 ns | 1.00 | 1 B | 1.00 |
| Count | PR | (?i)the | 204,045.78 ns | 1,553.695 ns | 0.99 | 1 B | 1.00 |
| Count | Main | (?m)^Sherlock(...)rlock Holmes$ [37] | 32,349.80 ns | 81.331 ns | 1.00 | - | NA |
| Count | PR | (?m)^Sherlock(...)rlock Holmes$ [37] | 32,393.32 ns | 77.258 ns | 1.00 | - | NA |
| Count | Main | (?s).* | 33.45 ns | 0.037 ns | 1.00 | - | NA |
| Count | PR | (?s).* | 33.21 ns | 0.105 ns | 0.99 | - | NA |
| Count | Main | [^\\n]* | 559,823.52 ns | 22,614.031 ns | 1.00 | 2 B | 1.00 |
| Count | PR | [^\\n]* | 536,291.06 ns | 2,026.347 ns | 0.96 | 2 B | 1.00 |
| Count | Main | [a-q][^u-z]{13}x | 23,112.67 ns | 91.126 ns | 1.00 | - | NA |
| Count | PR | [a-q][^u-z]{13}x | 23,203.38 ns | 56.952 ns | 1.00 | - | NA |
| Count | Main | [a-zA-Z]+ing | 3,342,434.45 ns | 2,917.243 ns | 1.00 | 9 B | 1.00 |
| Count | PR | [a-zA-Z]+ing | 3,336,751.20 ns | 3,755.952 ns | 1.00 | 9 B | 1.00 |
| Count | Main | \b\w+n\b | 6,369,530.43 ns | 45,790.238 ns | 1.00 | 17 B | 1.00 |
| Count | PR | \b\w+n\b | 6,312,709.59 ns | 7,224.904 ns | 0.99 | 17 B | 1.00 |
| Count | Main | \p{L} | 9,352,190.35 ns | 203,470.036 ns | 1.00 | 35 B | 1.00 |
| Count | PR | \p{L} | 8,998,771.35 ns | 81,466.216 ns | 0.96 | 25 B | 0.71 |
| Count | Main | \p{Ll} | 8,757,364.05 ns | 83,430.966 ns | 1.00 | 35 B | 1.00 |
| Count | PR | \p{Ll} | 8,846,479.18 ns | 12,811.221 ns | 1.01 | 35 B | 1.00 |
| Count | Main | \p{Lu} | 370,319.54 ns | 7,222.080 ns | 1.00 | 1 B | 1.00 |
| Count | PR | \p{Lu} | 352,891.50 ns | 9,872.821 ns | 0.95 | 1 B | 1.00 |
| Count | Main | \s[a-zA-Z]{0,12}ing\s | 3,467,432.45 ns | 1,371.457 ns | 1.00 | 11 B | 1.00 |
| Count | PR | \s[a-zA-Z]{0,12}ing\s | 3,467,935.38 ns | 2,670.569 ns | 1.00 | 11 B | 1.00 |
| Count | Main | \w+ | 4,016,073.49 ns | 13,553.049 ns | 1.00 | 21 B | 1.00 |
| Count | PR | \w+ | 4,013,003.50 ns | 8,291.537 ns | 1.00 | 117 B | 5.57 |
| Count | Main | \w+\s+Holmes | 2,797,597.50 ns | 6,682.593 ns | 1.00 | 8 B | 1.00 |
| Count | PR | \w+\s+Holmes | 2,796,547.16 ns | 7,160.022 ns | 1.00 | 10 B | 1.25 |
| Count | Main | \w+\s+Holmes\s+\w+ | 3,141,502.07 ns | 62,708.800 ns | 1.00 | 9 B | 1.00 |
| Count | PR | \w+\s+Holmes\s+\w+ | 3,171,759.90 ns | 16,672.959 ns | 1.01 | 10 B | 1.11 |
| Count | Main | aei | 28,579.41 ns | 294.714 ns | 1.00 | - | NA |
| Count | PR | aei | 28,513.72 ns | 314.556 ns | 1.00 | - | NA |
| Count | Main | aqj | 28,766.82 ns | 297.170 ns | 1.00 | - | NA |
| Count | PR | aqj | 28,717.28 ns | 315.561 ns | 1.00 | - | NA |
| Count | Main | Holmes | 39,009.86 ns | 111.573 ns | 1.00 | - | NA |
| Count | PR | Holmes | 39,148.84 ns | 76.971 ns | 1.00 | - | NA |
| Count | Main | Holmes.{0,25}(...).{0,25}Holmes [39] | 47,065.27 ns | 125.705 ns | 1.00 | - | NA |
| Count | PR | Holmes.{0,25}(...).{0,25}Holmes [39] | 44,504.31 ns | 109.445 ns | 0.95 | - | NA |
| Count | Main | Sher[a-z]+|Hol[a-z]+ | 48,334.72 ns | 73.481 ns | 1.00 | - | NA |
| Count | PR | Sher[a-z]+|Hol[a-z]+ | 45,442.03 ns | 99.352 ns | 0.94 | - | NA |
| Count | Main | Sherlock | 31,802.02 ns | 138.074 ns | 1.00 | - | NA |
| Count | PR | Sherlock | 31,618.70 ns | 68.301 ns | 0.99 | - | NA |
| Count | Main | Sherlock Holmes | 32,884.56 ns | 120.134 ns | 1.00 | - | NA |
| Count | PR | Sherlock Holmes | 32,756.02 ns | 103.337 ns | 1.00 | - | NA |
| Count | Main | Sherlock\s+Holmes | 32,385.90 ns | 102.102 ns | 1.00 | - | NA |
| Count | PR | Sherlock\s+Holmes | 32,436.04 ns | 103.027 ns | 1.00 | - | NA |
| Count | Main | Sherlock|Holmes | 44,851.74 ns | 111.835 ns | 1.00 | - | NA |
| Count | PR | Sherlock|Holmes | 41,733.06 ns | 69.913 ns | 0.93 | - | NA |
| Count | Main | Sherlock|Holmes|Watson | 59,181.78 ns | 363.880 ns | 1.00 | - | NA |
| Count | PR | Sherlock|Holmes|Watson | 58,648.84 ns | 149.309 ns | 0.99 | - | NA |
| Count | Main | Sherlock|Holm(...)er|John|Baker [45] | 88,137.47 ns | 166.569 ns | 1.00 | - | NA |
| Count | PR | Sherlock|Holm(...)er|John|Baker [45] | 87,773.70 ns | 168.097 ns | 1.00 | - | NA |
| Count | Main | Sherlock|Street | 25,153.15 ns | 138.367 ns | 1.00 | - | NA |
| Count | PR | Sherlock|Street | 25,230.78 ns | 79.591 ns | 1.00 | - | NA |
| Count | Main | the | 170,174.57 ns | 372.371 ns | 1.00 | - | NA |
| Count | PR | the | 170,758.26 ns | 1,123.961 ns | 1.00 | 3 B | NA |
| Count | Main | The | 44,177.70 ns | 81.443 ns | 1.00 | - | NA |
| Count | PR | The | 44,172.27 ns | 115.969 ns | 1.00 | - | NA |
| Count | Main | the\s+\w+ | 263,245.64 ns | 505.097 ns | 1.00 | 1 B | 1.00 |
| Count | PR | the\s+\w+ | 269,670.59 ns | 5,043.643 ns | 1.02 | 1 B | 1.00 |
| Count | Main | zqj | 28,670.72 ns | 308.628 ns | 1.00 | - | NA |
| Count | PR | zqj | 28,718.73 ns | 329.254 ns | 1.00 | - | NA |
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 11.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun IterationCount=15 LaunchCount=2
WarmupCount=10
| Method | Toolchain | Pattern | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Ctor | Main | (?:(?:250-5]?[0-9][0-9]) [87] | 19.19 μs | 0.075 μs | 1.00 | 30552 B | 1.00 |
| Ctor | PR | (?:(?:250-5]?[0-9][0-9]) [87] | 20.72 μs | 0.130 μs | 1.08 | 34328 B | 1.12 |
| Count | Main | (?:(?:250-5]?[0-9][0-9]) [87] | 2,677.62 μs | 5.240 μs | 1.00 | 15 B | 1.00 |
| Count | PR | (?:(?:250-5]?[0-9][0-9]) [87] | 2,668.78 μs | 5.216 μs | 1.00 | 14 B | 0.93 |
| Ctor | Main | [\w]+://[^/\s(...)?(?:#[^\\s]*)? [51] | 15.40 μs | 0.161 μs | 1.00 | 23216 B | 1.00 |
| Ctor | PR | [\w]+://[^/\s(...)?(?:#[^\\s]*)? [51] | 15.26 μs | 0.094 μs | 0.99 | 23384 B | 1.01 |
| Count | Main | [\w]+://[^/\s(...)?(?:#[^\\s]*)? [51] | 772.11 μs | 2.277 μs | 1.00 | 3 B | 1.00 |
| Count | PR | [\w]+://[^/\s(...)?(?:#[^\\s]*)? [51] | 767.30 μs | 2.140 μs | 0.99 | 3 B | 1.00 |
| Ctor | Main | [\w\.+-]+@[\w\.-]+\.[\w\.-]+ | 11.94 μs | 0.033 μs | 1.00 | 13880 B | 1.00 |
| Ctor | PR | [\w\.+-]+@[\w\.-]+\.[\w\.-]+ | 12.02 μs | 0.035 μs | 1.01 | 14048 B | 1.01 |
| Count | Main | [\w\.+-]+@[\w\.-]+\.[\w\.-]+ | 184.73 μs | 0.247 μs | 1.00 | 1 B | 1.00 |
| Count | PR | [\w\.+-]+@[\w\.-]+\.[\w\.-]+ | 185.04 μs | 0.525 μs | 1.00 | 1 B | 1.00 |
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 11.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=DontRemove IterationCount=15
LaunchCount=2 MemoryRandomization=True WarmupCount=10
| Method | Toolchain | Pattern | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Count | Main | .{0,2}(Tom|Sawyer|Huckleberry|Finn) | 182,222.3 μs | 493.44 μs | 1.00 | 979 B | 1.00 |
| Count | PR | .{0,2}(Tom|Sawyer|Huckleberry|Finn) | 182,007.7 μs | 75.87 μs | 1.00 | 979 B | 1.00 |
| Count | Main | .{2,4}(Tom|Sawyer|Huckleberry|Finn) | 188,994.5 μs | 3,019.56 μs | 1.00 | 872 B | 1.00 |
| Count | PR | .{2,4}(Tom|Sawyer|Huckleberry|Finn) | 187,465.8 μs | 138.40 μs | 0.99 | 984 B | 1.13 |
| Count | Main | (?i)Tom|Sawyer|Huckleberry|Finn | 2,875.3 μs | 661.45 μs | 1.13 | 8 B | 1.00 |
| Count | PR | (?i)Tom|Sawyer|Huckleberry|Finn | 2,865.4 μs | 661.38 μs | 1.13 | 4 B | 0.50 |
| Count | Main | (?i)Twain | 927.1 μs | 3.13 μs | 1.00 | 2 B | 1.00 |
| Count | PR | (?i)Twain | 925.5 μs | 3.35 μs | 1.00 | 2 B | 1.00 |
| Count | Main | ([A-Za-z]awyer|[A-Za-z]inn)\s | 12,759.0 μs | 4.25 μs | 1.00 | 45 B | 1.00 |
| Count | PR | ([A-Za-z]awyer|[A-Za-z]inn)\s | 12,753.0 μs | 4.53 μs | 1.00 | 40 B | 0.89 |
| Count | Main | [a-z]shing | 915.3 μs | 3.61 μs | 1.00 | 2 B | 1.00 |
| Count | PR | [a-z]shing | 916.2 μs | 4.40 μs | 1.00 | 2 B | 1.00 |
| Count | Main | \p{Sm} | 703.6 μs | 6.81 μs | 1.00 | 2 B | 1.00 |
| Count | PR | \p{Sm} | 704.5 μs | 5.67 μs | 1.00 | 2 B | 1.00 |
| Count | Main | Huck[a-zA-Z]+|Saw[a-zA-Z]+ | 1,570.4 μs | 11.46 μs | 1.00 | 4 B | 1.00 |
| Count | PR | Huck[a-zA-Z]+|Saw[a-zA-Z]+ | 846.3 μs | 3.09 μs | 0.54 | 2 B | 0.50 |
| Count | Main | Tom.{10,25}river|river.{10,25}Tom | 6,329.2 μs | 3.51 μs | 1.00 | 19 B | 1.00 |
| Count | PR | Tom.{10,25}river|river.{10,25}Tom | 1,079.4 μs | 3.21 μs | 0.17 | 6 B | 0.32 |
| Count | Main | Tom|Sawyer|Huckleberry|Finn | 2,639.0 μs | 3.84 μs | 1.00 | 9 B | 1.00 |
| Count | PR | Tom|Sawyer|Huckleberry|Finn | 2,629.0 μs | 2.40 μs | 1.00 | 9 B | 1.00 |
| Count | Main | Twain | 876.8 μs | 3.55 μs | 1.00 | 2 B | 1.00 |
| Count | PR | Twain | 881.1 μs | 12.17 μs | 1.00 | 2 B | 1.00 |
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 11.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=DontRemove IterationCount=15
LaunchCount=2 MemoryRandomization=True WarmupCount=10
| Method | Toolchain | Id | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| IsMatch | Main | 0 | 24.18 ns | 5.154 ns | 1.07 | - | NA |
| IsMatch | PR | 0 | 21.12 ns | 0.565 ns | 0.94 | - | NA |
| IsMatch | Main | 1 | 44.63 ns | 0.253 ns | 1.00 | - | NA |
| IsMatch | PR | 1 | 43.98 ns | 0.083 ns | 0.99 | - | NA |
| IsMatch | Main | 2 | 48.31 ns | 0.041 ns | 1.00 | - | NA |
| IsMatch | PR | 2 | 48.26 ns | 0.045 ns | 1.00 | - | NA |
| IsMatch | Main | 3 | 84.54 ns | 0.858 ns | 1.00 | - | NA |
| IsMatch | PR | 3 | 83.86 ns | 0.698 ns | 0.99 | - | NA |
| IsMatch | Main | 4 | 71.58 ns | 0.373 ns | 1.00 | - | NA |
| IsMatch | PR | 4 | 71.23 ns | 0.109 ns | 1.00 | - | NA |
| IsMatch | Main | 5 | 74.26 ns | 1.302 ns | 1.00 | - | NA |
| IsMatch | PR | 5 | 72.50 ns | 1.290 ns | 0.98 | - | NA |
| IsMatch | Main | 6 | 23.66 ns | 0.432 ns | 1.00 | - | NA |
| IsMatch | PR | 6 | 23.04 ns | 0.106 ns | 0.97 | - | NA |
| IsMatch | Main | 7 | 22.53 ns | 0.025 ns | 1.00 | - | NA |
| IsMatch | PR | 7 | 22.82 ns | 0.075 ns | 1.01 | - | NA |
| IsMatch | Main | 8 | 22.83 ns | 0.017 ns | 1.00 | - | NA |
| IsMatch | PR | 8 | 23.50 ns | 0.409 ns | 1.03 | - | NA |
| IsMatch | Main | 9 | 24.46 ns | 1.096 ns | 1.00 | - | NA |
| IsMatch | PR | 9 | 23.65 ns | 0.528 ns | 0.97 | - | NA |
| IsMatch | Main | 10 | 23.46 ns | 0.026 ns | 1.00 | - | NA |
| IsMatch | PR | 10 | 23.31 ns | 0.089 ns | 0.99 | - | NA |
| IsMatch | Main | 11 | 22.49 ns | 0.068 ns | 1.00 | - | NA |
| IsMatch | PR | 11 | 22.42 ns | 0.059 ns | 1.00 | - | NA |
| IsMatch | Main | 12 | 30.41 ns | 6.471 ns | 1.07 | - | NA |
| IsMatch | PR | 12 | 25.88 ns | 0.067 ns | 0.91 | - | NA |
| IsMatch | Main | 13 | 25.93 ns | 0.156 ns | 1.00 | - | NA |
| IsMatch | PR | 13 | 25.80 ns | 0.043 ns | 0.99 | - | NA |
Artifacts:
- BDN_Artifacts.zip (831 KB)
- results.md (29 KB)
Metadata
Metadata
Assignees
Labels
No labels