chore: update benchmark results

thomhurst · thomhurst · Nov 14, 2025 · Nov 14, 2025 · Nov 14, 2025 · eeb9e119ed080739a5b2119157015021aeb9a66b
commit eeb9e119ed080739a5b2119157015021aeb9a66b
diff --git a/docs/docs/benchmarks/AsyncTests.md b/docs/docs/benchmarks/AsyncTests.md
@@ -7,7 +7,7 @@ sidebar_position: 2
 # AsyncTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 551.3 ms | 551.1 ms | 1.86 ms |
-| NUnit | 4.4.0 | 639.4 ms | 634.6 ms | 10.77 ms |
-| MSTest | 4.0.2 | 612.9 ms | 611.2 ms | 9.13 ms |
-| xUnit3 | 3.2.0 | 692.8 ms | 692.6 ms | 5.81 ms |
-| **TUnit (AOT)** | 1.1.0 | 122.7 ms | 122.8 ms | 0.41 ms |
+| **TUnit** | 1.1.10 | 565.6 ms | 564.2 ms | 3.94 ms |
+| NUnit | 4.4.0 | 681.8 ms | 682.0 ms | 4.42 ms |
+| MSTest | 4.0.2 | 654.5 ms | 653.4 ms | 6.20 ms |
+| xUnit3 | 3.2.0 | 734.5 ms | 736.6 ms | 8.35 ms |
+| **TUnit (AOT)** | 1.1.10 | 124.2 ms | 124.2 ms | 0.29 ms |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "AsyncTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 832
-  bar [551.3, 639.4, 612.9, 692.8, 122.7]
+  y-axis "Time (ms)" 0 --> 882
+  bar [565.6, 681.8, 654.5, 734.5, 124.2]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.380Z*
+*Last generated: 2025-11-14T00:28:50.466Z*
diff --git a/docs/docs/benchmarks/BuildTime.md b/docs/docs/benchmarks/BuildTime.md
@@ -7,7 +7,7 @@ sidebar_position: 8
 # Build Performance Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -18,10 +18,10 @@ Compilation time comparison across frameworks:
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 2.100 s | 2.101 s | 0.0207 s |
-| Build_NUnit | 4.4.0 | 1.688 s | 1.689 s | 0.0214 s |
-| Build_MSTest | 4.0.2 | 1.731 s | 1.733 s | 0.0235 s |
-| Build_xUnit3 | 3.2.0 | 1.648 s | 1.639 s | 0.0283 s |
+| **TUnit** | 1.1.10 | 2.051 s | 2.047 s | 0.0286 s |
+| Build_NUnit | 4.4.0 | 1.637 s | 1.634 s | 0.0138 s |
+| Build_MSTest | 4.0.2 | 1.709 s | 1.706 s | 0.0086 s |
+| Build_xUnit3 | 3.2.0 | 1.618 s | 1.615 s | 0.0180 s |
 
 ## 📈 Visual Comparison
 
@@ -60,7 +60,7 @@ xychart-beta
   title "Build Time Comparison"
   x-axis ["Build_TUnit", "Build_NUnit", "Build_MSTest", "Build_xUnit3"]
   y-axis "Time (s)" 0 --> 3
-  bar [2.1, 1.688, 1.731, 1.648]
+  bar [2.051, 1.637, 1.709, 1.618]
 ```
 
 ---
@@ -69,4 +69,4 @@ xychart-beta
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.383Z*
+*Last generated: 2025-11-14T00:28:50.468Z*
diff --git a/docs/docs/benchmarks/DataDrivenTests.md b/docs/docs/benchmarks/DataDrivenTests.md
@@ -7,7 +7,7 @@ sidebar_position: 3
 # DataDrivenTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 486.77 ms | 486.53 ms | 3.791 ms |
-| NUnit | 4.4.0 | 589.92 ms | 591.78 ms | 12.153 ms |
-| MSTest | 4.0.2 | 605.63 ms | 602.89 ms | 14.207 ms |
-| xUnit3 | 3.2.0 | 600.41 ms | 597.06 ms | 10.504 ms |
-| **TUnit (AOT)** | 1.1.0 | 24.05 ms | 24.05 ms | 0.239 ms |
+| **TUnit** | 1.1.10 | 486.00 ms | 486.93 ms | 2.911 ms |
+| NUnit | 4.4.0 | 587.97 ms | 586.01 ms | 10.141 ms |
+| MSTest | 4.0.2 | 606.98 ms | 607.45 ms | 10.647 ms |
+| xUnit3 | 3.2.0 | 599.37 ms | 599.31 ms | 9.447 ms |
+| **TUnit (AOT)** | 1.1.10 | 23.70 ms | 23.74 ms | 0.136 ms |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "DataDrivenTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 727
-  bar [486.77, 589.92, 605.63, 600.41, 24.05]
+  y-axis "Time (ms)" 0 --> 729
+  bar [486, 587.97, 606.98, 599.37, 23.7]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.381Z*
+*Last generated: 2025-11-14T00:28:50.466Z*
diff --git a/docs/docs/benchmarks/MassiveParallelTests.md b/docs/docs/benchmarks/MassiveParallelTests.md
@@ -7,7 +7,7 @@ sidebar_position: 4
 # MassiveParallelTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 601.9 ms | 602.5 ms | 2.97 ms |
-| NUnit | 4.4.0 | 1,181.6 ms | 1,177.9 ms | 13.31 ms |
-| MSTest | 4.0.2 | 2,965.3 ms | 2,966.7 ms | 6.96 ms |
-| xUnit3 | 3.2.0 | 3,066.6 ms | 3,066.7 ms | 6.78 ms |
-| **TUnit (AOT)** | 1.1.0 | 131.6 ms | 131.7 ms | 0.37 ms |
+| **TUnit** | 1.1.10 | 613.8 ms | 613.2 ms | 4.83 ms |
+| NUnit | 4.4.0 | 1,216.8 ms | 1,214.5 ms | 9.48 ms |
+| MSTest | 4.0.2 | 2,992.2 ms | 2,990.5 ms | 13.72 ms |
+| xUnit3 | 3.2.0 | 3,088.0 ms | 3,087.1 ms | 9.69 ms |
+| **TUnit (AOT)** | 1.1.10 | 131.8 ms | 131.9 ms | 0.45 ms |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "MassiveParallelTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 3680
-  bar [601.9, 1181.6, 2965.3, 3066.6, 131.6]
+  y-axis "Time (ms)" 0 --> 3706
+  bar [613.8, 1216.8, 2992.2, 3088, 131.8]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.381Z*
+*Last generated: 2025-11-14T00:28:50.466Z*
diff --git a/docs/docs/benchmarks/MatrixTests.md b/docs/docs/benchmarks/MatrixTests.md
@@ -7,7 +7,7 @@ sidebar_position: 5
 # MatrixTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 570.36 ms | 570.43 ms | 4.980 ms |
-| NUnit | 4.4.0 | 1,565.27 ms | 1,565.69 ms | 5.876 ms |
-| MSTest | 4.0.2 | 1,523.48 ms | 1,521.53 ms | 8.270 ms |
-| xUnit3 | 3.2.0 | 1,605.46 ms | 1,605.92 ms | 7.776 ms |
-| **TUnit (AOT)** | 1.1.0 | 79.85 ms | 79.80 ms | 0.324 ms |
+| **TUnit** | 1.1.10 | 554.66 ms | 554.27 ms | 3.979 ms |
+| NUnit | 4.4.0 | 1,521.00 ms | 1,519.64 ms | 8.186 ms |
+| MSTest | 4.0.2 | 1,480.94 ms | 1,479.41 ms | 8.867 ms |
+| xUnit3 | 3.2.0 | 1,568.45 ms | 1,568.35 ms | 6.902 ms |
+| **TUnit (AOT)** | 1.1.10 | 77.76 ms | 77.77 ms | 0.199 ms |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "MatrixTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 1927
-  bar [570.36, 1565.27, 1523.48, 1605.46, 79.85]
+  y-axis "Time (ms)" 0 --> 1883
+  bar [554.66, 1521, 1480.94, 1568.45, 77.76]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.381Z*
+*Last generated: 2025-11-14T00:28:50.467Z*
diff --git a/docs/docs/benchmarks/ScaleTests.md b/docs/docs/benchmarks/ScaleTests.md
@@ -7,7 +7,7 @@ sidebar_position: 6
 # ScaleTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 516.15 ms | 515.58 ms | 7.373 ms |
-| NUnit | 4.4.0 | 582.62 ms | 580.89 ms | 8.879 ms |
-| MSTest | 4.0.2 | 564.54 ms | 562.45 ms | 7.780 ms |
-| xUnit3 | 3.2.0 | 578.98 ms | 576.98 ms | 9.057 ms |
-| **TUnit (AOT)** | 1.1.0 | 44.37 ms | 44.24 ms | 3.944 ms |
+| **TUnit** | 1.1.10 | 505.85 ms | 505.28 ms | 2.469 ms |
+| NUnit | 4.4.0 | 684.72 ms | 681.86 ms | 16.921 ms |
+| MSTest | 4.0.2 | 669.43 ms | 669.54 ms | 13.552 ms |
+| xUnit3 | 3.2.0 | 684.21 ms | 676.60 ms | 15.666 ms |
+| **TUnit (AOT)** | 1.1.10 | 44.88 ms | 44.70 ms | 3.904 ms |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "ScaleTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 700
-  bar [516.15, 582.62, 564.54, 578.98, 44.37]
+  y-axis "Time (ms)" 0 --> 822
+  bar [505.85, 684.72, 669.43, 684.21, 44.88]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.382Z*
+*Last generated: 2025-11-14T00:28:50.467Z*
diff --git a/docs/docs/benchmarks/SetupTeardownTests.md b/docs/docs/benchmarks/SetupTeardownTests.md
@@ -7,7 +7,7 @@ sidebar_position: 7
 # SetupTeardownTests Benchmark
 
 :::info Last Updated
-This benchmark was automatically generated on **2025-11-13** from the latest CI run.
+This benchmark was automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -16,11 +16,11 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 
 | Framework | Version | Mean | Median | StdDev |
 |-----------|---------|------|--------|--------|
-| **TUnit** | 1.1.0 | 562.2 ms | 561.5 ms | 4.24 ms |
-| NUnit | 4.4.0 | 1,173.5 ms | 1,173.5 ms | 9.02 ms |
-| MSTest | 4.0.2 | 1,146.7 ms | 1,145.3 ms | 16.63 ms |
-| xUnit3 | 3.2.0 | 1,216.8 ms | 1,217.2 ms | 5.86 ms |
-| **TUnit (AOT)** | 1.1.0 | NA | NA | NA |
+| **TUnit** | 1.1.10 | 559.8 ms | 560.2 ms | 3.75 ms |
+| NUnit | 4.4.0 | 1,135.0 ms | 1,132.6 ms | 11.31 ms |
+| MSTest | 4.0.2 | 1,108.5 ms | 1,107.1 ms | 8.11 ms |
+| xUnit3 | 3.2.0 | 1,186.2 ms | 1,186.3 ms | 6.25 ms |
+| **TUnit (AOT)** | 1.1.10 | NA | NA | NA |
 
 ## 📈 Visual Comparison
 
@@ -58,8 +58,8 @@ This benchmark was automatically generated on **2025-11-13** from the latest CI
 xychart-beta
   title "SetupTeardownTests Performance Comparison"
   x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
-  y-axis "Time (ms)" 0 --> 1461
-  bar [562.2, 1173.5, 1146.7, 1216.8, 0]
+  y-axis "Time (ms)" 0 --> 1424
+  bar [559.8, 1135, 1108.5, 1186.2, 0]
 ```
 
 ## 🎯 Key Insights
@@ -72,4 +72,4 @@ This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using
 View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
 :::
 
-*Last generated: 2025-11-13T00:28:35.382Z*
+*Last generated: 2025-11-14T00:28:50.467Z*
diff --git a/docs/docs/benchmarks/index.md b/docs/docs/benchmarks/index.md
@@ -7,7 +7,7 @@ sidebar_position: 1
 # Performance Benchmarks
 
 :::info Last Updated
-These benchmarks were automatically generated on **2025-11-13** from the latest CI run.
+These benchmarks were automatically generated on **2025-11-14** from the latest CI run.
 
 **Environment:** Ubuntu Latest • .NET SDK 10.0.100
 :::
@@ -37,7 +37,7 @@ These benchmarks compare TUnit against the most popular .NET testing frameworks:
 
 | Framework | Version Tested |
 |-----------|----------------|
-| **TUnit** | 1.1.0 |
+| **TUnit** | 1.1.10 |
 | **xUnit v3** | 3.2.0 |
 | **NUnit** | 4.4.0 |
 | **MSTest** | 4.0.2 |
@@ -80,4 +80,4 @@ These benchmarks run automatically daily via [GitHub Actions](https://github.com
 Each benchmark runs multiple iterations with statistical analysis to ensure accuracy. Results may vary based on hardware and test characteristics.
 :::
 
-*Last generated: 2025-11-13T00:28:35.383Z*
+*Last generated: 2025-11-14T00:28:50.468Z*
diff --git a/docs/static/benchmarks/AsyncTests.json b/docs/static/benchmarks/AsyncTests.json
@@ -1,5 +1,5 @@
 {
-  "timestamp": "2025-11-13T00:28:35.381Z",
+  "timestamp": "2025-11-14T00:28:50.466Z",
   "category": "AsyncTests",
   "environment": {
     "benchmarkDotNetVersion": "BenchmarkDotNet v0.15.7, Linux Ubuntu 24.04.3 LTS (Noble Numbat)",
@@ -9,43 +9,43 @@
   "results": [
     {
       "Method": "TUnit",
-      "Version": "1.1.0",
-      "Mean": "551.3 ms",
-      "Error": "2.23 ms",
-      "StdDev": "1.86 ms",
-      "Median": "551.1 ms"
+      "Version": "1.1.10",
+      "Mean": "565.6 ms",
+      "Error": "4.72 ms",
+      "StdDev": "3.94 ms",
+      "Median": "564.2 ms"
     },
     {
       "Method": "NUnit",
       "Version": "4.4.0",
-      "Mean": "639.4 ms",
-      "Error": "11.51 ms",
-      "StdDev": "10.77 ms",
-      "Median": "634.6 ms"
+      "Mean": "681.8 ms",
+      "Error": "5.30 ms",
+      "StdDev": "4.42 ms",
+      "Median": "682.0 ms"
     },
     {
       "Method": "MSTest",
       "Version": "4.0.2",
-      "Mean": "612.9 ms",
-      "Error": "10.30 ms",
-      "StdDev": "9.13 ms",
-      "Median": "611.2 ms"
+      "Mean": "654.5 ms",
+      "Error": "7.43 ms",
+      "StdDev": "6.20 ms",
+      "Median": "653.4 ms"
     },
     {
       "Method": "xUnit3",
       "Version": "3.2.0",
-      "Mean": "692.8 ms",
-      "Error": "6.56 ms",
-      "StdDev": "5.81 ms",
-      "Median": "692.6 ms"
+      "Mean": "734.5 ms",
+      "Error": "9.42 ms",
+      "StdDev": "8.35 ms",
+      "Median": "736.6 ms"
     },
     {
       "Method": "TUnit_AOT",
-      "Version": "1.1.0",
-      "Mean": "122.7 ms",
-      "Error": "0.47 ms",
-      "StdDev": "0.41 ms",
-      "Median": "122.8 ms"
+      "Version": "1.1.10",
+      "Mean": "124.2 ms",
+      "Error": "0.31 ms",
+      "StdDev": "0.29 ms",
+      "Median": "124.2 ms"
     }
   ]
 }