Skip to content

BENCHMARK_RESULTS_NEO.md

Latest commit

 

History

History
140 lines (116 loc) · 12.5 KB

BENCHMARK_RESULTS_NEO.md

File metadata and controls

140 lines (116 loc) · 12.5 KB

Benchmark Performance Results

This report compares the performance of the interactive benchmark application running in two different modes:

  • Development Mode
  • Production Mode

The data is aggregated over 5 run(s). The value in parentheses (±) is the standard deviation.

Duration Benchmarks

This table shows the average execution time in milliseconds (ms). Lower is better.

Benchmark Browser Dev Mode (ms) Prod Mode (ms) Improvement
Clear Rows
chromium 11.00 (±1.14) 9.22 (±2.95) +16.18%
firefox 12.00 (±3.58) 10.00 (±2.10) +16.67%
webkit 7.40 (±1.50) 8.20 (±2.40) -10.81%
Average 10.13 9.14 +9.80%
--------------------------- ------------ --------------- ---------------- -------------
Create 100k Rows
chromium 70.88 (±10.47) 66.34 (±9.18) +6.41%
firefox 73.60 (±6.62) 69.60 (±5.39) +5.43%
webkit 86.20 (±16.23) 76.80 (±12.25) +10.90%
Average 76.89 70.91 +7.78%
--------------------------- ------------ --------------- ---------------- -------------
Create 10k Rows
chromium 40.48 (±2.15) 17.98 (±6.39) +55.58%
firefox 23.00 (±5.62) 22.20 (±5.27) +3.48%
webkit 31.20 (±5.91) 32.80 (±3.71) -5.13%
Average 31.56 24.33 +22.92%
--------------------------- ------------ --------------- ---------------- -------------
Create 1M Rows
chromium 550.82 (±12.50) 553.54 (±16.35) -0.49%
firefox 708.80 (±31.95) 706.00 (±42.41) +0.40%
webkit 535.60 (±16.74) 515.80 (±26.72) +3.70%
Average 598.41 591.78 +1.11%
--------------------------- ------------ --------------- ---------------- -------------
Remove Row
chromium 0.70 (±0.06) 0.64 (±0.05) +8.57%
firefox 0.80 (±0.40) 0.60 (±0.49) +25.00%
webkit 0.60 (±0.49) 1.00 (±0.00) -66.67%
Average 0.70 0.75 -6.67%
--------------------------- ------------ --------------- ---------------- -------------
Select Row
chromium 12.12 (±4.72) 13.62 (±6.26) -12.38%
firefox 9.00 (±2.61) 11.60 (±4.41) -28.89%
webkit 6.00 (±0.00) 6.80 (±1.60) -13.33%
Average 9.04 10.67 -18.07%
--------------------------- ------------ --------------- ---------------- -------------
Swap Rows
chromium 15.74 (±2.79) 17.84 (±2.45) -13.34%
firefox 19.80 (±2.14) 15.80 (±5.42) +20.20%
webkit 9.40 (±5.31) 6.20 (±0.40) +34.04%
Average 14.98 13.28 +11.35%
--------------------------- ------------ --------------- ---------------- -------------
Update Every 10th Row
chromium 28.94 (±1.70) 29.10 (±1.16) -0.55%
firefox 36.40 (±8.11) 39.00 (±7.01) -7.14%
webkit 30.40 (±0.49) 30.60 (±0.49) -0.66%
Average 31.91 32.90 -3.09%
--------------------------- ------------ --------------- ---------------- -------------

UI Responsiveness Benchmarks

This table shows the average Frames Per Second (FPS) and the count of "Long Frames" (frames taking >50ms) during a 4-second test. For FPS, higher is better. For Long Frames, lower is better.

Benchmark Browser Dev Mode (FPS / Long Frames) Prod Mode (FPS / Long Frames)
Heavy Calculation (App Worker)
chromium 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
firefox 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
webkit 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.2 (±0.4)
--------------------------------------------- ------------ ------------------------------ -------------------------------
Heavy Calculation (Task Worker)
chromium 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
firefox 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
webkit 60.0 (±0.0) / 0.0 (±0.0) 59.8 (±0.4) / 0.0 (±0.0)
--------------------------------------------- ------------ ------------------------------ -------------------------------
Real-time Feed
chromium 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
firefox 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.0 (±0.0)
webkit 60.0 (±0.0) / 0.0 (±0.0) 60.0 (±0.0) / 0.2 (±0.4)
--------------------------------------------- ------------ ------------------------------ -------------------------------

Scrolling Fluidity Benchmarks

This table shows metrics related to how smoothly content updates during a scroll. For all metrics, lower is better.

Benchmark Browser Dev Mode (Avg Time to Valid State / Max Time to Valid State) Dev Mode (Update Success Rate) Prod Mode (Avg Time to Valid State / Max Time to Valid State) Prod Mode (Update Success Rate)
Scrolling Performance Under Duress 100k Rows
chromium 43.61 (±2.19) 100.00 (±0.00)% 41.95 (±2.75) 100.00 (±0.00)%
firefox 45.19 (±0.35) 100.00 (±0.00)% 46.19 (±0.71) 100.00 (±0.00)%
webkit 53.25 (±1.11) 100.00 (±0.00)% 52.09 (±1.16) 100.00 (±0.00)%
--------------------------------------------- ------------ -------------------------------------------------------------- -------------------------------- --------------------------------------------------------------- ---------------------------------
Scrolling Performance Under Duress 10k Rows
chromium 33.86 (±1.52) 100.00 (±0.00)% 33.76 (±0.76) 100.00 (±0.00)%
firefox 37.33 (±1.66) 100.00 (±0.00)% 37.09 (±2.43) 100.00 (±0.00)%
webkit 45.64 (±1.92) 100.00 (±0.00)% 46.56 (±1.15) 100.00 (±0.00)%
--------------------------------------------- ------------ -------------------------------------------------------------- -------------------------------- --------------------------------------------------------------- ---------------------------------
Scrolling Performance Under Duress 1M Rows
chromium 67.79 (±2.05) 100.00 (±0.00)% 67.06 (±2.18) 100.00 (±0.00)%
firefox N/A N/A N/A N/A
webkit 202.98 (±4.49) 100.00 (±0.00)% 198.61 (±1.95) 100.00 (±0.00)%
--------------------------------------------- ------------ -------------------------------------------------------------- -------------------------------- --------------------------------------------------------------- ---------------------------------

Browser Versions

Browser Version
Chrome Google Chrome 139.0.7258.128
Firefox Mozilla Firefox 141.0.3
Safari Safari kMDItemVersion = "18.5"

System Information

Property Value
OS Name macOS
OS Version 15.5
Total RAM 64GB
CPU Cores 16
Node.js v22.3.0
Playwright 1.54.2
Platform darwin
Architecture x64

Known Issues

  • React benchmark: Create 1M rows (Firefox): This test is skipped for Firefox due to known Out-of-Memory issues when attempting to render 1 million rows.

This file is auto-generated. Do not edit manually.