Created
August 11, 2025 14:35
-
-
Save jsign/70bc542b0a14284630bd02ba97564eae to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Loading baseline metrics from: /home/ignacio/code/zkevm-benchmark-workload/zkevm-metrics-master | |
| Found subfolders with metrics: ['sp1-v5.1.0'] | |
| Loaded 100 baseline files | |
| Loading optimized metrics from: /home/ignacio/code/zkevm-benchmark-workload/zkevm-metrics | |
| Found subfolders with metrics: ['sp1-v5.1.0'] | |
| Loaded 100 optimized files | |
| Calculating speedups... | |
| Found 100 common files with 8 regions | |
| Regions found: block_execution, decode_headers, post_state_compute, read_input, recover_signers, validation, verify_witness, total_num_cycles | |
| ================================================================================ | |
| SPEEDUP COMPARISON TABLE | |
| ================================================================================ | |
| File block_execution decode_headers post_state_computeread_input recover_signers validation verify_witness total_num_cycles | |
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | |
| sp1-v5.1.0/rpc_block_22974575 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974576 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974577 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974578 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974579 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974580 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974581 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974582 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974583 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974584 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974585 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974586 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974587 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974588 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974589 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974590 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974591 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974592 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974593 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974594 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974595 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974596 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974597 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974598 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974599 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974600 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974601 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974602 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974603 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974604 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974605 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974606 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974607 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974608 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974609 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974610 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974611 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974612 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974613 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974614 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974615 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974616 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974617 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974618 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974619 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974620 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974621 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974622 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974623 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974624 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974625 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974626 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974627 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974628 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974629 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974630 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974631 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974632 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974633 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974634 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974635 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974636 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.01x 1.00x | |
| sp1-v5.1.0/rpc_block_22974637 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974638 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974639 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974640 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974641 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974642 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974643 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974644 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974645 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974646 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974647 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974648 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974649 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974650 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974651 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974652 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974653 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974654 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974655 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974656 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974657 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974658 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974659 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974660 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974661 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974662 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974663 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974664 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974665 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974666 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974667 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974668 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974669 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974670 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974671 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974672 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974673 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x | |
| sp1-v5.1.0/rpc_block_22974674 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x | |
| ================================================================================ | |
| ANALYSIS | |
| ================================================================================ | |
| OVERALL SUMMARY: | |
| Note: Speedup < 1.0x means the optimized version is slower (regression) | |
| Speedup > 1.0x means the optimized version is faster (improvement) | |
| BLOCK EXECUTION: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974636: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974665: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974674: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974657: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974621: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974651: 1.00x | |
| DECODE HEADERS: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974635: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974628: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974597: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974577: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974631: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974609: 1.00x | |
| POST STATE COMPUTE: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974608: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974627: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974597: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974666: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974595: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974616: 1.00x | |
| READ INPUT: | |
| Average speedup: 0.99x (-1.0%) | |
| Min speedup: 0.98x | |
| Max speedup: 0.99x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974639: 0.99x | |
| 2. sp1-v5.1.0/rpc_block_22974609: 0.99x | |
| 3. sp1-v5.1.0/rpc_block_22974674: 0.99x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974599: 0.98x | |
| 2. sp1-v5.1.0/rpc_block_22974653: 0.98x | |
| 3. sp1-v5.1.0/rpc_block_22974673: 0.98x | |
| RECOVER SIGNERS: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974673: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974653: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974576: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974639: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974623: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974578: 1.00x | |
| VALIDATION: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974636: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974665: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974674: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974621: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974657: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974651: 1.00x | |
| VERIFY WITNESS: | |
| Average speedup: 1.00x (+0.1%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.01x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974636: 1.01x | |
| 2. sp1-v5.1.0/rpc_block_22974674: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974665: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974657: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974673: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974651: 1.00x | |
| TOTAL NUM CYCLES: | |
| Average speedup: 1.00x (+0.0%) | |
| Min speedup: 1.00x | |
| Max speedup: 1.00x | |
| Top 3 best speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974636: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974665: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974674: 1.00x | |
| Top 3 worst speedups: | |
| 1. sp1-v5.1.0/rpc_block_22974657: 1.00x | |
| 2. sp1-v5.1.0/rpc_block_22974651: 1.00x | |
| 3. sp1-v5.1.0/rpc_block_22974673: 1.00x | |
| ================================================================================ | |
| KEY FINDINGS | |
| ================================================================================ | |
| Regions ranked by average speedup: | |
| 1. Verify Witness: 1.00x (+0.1%) - NO CHANGE | |
| 2. Validation: 1.00x (+0.0%) - NO CHANGE | |
| 3. Post State Compute: 1.00x (+0.0%) - NO CHANGE | |
| 4. Block Execution: 1.00x (+0.0%) - NO CHANGE | |
| 5. Recover Signers: 1.00x (+0.0%) - NO CHANGE | |
| 6. Decode Headers: 1.00x (+0.0%) - NO CHANGE | |
| 7. Read Input: 0.99x (-1.0%) - REGRESSION | |
| Total files analyzed: 100 | |
| 🎯 OVERALL PERFORMANCE (Total Num Cycles): 1.00x (+0.0%) - NO CHANGE |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment