Skip to content

Instantly share code, notes, and snippets.

@jsign

jsign/cmp_master_vs_chainconfig_pr

Created August 11, 2025 14:35
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save jsign/70bc542b0a14284630bd02ba97564eae to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save jsign/70bc542b0a14284630bd02ba97564eae to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cmp_master_vs_chainconfig_pr
Loading baseline metrics from: /home/ignacio/code/zkevm-benchmark-workload/zkevm-metrics-master
Found subfolders with metrics: ['sp1-v5.1.0']
Loaded 100 baseline files
Loading optimized metrics from: /home/ignacio/code/zkevm-benchmark-workload/zkevm-metrics
Found subfolders with metrics: ['sp1-v5.1.0']
Loaded 100 optimized files
Calculating speedups...
Found 100 common files with 8 regions
Regions found: block_execution, decode_headers, post_state_compute, read_input, recover_signers, validation, verify_witness, total_num_cycles
================================================================================
SPEEDUP COMPARISON TABLE
================================================================================
File block_execution decode_headers post_state_computeread_input recover_signers validation verify_witness total_num_cycles
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
sp1-v5.1.0/rpc_block_22974575 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974576 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974577 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974578 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974579 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974580 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974581 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974582 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974583 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974584 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974585 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974586 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974587 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974588 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974589 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974590 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974591 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974592 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974593 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974594 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974595 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974596 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974597 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974598 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974599 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974600 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974601 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974602 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974603 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974604 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974605 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974606 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974607 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974608 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974609 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974610 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974611 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974612 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974613 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974614 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974615 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974616 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974617 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974618 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974619 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974620 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974621 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974622 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974623 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974624 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974625 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974626 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974627 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974628 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974629 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974630 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974631 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974632 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974633 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974634 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974635 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974636 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.01x 1.00x
sp1-v5.1.0/rpc_block_22974637 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974638 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974639 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974640 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974641 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974642 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974643 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974644 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974645 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974646 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974647 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974648 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974649 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974650 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974651 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974652 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974653 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974654 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974655 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974656 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974657 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974658 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974659 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974660 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974661 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974662 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974663 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974664 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974665 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974666 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974667 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974668 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974669 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974670 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974671 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974672 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974673 1.00x 1.00x 1.00x 0.98x 1.00x 1.00x 1.00x 1.00x
sp1-v5.1.0/rpc_block_22974674 1.00x 1.00x 1.00x 0.99x 1.00x 1.00x 1.00x 1.00x
================================================================================
ANALYSIS
================================================================================
OVERALL SUMMARY:
Note: Speedup < 1.0x means the optimized version is slower (regression)
Speedup > 1.0x means the optimized version is faster (improvement)
BLOCK EXECUTION:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974636: 1.00x
2. sp1-v5.1.0/rpc_block_22974665: 1.00x
3. sp1-v5.1.0/rpc_block_22974674: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974657: 1.00x
2. sp1-v5.1.0/rpc_block_22974621: 1.00x
3. sp1-v5.1.0/rpc_block_22974651: 1.00x
DECODE HEADERS:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974635: 1.00x
2. sp1-v5.1.0/rpc_block_22974628: 1.00x
3. sp1-v5.1.0/rpc_block_22974597: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974577: 1.00x
2. sp1-v5.1.0/rpc_block_22974631: 1.00x
3. sp1-v5.1.0/rpc_block_22974609: 1.00x
POST STATE COMPUTE:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974608: 1.00x
2. sp1-v5.1.0/rpc_block_22974627: 1.00x
3. sp1-v5.1.0/rpc_block_22974597: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974666: 1.00x
2. sp1-v5.1.0/rpc_block_22974595: 1.00x
3. sp1-v5.1.0/rpc_block_22974616: 1.00x
READ INPUT:
Average speedup: 0.99x (-1.0%)
Min speedup: 0.98x
Max speedup: 0.99x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974639: 0.99x
2. sp1-v5.1.0/rpc_block_22974609: 0.99x
3. sp1-v5.1.0/rpc_block_22974674: 0.99x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974599: 0.98x
2. sp1-v5.1.0/rpc_block_22974653: 0.98x
3. sp1-v5.1.0/rpc_block_22974673: 0.98x
RECOVER SIGNERS:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974673: 1.00x
2. sp1-v5.1.0/rpc_block_22974653: 1.00x
3. sp1-v5.1.0/rpc_block_22974576: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974639: 1.00x
2. sp1-v5.1.0/rpc_block_22974623: 1.00x
3. sp1-v5.1.0/rpc_block_22974578: 1.00x
VALIDATION:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974636: 1.00x
2. sp1-v5.1.0/rpc_block_22974665: 1.00x
3. sp1-v5.1.0/rpc_block_22974674: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974621: 1.00x
2. sp1-v5.1.0/rpc_block_22974657: 1.00x
3. sp1-v5.1.0/rpc_block_22974651: 1.00x
VERIFY WITNESS:
Average speedup: 1.00x (+0.1%)
Min speedup: 1.00x
Max speedup: 1.01x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974636: 1.01x
2. sp1-v5.1.0/rpc_block_22974674: 1.00x
3. sp1-v5.1.0/rpc_block_22974665: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974657: 1.00x
2. sp1-v5.1.0/rpc_block_22974673: 1.00x
3. sp1-v5.1.0/rpc_block_22974651: 1.00x
TOTAL NUM CYCLES:
Average speedup: 1.00x (+0.0%)
Min speedup: 1.00x
Max speedup: 1.00x
Top 3 best speedups:
1. sp1-v5.1.0/rpc_block_22974636: 1.00x
2. sp1-v5.1.0/rpc_block_22974665: 1.00x
3. sp1-v5.1.0/rpc_block_22974674: 1.00x
Top 3 worst speedups:
1. sp1-v5.1.0/rpc_block_22974657: 1.00x
2. sp1-v5.1.0/rpc_block_22974651: 1.00x
3. sp1-v5.1.0/rpc_block_22974673: 1.00x
================================================================================
KEY FINDINGS
================================================================================
Regions ranked by average speedup:
1. Verify Witness: 1.00x (+0.1%) - NO CHANGE
2. Validation: 1.00x (+0.0%) - NO CHANGE
3. Post State Compute: 1.00x (+0.0%) - NO CHANGE
4. Block Execution: 1.00x (+0.0%) - NO CHANGE
5. Recover Signers: 1.00x (+0.0%) - NO CHANGE
6. Decode Headers: 1.00x (+0.0%) - NO CHANGE
7. Read Input: 0.99x (-1.0%) - REGRESSION
Total files analyzed: 100
🎯 OVERALL PERFORMANCE (Total Num Cycles): 1.00x (+0.0%) - NO CHANGE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment