Skip to content

Instantly share code, notes, and snippets.

@dpo

dpo/judgement.md

Last active March 13, 2026 13:51
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save dpo/945f48c4159f6f8e7094351fb918f211 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save dpo/945f48c4159f6f8e7094351fb918f211 to your computer and use it in GitHub Desktop.
Download ZIP
RegularizedOptimization repository benchmark
Raw
judgement.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmarks:
    • Target: 13 Mar 2026 - 13:49
    • Baseline: 13 Mar 2026 - 13:50
  • Package commits:
    • Target: 4507594
    • Baseline: fa54158
  • Julia commits:
    • Target: 5fe89b8
    • Baseline: 5fe89b8
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Brackets display tolerances for the benchmark estimates. Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["R2", "bpdn_B0"] 3.77 (5%) ❌ 2.89 (1%) ❌
["R2", "bpdn_l0"] 0.88 (5%) ✅ 0.99 (1%)
["R2", "bpdn_l1"] 3.21 (5%) ❌ 1.10 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Target

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        269 s          0 s        134 s        206 s          0 s  
       #2  2400 MHz        270 s          0 s        117 s        221 s          0 s  
       #3  2400 MHz        262 s          0 s        109 s        238 s          0 s  
  Memory: 7.0 GB (101.921875 MB free)
  Uptime: 608.0 sec
  Load Avg:  16.3720703125  16.1298828125  11.7568359375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Baseline

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        298 s          0 s        142 s        208 s          0 s  
       #2  2400 MHz        300 s          0 s        124 s        224 s          0 s  
       #3  2400 MHz        291 s          0 s        117 s        241 s          0 s  
  Memory: 7.0 GB (76.34375 MB free)
  Uptime: 648.0 sec
  Load Avg:  17.68603515625  16.57763671875  12.12548828125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
profiles_this_commit_vs_reference_R2.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Raw
reference.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 13:50
  • Package commit: fa54158
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 2.844 ms (5%) 642.27 KiB (1%) 946
["R2", "bpdn_l0"] 532.060 ms (5%) 3.29 MiB (1%) 176301
["R2", "bpdn_l1"] 1.990 ms (5%) 336.62 KiB (1%) 666

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        298 s          0 s        142 s        208 s          0 s  
       #2  2400 MHz        300 s          0 s        124 s        224 s          0 s  
       #3  2400 MHz        291 s          0 s        117 s        241 s          0 s  
  Memory: 7.0 GB (76.34375 MB free)
  Uptime: 648.0 sec
  Load Avg:  17.68603515625  16.57763671875  12.12548828125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Raw
tables.md

Solver Benchmarks Tables

This commit vs reference: R2_precise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 3.23e-04 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 5.73e-03 107 64 106
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.38e-02 140 76 139

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 3.06e-03 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 1.80e-03 27 26 26
BPDN/ProximalOperators.IndBallL0 8.25e-03 3.47e-03 29 29 28

This commit vs reference: R2_imprecise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 2.29e-03 41 31 40
BPDN/ProximalOperators.IndBallL0 8.25e-03 6.75e-03 64 38 63

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 1.41e-03 19 18 18
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.55e-03 19 19 18
Raw
this_commit.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 13:49
  • Package commit: 4507594
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 10.733 ms (5%) 1.81 MiB (1%) 4319
["R2", "bpdn_l0"] 469.859 ms (5%) 3.27 MiB (1%) 175079
["R2", "bpdn_l1"] 6.386 ms (5%) 369.67 KiB (1%) 2604

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        269 s          0 s        134 s        206 s          0 s  
       #2  2400 MHz        270 s          0 s        117 s        221 s          0 s  
       #3  2400 MHz        262 s          0 s        109 s        238 s          0 s  
  Memory: 7.0 GB (101.921875 MB free)
  Uptime: 608.0 sec
  Load Avg:  16.3720703125  16.1298828125  11.7568359375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_allocations.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_gctime.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_imprecise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_memory.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_precise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_time.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment