Skip to content

Instantly share code, notes, and snippets.

@dpo

dpo/judgement.md

Last active March 13, 2026 14:30
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save dpo/9c2701b731f97c34e95bfb1d00f79a97 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save dpo/9c2701b731f97c34e95bfb1d00f79a97 to your computer and use it in GitHub Desktop.
Download ZIP
RegularizedOptimization repository benchmark
Raw
judgement.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmarks:
    • Target: 13 Mar 2026 - 14:28
    • Baseline: 13 Mar 2026 - 14:29
  • Package commits:
    • Target: 4507594
    • Baseline: fa54158
  • Julia commits:
    • Target: 5fe89b8
    • Baseline: 5fe89b8
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Brackets display tolerances for the benchmark estimates. Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["R2", "bpdn_B0"] 3.46 (5%) ❌ 2.89 (1%) ❌
["R2", "bpdn_l0"] 0.92 (5%) ✅ 0.99 (1%)
["R2", "bpdn_l1"] 3.21 (5%) ❌ 1.10 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Target

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz         96 s          0 s         64 s        114 s          0 s  
       #2  2400 MHz         97 s          0 s         51 s        126 s          0 s  
       #3  2400 MHz         91 s          0 s         47 s        136 s          0 s  
  Memory: 7.0 GB (78.640625 MB free)
  Uptime: 274.0 sec
  Load Avg:  7.8427734375  15.560546875  8.966796875
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Baseline

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        117 s          0 s         70 s        126 s          0 s  
       #2  2400 MHz        118 s          0 s         56 s        139 s          0 s  
       #3  2400 MHz        112 s          0 s         52 s        149 s          0 s  
  Memory: 7.0 GB (121.78125 MB free)
  Uptime: 313.0 sec
  Load Avg:  9.376953125  14.962890625  9.0478515625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
profiles_this_commit_vs_reference_R2.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Raw
reference.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 14:29
  • Package commit: fa54158
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 2.887 ms (5%) 642.27 KiB (1%) 946
["R2", "bpdn_l0"] 457.136 ms (5%) 3.29 MiB (1%) 176301
["R2", "bpdn_l1"] 1.863 ms (5%) 336.62 KiB (1%) 666

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        117 s          0 s         70 s        126 s          0 s  
       #2  2400 MHz        118 s          0 s         56 s        139 s          0 s  
       #3  2400 MHz        112 s          0 s         52 s        149 s          0 s  
  Memory: 7.0 GB (121.78125 MB free)
  Uptime: 313.0 sec
  Load Avg:  9.376953125  14.962890625  9.0478515625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Raw
tables.md

Solver Benchmarks Tables

This commit vs reference: R2_precise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 2.66e-04 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 6.42e-03 107 64 106
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.18e-02 140 76 139

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 5.28e-03 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 2.64e-03 27 26 26
BPDN/ProximalOperators.IndBallL0 8.25e-03 3.67e-03 29 29 28

This commit vs reference: R2_imprecise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 4.19e-03 41 31 40
BPDN/ProximalOperators.IndBallL0 8.25e-03 4.73e-03 64 38 63

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 1.19e-03 19 18 18
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.70e-03 19 19 18
Raw
this_commit.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 14:28
  • Package commit: 4507594
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 9.999 ms (5%) 1.81 MiB (1%) 4319
["R2", "bpdn_l0"] 419.413 ms (5%) 3.27 MiB (1%) 175079
["R2", "bpdn_l1"] 5.986 ms (5%) 369.67 KiB (1%) 2604

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz         96 s          0 s         64 s        114 s          0 s  
       #2  2400 MHz         97 s          0 s         51 s        126 s          0 s  
       #3  2400 MHz         91 s          0 s         47 s        136 s          0 s  
  Memory: 7.0 GB (78.640625 MB free)
  Uptime: 274.0 sec
  Load Avg:  7.8427734375  15.560546875  8.966796875
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_allocations.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_gctime.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_imprecise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_memory.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_precise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_time.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment