Skip to content

Instantly share code, notes, and snippets.

@dpo

dpo/judgement.md

Last active March 13, 2026 19:43
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save dpo/999e6af22d5321f9257549f6ccb605c8 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save dpo/999e6af22d5321f9257549f6ccb605c8 to your computer and use it in GitHub Desktop.
Download ZIP
RegularizedOptimization repository benchmark
Raw
judgement.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmarks:
    • Target: 13 Mar 2026 - 19:42
    • Baseline: 13 Mar 2026 - 19:42
  • Package commits:
    • Target: 68ad95f
    • Baseline: 04e910b
  • Julia commits:
    • Target: 5fe89b8
    • Baseline: 5fe89b8
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Brackets display tolerances for the benchmark estimates. Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["R2", "bpdn_B0"] 3.74 (5%) ❌ 2.89 (1%) ❌
["R2", "bpdn_l0"] 0.90 (5%) ✅ 0.99 (1%)
["R2", "bpdn_l1"] 3.15 (5%) ❌ 1.10 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Target

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        399 s          0 s        202 s        713 s          0 s  
       #2  2400 MHz        392 s          0 s        183 s        740 s          0 s  
       #3  2400 MHz        376 s          0 s        167 s        771 s          0 s  
  Memory: 7.0 GB (93.796875 MB free)
  Uptime: 1316.0 sec
  Load Avg:  2.41796875  2.98388671875  4.54541015625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Baseline

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        414 s          0 s        203 s        730 s          0 s  
       #2  2400 MHz        401 s          0 s        184 s        761 s          0 s  
       #3  2400 MHz        385 s          0 s        168 s        793 s          0 s  
  Memory: 7.0 GB (63.1875 MB free)
  Uptime: 1348.0 sec
  Load Avg:  1.8583984375  2.79248046875  4.4208984375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
profiles_this_commit_vs_reference_R2.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Raw
reference.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 19:42
  • Package commit: 04e910b
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 2.655 ms (5%) 642.27 KiB (1%) 946
["R2", "bpdn_l0"] 446.044 ms (5%) 3.29 MiB (1%) 176301
["R2", "bpdn_l1"] 1.852 ms (5%) 336.62 KiB (1%) 666

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        414 s          0 s        203 s        730 s          0 s  
       #2  2400 MHz        401 s          0 s        184 s        761 s          0 s  
       #3  2400 MHz        385 s          0 s        168 s        793 s          0 s  
  Memory: 7.0 GB (63.1875 MB free)
  Uptime: 1348.0 sec
  Load Avg:  1.8583984375  2.79248046875  4.4208984375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Raw
tables.md

Solver Benchmarks Tables

This commit vs reference: R2_precise

This commit

Name f(x) Time
BPDN/ProximalOperators.NormL0 1.79e+00 2.14e-04
BPDN/ProximalOperators.NormL1 4.98e-01 4.74e-03
BPDN/ProximalOperators.IndBallL0 8.25e-03 7.95e-03

Reference

Name f(x) Time
BPDN/ProximalOperators.NormL0 1.79e+00 2.40e-03
BPDN/ProximalOperators.NormL1 4.98e-01 1.57e-03
BPDN/ProximalOperators.IndBallL0 8.25e-03 2.76e-03

This commit vs reference: R2_imprecise

This commit

Name f(x) Time
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00
BPDN/ProximalOperators.NormL1 4.98e-01 2.12e-03
BPDN/ProximalOperators.IndBallL0 8.25e-03 4.29e-03

Reference

Name f(x) Time
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00
BPDN/ProximalOperators.NormL1 4.98e-01 1.06e-03
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.46e-03
Raw
this_commit.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 13 Mar 2026 - 19:42
  • Package commit: 68ad95f
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 9.925 ms (5%) 1.81 MiB (1%) 4319
["R2", "bpdn_l0"] 400.531 ms (5%) 3.27 MiB (1%) 175079
["R2", "bpdn_l1"] 5.841 ms (5%) 369.67 KiB (1%) 2604

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        399 s          0 s        202 s        713 s          0 s  
       #2  2400 MHz        392 s          0 s        183 s        740 s          0 s  
       #3  2400 MHz        376 s          0 s        167 s        771 s          0 s  
  Memory: 7.0 GB (93.796875 MB free)
  Uptime: 1316.0 sec
  Load Avg:  2.41796875  2.98388671875  4.54541015625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_allocations.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_gctime.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_imprecise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_memory.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_precise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_time.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment