Repository navigation

big rework of algorithms and benchmark - #10

Merged

jmarecek merged 173 commits into

humancompatible:mainfrom

andrewklayk:main

May 3, 2026

Merged

big rework of algorithms and benchmark#10
jmarecek merged 173 commits into
humancompatible:mainfrom
andrewklayk:main

Commits on Dec 2, 2025
- add generator to BalancedBatchSampler
  andrewklayk
  committed
  088cf12
Commits on Dec 8, 2025
- small update to sslalmadam
  andrewklayk
  committed
  451c803
- temp for checkout
  andrewklayk
  committed
  cb02ca5
Commits on Dec 11, 2025
- barrier method added
  bosakad
  committed
  fba05fe
- tried implementing adam for ssw
  bosakad
  committed
  4093e4a
Commits on Dec 12, 2025
- adam version of ssw done
  bosakad
  committed
  2efe754
- PBM implementation done
  bosakad
  committed
  962515e
Commits on Dec 15, 2025
- testing script created
  bosakad
  committed
  9488a10
- PBM finished
  bosakad
  committed
  58bb133
Commits on Dec 16, 2025
- deterministic constraints done for PBM
  bosakad
  committed
  10d136f
- PBM stochastic done
  bosakad
  committed
  a11be5c
- PBM stochastic complicated case done
  bosakad
  committed
  54fb548
- PBM one more try
  bosakad
  committed
  096ff4d
- described the complicated case
  bosakad
  committed
  b2943cc
Commits on Dec 17, 2025
- dataset loader for dutch implemented
  bosakad
  committed
  bc9b559
Commits on Dec 18, 2025
- dutch dataset now drops small samples
  bosakad
  committed
  7c5fffe
- dutch dataloader can now drop small or keep all samples
  bosakad
  committed
  a586233
- train/test adam
  bosakad
  committed
  71503c6
- dutch adam done
  bosakad
  committed
  a829a58
- pbm + sslalm done
  bosakad
  committed
  39868fd
- ssw dutch
  bosakad
  committed
  7e8652d
Commits on Dec 19, 2025
- ssw fixed bug in jupyter
  bosakad
  committed
  1a6b423
- updated requirements
  bosakad
  committed
  f5b6d09
- new requirements.txt
  bosakad
  committed
  8ee0780
- requirements changed
  bosakad
  committed
  9b4ffe2
- removed file
  bosakad
  committed
  c83f2b9
- requirements rci done
  bosakad
  committed
  d3f2dce
Commits on Dec 22, 2025
- pbm done
  bosakad
  committed
  b676ac4
Commits on Jan 2, 2026
- PBM has now diminishing p update
  bosakad
  committed
  bc120b1
Commits on Jan 5, 2026
- add option to do one joint backward pass for obj and constr in sslalm and sslalm-adam
  andrewklayk
  committed
  8d5648c
- Merge branch 'main' of https://github.com/andrewklayk/humancompatible-train
  andrewklayk
  committed
  864c501
- cifar experimental notebook created
  bosakad
  committed
  78a1713
- cifar test done
  bosakad
  committed
  987cd48
Commits on Jan 6, 2026
- PBM is fast now - backpropagates only once per batch
  bosakad
  committed
  56cfe92
- cifar10 done for unconstrained optimization - TODO: PBM next
  bosakad
  committed
  d7dddf6
Commits on Jan 7, 2026
- cifar10 constr as a demographic parity
  bosakad
  committed
  0f01772
- cifar10 with pbm and ssw with 1 constraint - TODO: uniform constraints
  bosakad
  committed
  593c8be
- pbm, adam and ssw implemented for the cifar10
  bosakad
  committed
  091b8aa
Commits on Jan 8, 2026
- sslalm done for cifar10
  bosakad
  committed
  351f373
Commits on Jan 13, 2026
- modify sslalm_adam to do compute lagrangian and do backward inside step()
  andrewklayk
  committed
  c229a3b
- modify constrained_training.ipynb to use implicit backward in sslalm_adam
  andrewklayk
  committed
  855b70f
- fixes to new api in ssl_alm_adam.py
  andrewklayk
  committed
  b467867
- cifar10 with grid search
  bosakad
  committed
  a7616b3
- cifar10 gridsearch done + start of cifar100
  bosakad
  committed
  906101d
Commits on Jan 14, 2026
- cifar100 implemented
  bosakad
  committed
  22cf26f
- warm start for pbm done
  bosakad
  committed
  b1ae9fd
- alexnet trials
  bosakad
  committed
  9460e9f
- resnet cifar100
  bosakad
  committed
  6e7030b
- finetuning hyperparams
  bosakad
  committed
  6e740ae
- PBM: remove unnecessary warning about epoch_len when it is not used
  andrewklayk
  committed
  8f69a2b
- change sslalm to new api
  andrewklayk
  committed
  e2ea3e7
- add wrapper for benchmarking
  andrewklayk
  committed
  67f75e0
- add example of new wrapper to examples/benchmarking_copy.ipynb
  andrewklayk
  committed
  27fee60
- small changes to wrapper example
  andrewklayk
  committed
  ec24a2d
Commits on Jan 15, 2026
- cifar100 benchmarked
  bosakad
  committed
  4bbef8f
Commits on Jan 16, 2026
- benchmarking rename
  bosakad
  committed
  0c44e28
- Merge branch 'main' of github.com:andrewklayk/humancompatible-train
  bosakad
  committed
  1f9c847
- quick fix to grad bug in PBM
  andrewklayk
  committed
  3691319
- dutch dataset fixed ssl-alm
  bosakad
  committed
  cfe9fea
- PBM's zero grad is fixed in the step function
  bosakad
  committed
  e2bed3c
- update wrapper example
  andrewklayk
  committed
  ad25066
- Merge branch 'main' of https://github.com/andrewklayk/humancompatible-train
  andrewklayk
  committed
  1568000
- cifar100 benchmarking done
  bosakad
  committed
  292ebad
Commits on Jan 19, 2026
- Merge branch 'main' of github.com:andrewklayk/humancompatible-train
  bosakad
  committed
  b07f323
- cifar100 now plots only bounds
  bosakad
  committed
  93ea105
- weight reg. plots done
  bosakad
  committed
  cc4c679
- acsincome test loss included now
  bosakad
  committed
  e846d07
- acsincome vector test loss included now
  bosakad
  committed
  1acc4ef
- all plots are done: TODO: try cifar10 without balanced sampling
  bosakad
  committed
  25f239c
Commits on Jan 20, 2026
- pbm demo with two circles
  bosakad
  committed
  a29073e
- small fix to pbm bounds
  andrewklayk
  committed
  877fc81
- Merge branch 'main' of https://github.com/andrewklayk/humancompatible-train
  andrewklayk
  committed
  f1ddcbe
- weight reg benchmarking script done
  bosakad
  committed
  5f1be6d
- update pbm example
  andrewklayk
  committed
  672a58e
- Merge branch 'main' of https://github.com/andrewklayk/humancompatible-train
  andrewklayk
  committed
  418561b
- acs income vector done bechmarking script
  bosakad
  committed
  bc0863d
- Merge branch 'main' of github.com:andrewklayk/humancompatible-train
  bosakad
  committed
  3ba5f53
- pbm now accepts adam vs sgd
  bosakad
  committed
  ad61214
- timing added to the benchmarking scripts
  bosakad
  committed
  f52f75f
- benchmarking done for acsincome eq. opportunity
  bosakad
  committed
  4d1e704
- dutch benchmarking done
  bosakad
  committed
  d2808ae
- benchmarking scripts done
  bosakad
  committed
  86bafc4
- pbm demo reg. update
  bosakad
  committed
  35d15df
Commits on Jan 21, 2026
- weights benchmark had wrong threshold
  bosakad
  committed
  441dc52
- balls updates
  andrewklayk
  committed
  a62be12
- dual beta bench done
  bosakad
  committed
  3815abd
- Merge branch 'main' of github.com:andrewklayk/humancompatible-train
  bosakad
  committed
  7ad908b
- cifar10 started
  bosakad
  committed
  14ea810
Commits on Jan 22, 2026
- cifar10 and cifar100 benchmarking scripts done
  bosakad
  committed
  f8f72a9
- PBM has now hardcoded derivative and it improves speed slightly
  bosakad
  committed
  a570f0a
- cifar10 and cifar100 benchmarking script is now working
  bosakad
  committed
  086c9f3
Commits on Jan 23, 2026
- dutch now splits 60/20/20
  bosakad
  committed
  0a3f124
- weights now do 60/20/20 validation + also plots test loss
  bosakad
  committed
  87ce25a
- acsincome vector 60/20/20 done
  bosakad
  committed
  0d12ece
- gridsearch for cifar10 implemented
  bosakad
  committed
  2c1aa39
- cifar10 batch size=120
  bosakad
  committed
  3d484a6
- gridsearch cifar100 done + restructured scripts
  bosakad
  committed
  09d279b
- PBM runs with the speed of light!
  bosakad
  committed
  ec1f62d
- cifar10 seeds update
  bosakad
  committed
  3b9a8f0
- adaptive work started
  bosakad
  committed
  d9c551f
- adaptive done
  bosakad
  committed
  48094ce
- cifar10 now works vectorized - bug with device
  bosakad
  committed
  81bcf9c
Commits on Jan 24, 2026
- cifars now accept adaptive as option
  bosakad
  committed
  56cacd0
- fixed issue with testing data in cifar10
  bosakad
  committed
  7ccc1d8
Commits on Jan 25, 2026
- pbm now skips nans
  bosakad
  committed
  25ee1ac
- set correct value for cifar100 adam
  bosakad
  committed
  cbaaf01
- pbm ub is now fixed with nan
  bosakad
  committed
  f12b4f4
Commits on Jan 26, 2026
- berrier had issue with .backward calls
  bosakad
  committed
  764e585
- benchmarking notebook updated markdown
  bosakad
  committed
  6fca2c1
- add vectorized dual_steps method
  andrewklayk
  committed
  72660ad
Commits on Jan 27, 2026
- cifar10 and cifar100 now runs vectorized
  bosakad
  committed
  1efffca
- vectorized ssw + timing is now without logging
  bosakad
  committed
  2e35816
- plot demo balls example is done
  bosakad
  committed
  226ced3
- vecorized loss per class
  bosakad
  committed
  029ef0f
- predcomputed values
  bosakad
  committed
  2a0afe1
Commits on Feb 4, 2026
- changed requirements.txt
  
  Adam Bosák
  authored and
  Adam Bosák
  committed
  65d208a
- PBM implemented forward method
  
  Adam Bosák
  authored and
  Adam Bosák
  committed
  f26bcae
- PBM has now forward function - TODO: implement smoothing
  
  Adam Bosák
  authored and
  Adam Bosák
  committed
  e8220ef
Commits on Feb 5, 2026
- new api for alm, moreau
  andrewklayk
  committed
  4eff1a6
- work on new algs
  andrewklayk
  committed
  0b202fa
Commits on Feb 6, 2026
- add fixes to alm, moreau
  andrewklayk
  committed
  b2a31db
- first version of alm, pbm, moreau
  andrewklayk
  committed
  b46a042
Commits on Feb 11, 2026
- add momentum to dual updates
  andrewklayk
  committed
  6d6a413
- update MSD integration
  andrewklayk
  committed
  7fc2c4d
Commits on Feb 12, 2026
- minor updates to new classes
  andrewklayk
  committed
  49f809d
Commits on Feb 17, 2026
- add manual dimin lr for pbm
  andrewklayk
  committed
  c402cd4
- update constrained_training.ipynb to use dual
  andrewklayk
  committed
  815356f
- move benchmarks to separate repository
  andrewklayk
  committed
  9668a53
- fix bug in penalty term in alm: remove square
  andrewklayk
  committed
  d7296da
- rework unit tests
  andrewklayk
  committed
  84acf55
- tweak pbm add_constraint_group
  andrewklayk
  committed
  a2139b1
- add basic example
  andrewklayk
  committed
  7eee6f2
- update minor examples
  andrewklayk
  committed
  5caaaee
- update readme
  andrewklayk
  committed
  9716114
Commits on Feb 18, 2026
- add save and load state_dict to duals
  andrewklayk
  committed
  7685537
- add device setting to dual optimizers
  andrewklayk
  committed
  6b4173b
Commits on Feb 19, 2026
- tweak initial parameters of pbm
  andrewklayk
  committed
  aaf259a
Commits on Feb 26, 2026
- cosmetic changes to dual_optim files
  andrewklayk
  committed
  fa9f420
- remove dataset files from repo
  andrewklayk
  committed
  3dc718f
- Merge https://github.com/humancompatible/train
  andrewklayk
  committed
  aec9e0a
Commits on Mar 4, 2026
- add new benchmark
  andrewklayk
  committed
  c7fa5cf
- fixes to new benchmark
  andrewklayk
  committed
  9e98a37
- benchmark improvements
  andrewklayk
  committed
  9818d9f
Commits on Mar 5, 2026
- update benchmark
  andrewklayk
  committed
  c7c68c3
Commits on Mar 12, 2026
- pbm now allows for a second variant of the pbm - more steps of the primal update
  Adam Bosák
  committed
  d121db8
- pbm new dual and penalty update strategies
  andrewklayk
  committed
  9f5e0b2
- update pyproject.toml and tests
  andrewklayk
  committed
  7fa2212
Commits on Mar 24, 2026
- change benchmark to basic Hydra config
  andrewklayk
  committed
  1900f37
- minor changes to pbm & cleanup
  andrewklayk
  committed
  eb976df
- rework pbm lambda updateto smoothing
  andrewklayk
  committed
  9ac57e7
Commits on Mar 31, 2026
- rename pbm params
  andrewklayk
  committed
  cfca72e
Commits on Apr 2, 2026
- rename mu to p_lr
  andrewklayk
  committed
  e61d5ca
- change pbm defaults
  andrewklayk
  committed
  3b30ef1
Commits on Apr 6, 2026
- rework benchmark constraint system; TODO multiple constraints
  andrewklayk
  committed
  b56c1af
- Merge branch 'dev'
  andrewklayk
  committed
  ddb4ea2
- modify hydra configs for benchmark
  andrewklayk
  committed
  41492d5
- modify hydra configs for benchmark
  andrewklayk
  committed
  5e8df60
- fix bug in run_benchmark
  andrewklayk
  committed
  6a0c0cf
- Merge branch 'dev'
  andrewklayk
  committed
  a93a954
Commits on Apr 7, 2026
- bring pbm notation in line with paper
  andrewklayk
  committed
  2aaa5ec
- change default gamma for pbm
  andrewklayk
  committed
  0329c02
- fix bug in benchmark loop
  andrewklayk
  committed
  5c9635a
- fix PBM.update_penalties()
  andrewklayk
  committed
  7528141
- update benchmark
  andrewklayk
  committed
  3ee46f5
- gitignore update
  andrewklayk
  committed
  9b75498
Commits on Apr 8, 2026
- bugfixes to pbm
  andrewklayk
  committed
  f99b9dd
- update examples
  andrewklayk
  committed
  b0efaa1
- pbm tests
  andrewklayk
  committed
  014603c
- pbm docstring update
  andrewklayk
  committed
  570c9d6
Commits on Apr 16, 2026
- update pde example to a more challenging one
  andrewklayk
  committed
  61f718e
Commits on May 1, 2026
- benchmark update for neurips
  andrewklayk
  committed
  9a65f25
- bug
  andrewklayk
  committed
  57d7b6b
Commits on May 2, 2026
- oat sensitivity analysis done
  bosakad1
  committed
  f9547a1

Commits

Commits on Dec 2, 2025

Commits on Dec 8, 2025

Commits on Dec 11, 2025

Commits on Dec 12, 2025

Commits on Dec 15, 2025

Commits on Dec 16, 2025

Commits on Dec 17, 2025

Commits on Dec 18, 2025

Commits on Dec 19, 2025

Commits on Dec 22, 2025

Commits on Jan 2, 2026

Commits on Jan 5, 2026

Commits on Jan 6, 2026

Commits on Jan 7, 2026

Commits on Jan 8, 2026

Commits on Jan 13, 2026

Commits on Jan 14, 2026

Commits on Jan 15, 2026

Commits on Jan 16, 2026

Commits on Jan 19, 2026

Commits on Jan 20, 2026

Commits on Jan 21, 2026

Commits on Jan 22, 2026

Commits on Jan 23, 2026

Commits on Jan 24, 2026

Commits on Jan 25, 2026

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Feb 4, 2026