Releases: TYTTYTTYT/AdamR
Releases · TYTTYTTYT/AdamR
beta v0.0.2
beta v0.0.1
Insight
The AdamR optimizer which tends to maintain the parameters from pre-training.
TODOs
- a basic AdamR optimzer, just like other PyTorch optimizers
- refine the documentations
- provide a function to specify initial parameters