beta v0.0.1
Pre-release
Pre-release
Insight
The AdamR optimizer which tends to maintain the parameters from pre-training.
TODOs
- a basic AdamR optimzer, just like other PyTorch optimizers
- refine the documentations
- provide a function to specify initial parameters