You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: configs/ada/README.md
+12-7Lines changed: 12 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,18 +1,19 @@
1
1
# ADA
2
2
3
3
> [Training Generative Adversarial Networks with Limited Data](https://arxiv.org/pdf/2006.06676.pdf)
4
+
4
5
<!-- [ALGORITHM] -->
5
6
6
7
## Abstract
8
+
7
9
Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes training in limited data regimes. The approach does not require changes to loss functions or network architectures, and is applicable both when training from scratch and when fine-tuning an existing GAN on another dataset. We demonstrate, on several datasets, that good results are now possible using only a few thousand training images, often matching StyleGAN2 results with an order of magnitude fewer images. We expect this to open up new application domains for GANs. We also find that the widely used CIFAR-10 is, in fact, a limited data benchmark, and improve the record FID from 5.59 to 2.42.
Currently we only implement ada for StyleGANv2/v3. To use this training trick. You should use `ADAStyleGAN2Discriminator` as your discriminator.
31
32
32
33
An example:
34
+
33
35
```python
34
36
model =dict(
35
37
xxx,
@@ -40,9 +42,11 @@ model = dict(
40
42
xxx
41
43
)
42
44
```
45
+
43
46
Here, you can adjust `ada_kimg` to change the magnitude of augmentation(The smaller the value, the greater the magnitude).
44
47
45
48
`aug_kwargs` is usually set as follows:
49
+
46
50
```python
47
51
aug_kwargs = {
48
52
'xflip': 1,
@@ -59,6 +63,7 @@ aug_kwargs = {
59
63
'saturation': 1
60
64
}
61
65
```
66
+
62
67
Here, the number is Probability multiplier for each operation. For details, you can refer to [augment](https://github.com/open-mmlab/mmgeneration/tree/master/mmgen/models/architectures/stylegan/ada/augment.py).
63
68
64
69
## Citation
@@ -70,4 +75,4 @@ Here, the number is Probability multiplier for each operation. For details, you
0 commit comments