bug: incorrect logic in GAE calculation

[vwxyzjn]

Description

#334 actually introduced a major bug... It's totally my bad 🙈

        storage = storage.replace(
            advantages=advantages,
            returns=storage.advantages + storage.values,
        )

should have been the following because storage.advantages has zero values.

        storage = storage.replace(
            advantages=advantages,
            returns=advantages + storage.values,
        )

Types of changes

• Bug fix
• New feature
• New algorithm
• Documentation

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated
cleanrl	✅ Ready (Inspect)	Visit Preview	Dec 31, 2022 at 10:58PM (UTC)

[51616]

This looks correct to me. Btw, did the gae test in #334 run correctly? Seems like the bug is in the test file as well.