use_fuse_mask_softmax#412

Open

xiezipeng-ML wants to merge 3 commits intomainfrom

use_fuse_mask_softmax

Commits on Oct 28, 2022

use fuse multi head att

xiezipeng-ML
authored and
xiezipeng-ML
committed
use batch size = 4, acc step = 8, amp, open Checkpointing
xiezipeng-ML
committed

Commits on Nov 1, 2022

add activation checkpoint
xiezipeng-ML
committed