Defining arch from args/checkpoint/default?
Created by: suchenzang
Given https://github.com/fairinternal/metaseq-internal/pull/181 , it seems like arch is not necessarily present in args in the training workflow when loading from disk. This seems like yet another case where there are multiple ways to track configuration - we should figure out why this codepath breaks for training, where args.arch is not present.