[SpeechEncoderDecoderModel] can be randomly initialized from an encoder and a decoder config.