chunked/nltk_chunking/model_doc_speecht5/chunk_5.txt

To align the textual and speech information into this unified semantic space, we propose a cross-modal vector quantization approach that randomly mixes up speech/text states with latent units as the interface between encoder and decoder.