chunked/nltk_chunking/model_doc_speecht5/chunk_4.txt

Leveraging large-scale unlabeled speech and text data, we pre-train SpeechT5 to learn a unified-modal representation, hoping to improve the modeling capability for both speech and text.