before_revision: Following each patient visit, physicians must draft detailed clinical summaries called SOAP notes . Moreover, with electronic health records, these notes must be digitized. For all the benefits of this documentation the process remains onerous , contributing to increasing physician burnout. In a parallel development, patients increasingly record audio from their visits (with consent), often through dedicated apps. In this paper, we present the first study to evaluate complete pipelines for leveraging these transcripts to train machine learning model to  generate these notes . We first describe a unique dataset of patient visit records, consisting of transcripts , paired SOAP notes, and annotations marking noteworthy utterances that support each summary sentence. We decompose the problem into extractive and abstractive subtasks, exploring a spectrum of approaches according to how much they demand from each component.  Our best performing method first (i) extracts noteworthy utterances via multi-label classification assigns them to summary section(s); (ii) clusters noteworthy utterances on a per-section basis; and (iii) generates the summary sentences by conditioning on the corresponding cluster and the subsection of the SOAP sentence to be generated. Compared to an end-to-end approach that generates the full SOAP note from the full conversation, our approach improves by 7 ROUGE-1 points . Oracle experiments indicate that fixing our generative capabilities, improvements in extraction alone could provide (up to) a further 9 ROUGE point gain .
after_revision: Following each patient visit, physicians must draft a detailed clinical summary called a SOAP note . Moreover, with electronic health records, these notes must be digitized. Despite the benefits of this documentation , their creation remains an onerous process , contributing to increasing physician burnout. In this paper, we present the first study to evaluate complete pipelines to train summarization models to generate these notes from conversations between physicians and patients. We benefit from a dataset that, along with transcripts and paired SOAP notes, consists of annotations marking noteworthy utterances that support each summary sentence. We decompose the problem into extractive and abstractive subtasks, exploring a spectrum of approaches according to how much they demand from each component. We observe that the performance improves constantly as the extractive subtask is made more complex - an observation that we also replicate on the well-known AMI meeting summarization dataset. Our best performing method first (i) extracts noteworthy utterances via multi-label classification , assigning each to summary section(s); (ii) clusters noteworthy utterances on a per-section basis; and (iii) generates the summary sentences by conditioning on the corresponding cluster and the subsection of the SOAP sentence to be generated. Compared to an end-to-end approach that generates the full SOAP note from the full conversation, our approach improves by around 8 ROUGE-1 points .
edit_actions: R
edit_actions: detailed clinical summaries called SOAP notes
edit_actions: a detailed clinical summary called a SOAP note
edit_actions: clarity
edit_actions: clarity style clarity
edit_actions: R
edit_actions: For all
edit_actions: Despite
edit_actions: clarity
edit_actions: clarity clarity style
edit_actions: R
edit_actions: the process remains onerous
edit_actions: , their creation remains an onerous process
edit_actions: clarity
edit_actions: style clarity clarity
edit_actions: D
edit_actions: a parallel development, patients increasingly record audio from their visits (with consent), often through dedicated apps. In
edit_actions: clarity
edit_actions: clarity coherence clarity
edit_actions: D
edit_actions: for leveraging these transcripts to train machine learning model
edit_actions: clarity
edit_actions: clarity clarity coherence
edit_actions: A
edit_actions: train summarization models to
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed coherence
edit_actions: R
edit_actions: . We first describe a unique dataset of patient visit records, consisting of transcripts ,
edit_actions: from conversations between physicians and patients. We benefit from a dataset that, along with transcripts and
edit_actions: clarity
edit_actions: clarity clarity coherence
edit_actions: R
edit_actions: and
edit_actions: consists of
edit_actions: clarity
edit_actions: clarity clarity style
edit_actions: A
edit_actions: We observe that the performance improves constantly as the extractive subtask is made more complex - an observation that we also replicate on the well-known AMI meeting summarization dataset.
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: R
edit_actions: assigns them
edit_actions: , assigning each
edit_actions: clarity
edit_actions: clarity style clarity
edit_actions: R
edit_actions: 7
edit_actions: around 8
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: D
edit_actions: . Oracle experiments indicate that fixing our generative capabilities, improvements in extraction alone could provide (up to) a further 9 ROUGE point gain
edit_actions: clarity
edit_actions: coherence clarity clarity