CODER: Knowledge-infused cross-lingual medical term embedding for term normalization.

TitleCODER: Knowledge-infused cross-lingual medical term embedding for term normalization.
Publication TypeJournal Article
Year of Publication2022
AuthorsYuan Z, Zhao Z, Sun H, Li J, Wang F, Yu S
JournalJ Biomed Inform
Volume126
Pagination103983
Date Published2022 Feb
ISSN1532-0480
KeywordsLanguage, Machine Learning, Natural Language Processing, Semantics, Unified Medical Language System
Abstract

OBJECTIVE: This paper aims to propose knowledge-aware embedding, a critical tool for medical term normalization.

METHODS: We develop CODER (Cross-lingual knowledge-infused medical term embedding) via contrastive learning based on a medical knowledge graph (KG) named the Unified Medical Language System, and similarities are calculated utilizing both terms and relation triplets from the KG. Training with relations injects medical knowledge into embeddings and can potentially improve their performance as machine learning features.

RESULTS: We evaluate CODER based on zero-shot term normalization, semantic similarity, and relation classification benchmarks, and the results show that CODER outperforms various state-of-the-art biomedical word embeddings, concept embeddings, and contextual embeddings.

CONCLUSION: CODER embeddings excellently reflect semantic similarity and relatedness of medical concepts. One can use CODER for embedding-based medical term normalization or to provide features for machine learning. Similar to other pretrained language models, CODER can also be fine-tuned for specific tasks. Codes and models are available at https://github.com/GanjinZero/CODER.

DOI10.1016/j.jbi.2021.103983
Alternate JournalJ Biomed Inform
PubMed ID34990838
Division: 
Institute of Artificial Intelligence for Digital Health
Category: 
Faculty Publication