Title | CODER: Knowledge-infused cross-lingual medical term embedding for term normalization. |
Publication Type | Journal Article |
Year of Publication | 2022 |
Authors | Yuan Z, Zhao Z, Sun H, Li J, Wang F, Yu S |
Journal | J Biomed Inform |
Volume | 126 |
Pagination | 103983 |
Date Published | 2022 Feb |
ISSN | 1532-0480 |
Keywords | Language, Machine Learning, Natural Language Processing, Semantics, Unified Medical Language System |
Abstract | OBJECTIVE: This paper aims to propose knowledge-aware embedding, a critical tool for medical term normalization. METHODS: We develop CODER (Cross-lingual knowledge-infused medical term embedding) via contrastive learning based on a medical knowledge graph (KG) named the Unified Medical Language System, and similarities are calculated utilizing both terms and relation triplets from the KG. Training with relations injects medical knowledge into embeddings and can potentially improve their performance as machine learning features. RESULTS: We evaluate CODER based on zero-shot term normalization, semantic similarity, and relation classification benchmarks, and the results show that CODER outperforms various state-of-the-art biomedical word embeddings, concept embeddings, and contextual embeddings. CONCLUSION: CODER embeddings excellently reflect semantic similarity and relatedness of medical concepts. One can use CODER for embedding-based medical term normalization or to provide features for machine learning. Similar to other pretrained language models, CODER can also be fine-tuned for specific tasks. Codes and models are available at https://github.com/GanjinZero/CODER. |
DOI | 10.1016/j.jbi.2021.103983 |
Alternate Journal | J Biomed Inform |
PubMed ID | 34990838 |
CODER: Knowledge-infused cross-lingual medical term embedding for term normalization.
Submitted by chz4003 on April 11, 2023 - 5:01pm
Division:
Institute of Artificial Intelligence for Digital Health
Category:
Faculty Publication