Incorporating hierarchy into text encoder
WebMar 8, 2024 · Hierarchical text classification is a challenging subtask of multi-label classification due to its complex label hierarchy. Existing methods encode text and label hierarchy separately and mix their representations for classification, where the hierarchy remains unchanged for all input text. WebDec 25, 2024 · This paper proposes a contrastive learning approach for HTC through generating high quality positive samples using the taxonomic hierarchy. The hierarchy is modeled with Graphormer and trained end-to-end with positive sample generation under a contrastive loss and a classification loss. Comments Wow, amazing! It’s hard to believe …
Incorporating hierarchy into text encoder
Did you know?
WebMay 21, 2024 · The decoder has almost the same structure as the encoder, except that it has an additional Dense layer that converts the vector of size decoder_dim that is output from the RNN, into a vector that ... WebApr 7, 2024 · Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification Zihan Wang Peiyi Wang Lianzhe Huang Xin Sun Houfeng Wang Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) pdf bib abs
WebMay 5, 2024 · To model semantic information along with hierarchical information, Zhou et al. proposes hierarchy-aware multi-label attention. Chen et al. reformulates it as a matching … WebThis work has been accepted as the long paper "Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification" in ACL 2024. …
WebIncorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification . Hierarchical text classification is a challenging subtask of multi-label classification due to its complex label hierarchy. Existing methods encode text and label hierarchy separately and mix their representations for classification ... WebMay 5, 2024 · Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification Hierarchical text classification is a challenging subtask of multi-label... Zihan Wang, et al. ∙ share 8 research ∙04/12/2024 HTCInfoMax: A Global Model for Hierarchical Text Classification via
Web2 days ago · Instead of modeling them separately, in this work, we propose Hierarchy-guided Contrastive Learning (HGCLR) to directly embed the hierarchy into a text encoder. During …
WebHierarchical text classification is a challenging subtask of multi-label classification due to its complex label hierarchy. Existing methods encode text and label hierarchy separately and... earth ozone layer 2023Web(2024) demonstrate that encoding the holistic la-bel structure directly by a structure encoder can further improve performance. Following this re-search, a bunch of models try to study how the hierarchy should interact with the text. BothChen et al.(2024) andChen et al.(2024) embed word and label hierarchy jointly in a same space.Deng earthpac nzWeb2024. Incorporating hierarchy into text encoder: a contrastive learning approach for hierarchical text classification. Z Wang, P Wang, L Huang, X Sun, H Wang. arXiv preprint arXiv:2203.03825. , 2024. 5. 2024. Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. ct landmark ar burnt siennaWebMay 5, 2024 · Existing methods encode label hierarchy in a global view, where label hierarchy is treated as the static hierarchical structure containing all labels. Since global hierarchy is static and... earth packed tiresWebquence generation to incorporate hierarchy information into a target label sequence instead of the model structure. Subse-quently, we propose the Hierarchy DECoder (HiDEC), which decodes a text sequence into a sub-hierarchy sequence using recursive hierarchy decoding, classifying all parents at the same level into children at once. ctl and itl fileWebMar 7, 2024 · By pulling together the input text and its positive sample, the text encoder can learn to generate the hierarchy-aware text representation independently. Therefore, after … ctlap2203.wWebJan 1, 2024 · In this paper, we propose a L abel-based A ttention for H ierarchical Multi-label Text C lassification Neural N etwork ( LA-HCN), where the novel label-based attention … ctla membership