关键词: 药物相互作用, 类别关键词, 注意力机制

Abstract: A drug interaction extraction model combining category key words with attention mechanism was proposed to enhance the discrimination among different categories of data and improve the performance of classifier． Firstly，the keywords of each class were selected based on the chi-square test and document frequency． Then，the position coding of keywords and drug pairs was added into the pre-trained model BERT，in order to make the difference of the samples more salient． The distribution information of keywords and other words in the sentence was learned through the attention mechanism to improve the performance of the model． Aiming at the problem of too much negative samples in the drug interaction extraction experiment，a negative sample filtering method based on rules and patterns was proposed to effectively reduce the proportion of positive and negative samples． Compared with other DDI models based on CNN，LSTM，and BERT，KA-BERT model can better improve performance on DDI data，which proves the effectiveness of KA-BERT model． The results of the test on chemical protein relation extraction show that the precision，recall and F1 score of KA-BERT model are enhanced significantly，which further proves the validity and universality of KA-BERT model．

Key words: drug interaction, category keywords, attention mechanism