收稿日期: 2024-04-17
网络出版日期: 2024-08-23
基金资助
国家重点研发计划项目(2021YFB2700600)
Customer Service Knowledge Recommendation Large Model Construction Driven by Intent Understanding
Received date: 2024-04-17
Online published: 2024-08-23
Supported by
the National Key R & D Program of China(2021YFB2700600)
随着人工智能技术在客服领域的深入应用,电信运营商对AI服务知识推荐的准确率提升提出了更高的要求。为提高电信运营商AI客服系统的知识推荐效率和准确度,该文提出了基于意图理解驱动的客服知识推荐大模型。首先,采用同义词及对话序列的关键词提取模型识别用户查询中的关键词,通过语义相似度比较技术匹配标准问库中的问题,生成最相关的标准问,并采用生成式智能体技术框架构建标准问库,使用智能体技术自动生成知识问题;然后将提取的标准问输入ChatGLM2-6B大语言模型中,经过预训练与人类偏好对齐训练,以进一步提高知识推荐的准确率。实验结果显示:引入标准问库后,智能推荐系统在特定行业知识领域的准确率从74.8%显著提升至85.9%,多组对比实验结果进一步验证了建立标准问库的策略在提高准确率方面的有效性;该文大模型优化了运营商AI客服的智能知识推荐,可为电信运营商AI客服系统的知识推荐提供新的思路和技术支持;运营商通过该文大模型能够更有效地理解和响应客户查询,显著提升客户服务体验。
马晓亮 , 高洁 , 刘英 , 裴庆祺 , 赵汝强 , 杨邦兴 , 邓从健 . 基于意图理解驱动的客服知识推荐大模型构建[J]. 华南理工大学学报(自然科学版), 2025 , 53(3) : 40 -49 . DOI: 10.12141/j.issn.1000-565X.240191
With the deepening application of artificial intelligence technology in the field of customer service, telecommunications operators have raised higher standards for the accuracy of AI service knowledge recommendations. To enhance the efficiency and accuracy of knowledge recommendation in telecommunications operators’AI customer service systems, this paper proposed a large-scale customer service knowledge recommendation model driven by intent understanding. Firstly, the synonym and dialogue sequence keyword extraction model was employed to identify key terms in user queries. These keywords were then matched with questions in a standard question bank using semantic similarity comparison techniques to generate the most relevant standard questions. Additionally, a generative agent technology framework was utilized to construct and enrich the standard question bank, enabling the automatic generation of knowledge questions. The extracted standard questions were input into the ChatGLM2-6B large language model, which has been pre-trained and aligned with human preferences, further improving the accuracy of knowledge recommendations. The experimental results show that after the introduction of the standard question bank, the accuracy of the intelligent recommendation system in specific industry knowledge domains significantly increased from 74.8% to 85.9%. Multiple sets of comparative experimental results further validate the effectiveness of the strategy of establishing a standard question bank in improving accuracy. The large model discussed in this paper optimized the intelligent knowledge recommendation for operator AI customer service, providing new ideas and technical support for the knowledge recommendation in telecommunications operators’AI customer service systems. With this model, operators can more effectively understand and respond to customer inquiries, significantly enhancing the customer service experience.
| 1 | 黄勃,严非凡,张昊,等 .推荐系统研究进展与应用[J].武汉大学学报(理学版),2021,67(6):503-516. |
| HUANG Bo, YAN Feifan, ZHANG Hao,et al .Pro-gress and Application of Recommendation System [J].Journal of Wuhan University(Natural Science Edition),2021,67(6):503-516. | |
| 2 | 胡琪,朱定局,吴惠粦,等 .智能推荐系统研究综述[J].计算机系统应用,2022,31(4):47-58. |
| HU Qi, ZHU Ding-ju, WU Hui-lin,et al .Survey on intelligent recommendation system[J].Computer Systems Applications,2022,31(4):47-58. | |
| 3 | 冷亚军,陆青,梁昌勇 .协同过滤推荐技术综述[J].模式识别与人工智能,2014,27(8):720-734. |
| LENG Ya-jun, LU Qing, LIANG Chang-yong .Survey of recommendation based on collaborative filtering[J].Pattern Recognition and Artificial Intelligence,2014,27(8):720-734. | |
| 4 | 刘海涛,赵卫东 .基于知识模式挖掘的流程知识推荐系统[J].计算机集成制造系统,2017,23(2):396-403. |
| LIU Haitao, ZHAO Weidong .Process-oriented know-ledge recommendation by mining knowledge patterns[J].Computer Integrated Manufacturing Systems,2017,23(2):396-403. | |
| 5 | 赵晔辉,柳林,王海龙,等 .知识图谱推荐系统研究综述[J].计算机科学与探索,2023,17(4):771-791. |
| ZHAO Yehui, LIU Lin, WANG Hailong,et al .Survey of knowledge graph recommendation system research[J].Journal of Frontiers of Computer Science and Technology,2023,17(4):771-791. | |
| 6 | 秦琪琦,张月琴,王润泽,等 .基于知识图谱的层次粒化推荐方法[J].计算机科学,2022,49(8):64-69. |
| QIN Qiqi, ZHANG Yueqin, WANG Runze,et al .Hie-rarchical granulation recommendation method based on knowledge graph[J].Computer Science,2022,49(8):64-69. | |
| 7 | YUAN S, ZHAO H, DU Z,et al .WuDaoCorpora:a super large-scale Chinese corpora for pre-training language models[J].AI Open,2021,2:65-68. |
| 8 | MAATOUK A, PIOVESAN N, AYED F,et al .Large language models for telecom:forthcoming impact on the industry[EB/OL]. (2023-08-11)[2024-04-14].. |
| 9 | 陈彬,张荣梅,张琦 .DCFM:基于深度学习的混合推荐模型[J].计算机工程与应用,2021,57(3):150-155. |
| CHEN Bin, ZHANG Rongmei, ZHANG Qi .DCFM:hybrid recommendation model based on deep learning[J].Computer Engineering and Applications,2021,57(3):150-155. | |
| 10 | 马娟 .智能客服在运营商中的主要应用场景探讨[J].无线互联科技,2022,19(16):124-127. |
| MA Juan .Discussion on main application scenarios of intelligent customer service in operators[J].Wireless Internet Technology,2022,19(16):124-127. | |
| 11 | 马晓亮,安玲玲,邓从健,等 .基于行业词表的自动语音转写后优化技术[J].华南理工大学学报(自然科学版),2023,51(8):118-125. |
| MA Xiaoliang, AN Lingling, DENG Congjian,et al .Translation optimization technology of automatic speech recognition based on industry-specific vocabulary[J].Journal of South China University of Technology(Natural Science Edition),2023,51(8):118-125. | |
| 12 | PARK J S, O’BRIEN J C, CAI C J,et al .Generative agents:interactive simulacra of human behavior [EB/OL](2023-08-06)[2024-04-14].. |
| 13 | WILLIAMS R, HOSSEINICHIMEH N, MAJUMDAR A,et al .Epidemic modeling with generative agents [EB/OL]. (2023-07-10)[2024-04-14].. |
| 14 | 杨兴锐,赵寿为,张如学,等 .改进BERT词向量的BiLSTM-Attention文本分类模型[J].传感器与微系统,2023,42(10):160-164. |
| YANG Xingrui, ZHAO Shouwei, ZHANG Ruxue,et al .BiLSTM-attention text classification model of improved BERT word vector[J].Transducer and Microsystem Technologies,2023,42(10):160-164. | |
| 15 | 马晓亮,安玲玲,朱栩,等 .基于小样本学习的关键词提取方法及装置:CN202211459952.0[P].2023-12-29. |
| 16 | DU Z, QIAN Y, LIU X,et al .GLM:general language model pretraining with autoregressive blank infilling [EB/OL]. (2021-03-18)[2024-04-14].. |
| 17 | LEE H, PHATALE S, MANSOOR H, et al .RLAIF vs.RLHF:scaling reinforcement learning from human feedback with AI feedback [EB/OL]. (2023-09-01)[2024-04-14].. |
| 18 | SUN T, ZHANG X, HE Z,et al .MOSS:an open conversational large language model[J].Machine Inte-lligence Research,2024,21(5):888-905. |
/
| 〈 |
|
〉 |