计算机科学与技术

基于意图理解驱动的客服知识推荐大模型构建

  • 马晓亮 ,
  • 高洁 ,
  • 刘英 ,
  • 裴庆祺 ,
  • 赵汝强 ,
  • 杨邦兴 ,
  • 邓从健
展开
  • 1.西安电子科技大学 广州研究院,广东 广州 510555
    2.中国电信股份有限公司 广州分公司,广东 广州 510620
    3.马晓亮劳模和创新工匠工作室,广东 广州 510620
    4.广州云趣信息科技有限公司,广东 广州 510665
    5.中数通信息有限公司,广东 广州 510650
马晓亮(1973—),男,博士生,高级工程师,华南理工大学工商管理学院讲席教授,主要从事人工智能、自然语言处理、方言处理、运营商客服运营、数据安全保护研究。E-mail: maxiaol.gd@chinatelecom.cn

收稿日期: 2024-04-17

  网络出版日期: 2024-08-23

基金资助

国家重点研发计划项目(2021YFB2700600)

Customer Service Knowledge Recommendation Large Model Construction Driven by Intent Understanding

  • MA Xiaoliang ,
  • GAO Jie ,
  • LIU Ying ,
  • PEI Qingqi ,
  • ZHAO Ruqiang ,
  • YANG Bangxing ,
  • DENG Congjian
Expand
  • 1.Guangzhou Institue of Technology,Xidian University,Guangzhou 510555,Guangdong,China
    2.Guangzhou Branch of China Telecom Co. ,Ltd. ,Guangzhou 510620,Guangdong,China
    3.MA Xiaoliang’?s Model Worker and Innovative Craftsman Workshop,Guangzhou 510620,Guangdong,China
    4.Guangzhou Yunqu Information Technology Co. ,Ltd. ,Guangzhou 510665,Guangdong,China
    5.China DataCom Co. ,Ltd. ,Guangzhou 510650,Guangdong,China
马晓亮(1973—),男,博士生,高级工程师,华南理工大学工商管理学院讲席教授,主要从事人工智能、自然语言处理、方言处理、运营商客服运营、数据安全保护研究。E-mail: maxiaol.gd@chinatelecom.cn

Received date: 2024-04-17

  Online published: 2024-08-23

Supported by

the National Key R & D Program of China(2021YFB2700600)

摘要

随着人工智能技术在客服领域的深入应用,电信运营商对AI服务知识推荐的准确率提升提出了更高的要求。为提高电信运营商AI客服系统的知识推荐效率和准确度,该文提出了基于意图理解驱动的客服知识推荐大模型。首先,采用同义词及对话序列的关键词提取模型识别用户查询中的关键词,通过语义相似度比较技术匹配标准问库中的问题,生成最相关的标准问,并采用生成式智能体技术框架构建标准问库,使用智能体技术自动生成知识问题;然后将提取的标准问输入ChatGLM2-6B大语言模型中,经过预训练与人类偏好对齐训练,以进一步提高知识推荐的准确率。实验结果显示:引入标准问库后,智能推荐系统在特定行业知识领域的准确率从74.8%显著提升至85.9%,多组对比实验结果进一步验证了建立标准问库的策略在提高准确率方面的有效性;该文大模型优化了运营商AI客服的智能知识推荐,可为电信运营商AI客服系统的知识推荐提供新的思路和技术支持;运营商通过该文大模型能够更有效地理解和响应客户查询,显著提升客户服务体验。

本文引用格式

马晓亮 , 高洁 , 刘英 , 裴庆祺 , 赵汝强 , 杨邦兴 , 邓从健 . 基于意图理解驱动的客服知识推荐大模型构建[J]. 华南理工大学学报(自然科学版), 2025 , 53(3) : 40 -49 . DOI: 10.12141/j.issn.1000-565X.240191

Abstract

With the deepening application of artificial intelligence technology in the field of customer service, telecommunications operators have raised higher standards for the accuracy of AI service knowledge recommendations. To enhance the efficiency and accuracy of knowledge recommendation in telecommunications operators’AI customer service systems, this paper proposed a large-scale customer service knowledge recommendation model driven by intent understanding. Firstly, the synonym and dialogue sequence keyword extraction model was employed to identify key terms in user queries. These keywords were then matched with questions in a standard question bank using semantic similarity comparison techniques to generate the most relevant standard questions. Additionally, a generative agent technology framework was utilized to construct and enrich the standard question bank, enabling the automatic generation of knowledge questions. The extracted standard questions were input into the ChatGLM2-6B large language model, which has been pre-trained and aligned with human preferences, further improving the accuracy of knowledge recommendations. The experimental results show that after the introduction of the standard question bank, the accuracy of the intelligent recommendation system in specific industry knowledge domains significantly increased from 74.8% to 85.9%. Multiple sets of comparative experimental results further validate the effectiveness of the strategy of establishing a standard question bank in improving accuracy. The large model discussed in this paper optimized the intelligent knowledge recommendation for operator AI customer service, providing new ideas and technical support for the knowledge recommendation in telecommunications operators’AI customer service systems. With this model, operators can more effectively understand and respond to customer inquiries, significantly enhancing the customer service experience.

参考文献

1 黄勃,严非凡,张昊,等 .推荐系统研究进展与应用[J].武汉大学学报(理学版)202167(6):503-516.
  HUANG Bo, YAN Feifan, ZHANG Hao,et al .Pro-gress and Application of Recommendation System [J].Journal of Wuhan University(Natural Science Edition)202167(6):503-516.
2 胡琪,朱定局,吴惠粦,等 .智能推荐系统研究综述[J].计算机系统应用202231(4):47-58.
  HU Qi, ZHU Ding-ju, WU Hui-lin,et al .Survey on intelligent recommendation system[J].Computer Systems Applications202231(4):47-58.
3 冷亚军,陆青,梁昌勇 .协同过滤推荐技术综述[J].模式识别与人工智能201427(8):720-734.
  LENG Ya-jun, LU Qing, LIANG Chang-yong .Survey of recommendation based on collaborative filtering[J].Pattern Recognition and Artificial Intelligence201427(8):720-734.
4 刘海涛,赵卫东 .基于知识模式挖掘的流程知识推荐系统[J].计算机集成制造系统201723(2):396-403.
  LIU Haitao, ZHAO Weidong .Process-oriented know-ledge recommendation by mining knowledge patterns[J].Computer Integrated Manufacturing Systems201723(2):396-403.
5 赵晔辉,柳林,王海龙,等 .知识图谱推荐系统研究综述[J].计算机科学与探索202317(4):771-791.
  ZHAO Yehui, LIU Lin, WANG Hailong,et al .Survey of knowledge graph recommendation system research[J].Journal of Frontiers of Computer Science and Technology202317(4):771-791.
6 秦琪琦,张月琴,王润泽,等 .基于知识图谱的层次粒化推荐方法[J].计算机科学202249(8):64-69.
  QIN Qiqi, ZHANG Yueqin, WANG Runze,et al .Hie-rarchical granulation recommendation method based on knowledge graph[J].Computer Science202249(8):64-69.
7 YUAN S, ZHAO H, DU Z,et al .WuDaoCorpora:a super large-scale Chinese corpora for pre-training language models[J].AI Open20212:65-68.
8 MAATOUK A, PIOVESAN N, AYED F,et al .Large language models for telecom:forthcoming impact on the industry[EB/OL]. (2023-08-11)[2024-04-14]..
9 陈彬,张荣梅,张琦 .DCFM:基于深度学习的混合推荐模型[J].计算机工程与应用202157(3):150-155.
  CHEN Bin, ZHANG Rongmei, ZHANG Qi .DCFM:hybrid recommendation model based on deep learning[J].Computer Engineering and Applications202157(3):150-155.
10 马娟 .智能客服在运营商中的主要应用场景探讨[J].无线互联科技202219(16):124-127.
  MA Juan .Discussion on main application scenarios of intelligent customer service in operators[J].Wireless Internet Technology202219(16):124-127.
11 马晓亮,安玲玲,邓从健,等 .基于行业词表的自动语音转写后优化技术[J].华南理工大学学报(自然科学版)202351(8):118-125.
  MA Xiaoliang, AN Lingling, DENG Congjian,et al .Translation optimization technology of automatic speech recognition based on industry-specific vocabulary[J].Journal of South China University of Technology(Natural Science Edition)202351(8):118-125.
12 PARK J S, O’BRIEN J C, CAI C J,et al .Generative agents:interactive simulacra of human behavior [EB/OL](2023-08-06)[2024-04-14]..
13 WILLIAMS R, HOSSEINICHIMEH N, MAJUMDAR A,et al .Epidemic modeling with generative agents [EB/OL]. (2023-07-10)[2024-04-14]..
14 杨兴锐,赵寿为,张如学,等 .改进BERT词向量的BiLSTM-Attention文本分类模型[J].传感器与微系统202342(10):160-164.
  YANG Xingrui, ZHAO Shouwei, ZHANG Ruxue,et al .BiLSTM-attention text classification model of improved BERT word vector[J].Transducer and Microsystem Technologies202342(10):160-164.
15 马晓亮,安玲玲,朱栩,等 .基于小样本学习的关键词提取方法及装置:CN202211459952.0[P].2023-12-29.
16 DU Z, QIAN Y, LIU X,et al .GLM:general language model pretraining with autoregressive blank infilling [EB/OL]. (2021-03-18)[2024-04-14]..
17 LEE H, PHATALE S, MANSOOR H, et al .RLAIF vs.RLHF:scaling reinforcement learning from human feedback with AI feedback [EB/OL]. (2023-09-01)[2024-04-14]..
18 SUN T, ZHANG X, HE Z,et al .MOSS:an open conversational large language model[J].Machine Inte-lligence Research202421(5):888-905.
文章导航

/