Electronics, Communication & Automation Technology

Multidimensional Cross-Layer Bandwidth Prediction for Low-Latency Real-Time Video

Expand
  • College of Physics and Information Engineering,Fuzhou University,Fuzhou 350108,Fujian,China
陈锋(1984-),男,博士,副教授,主要从事视频传输、深度强化学习研究。E-mail:chenf@fzu. edu. cn

Received date: 2022-10-25

  Online published: 2023-04-04

Supported by

the National Natural Science Foundation of China for Youths(61801120);the General Program of the Natural Science Foundation of Fujian Province(2022J01551)

Abstract

The available bandwidth of 5G networks is a pivotal factor influencing real-time video services. However, how to achieve accurate predictions in the context of low-latency real-time video services remains a difficult problem. Conventional algorithms for predicting available bandwidth typically rely on data metrics at the application layer and complete the forecast according to the packet transmission strategies. Such algorithms can lead to prediction lag in complex scenarios, thereby significantly impairing the received video quality for users. To address this concern, this study proposed a novel available bandwidth prediction algorithm based on cross-layer multi-dimensional parameters. This algorithm comprehensively integrates pertinent data metrics from the application, physical, and network layers, utilizes multiple dimensions of parameters to enhance the precision of wireless network bandwidth detection. In this paper, deep reinforcement learning was adopted as the model framework to integrate offline prediction and online prediction through cross-layer and multi-dimensional data model learning for different motion scenarios. Furthermore, network packet loss rates, image quality assessments, end-to-end delays, and other link-related factors were introduced as constraints, to realize the real-time adjustment and optimization of the prediction model during the transmission process. Experimental results conducted on a semi-physical platform show that: the prediction performance of the proposed algorithm is better than the traditional prediction method, and the fitting degree of the prediction curve and the actual curve is more than 95.8%; compared with the single-layer prediction algorithm, the packet loss rate of the proposed algorithm in walking and driving scenarios decreases by 47.3% and 30.9%, respectively, and the quality of received video is improved by 12%.

Cite this article

CHEN Feng, MAO Haobin, CAI Jiling, et al. . Multidimensional Cross-Layer Bandwidth Prediction for Low-Latency Real-Time Video[J]. Journal of South China University of Technology(Natural Science), 2023 , 51(11) : 18 -27 . DOI: 10.12141/j.issn.1000-565X.220705

References

1 ARSAN T .Review of bandwidth estimation tools and application to bandwidth adaptive video streaming[C]∥Proceedings of High Capacity Optical Networks and Emerging/Enabling Technologies.Istanbul:IEEE,2012:152-156.
2 JIANG J, SEKAR V, ZHANG H .Improving fairness,efficiency,and stability in HTTP-based adaptive video streaming with festive[J].IEEE/ACM Transactions on Networking201422(1):326-340.
3 YIN X, JINDAL A, SEKAR V,et al .A control-theoretic approach for dynamic adaptive video streaming over HTTP[C]∥ Proceedings of the 2015 ACM Confe-rence on Special Interest Group on Data Communication.New York:ACM,2015:325-338.
4 HE Q, DOVROLIS C, AMMAR M .On the predictabi-lity of large transfer TCP throughput[J].Computer Networks200751(14):3959-3977.
5 MIRZA M, SOMMERS J, BARFORD P,et al .A machine learning approach to TCP throughput prediction[J].IEEE/ACM Transactions on Networking201018(4):1026-1039.
6 SUN Y, YIN X, JIANG J,et al .C S2P:improving video bitrate selection and adaptation with data-driven throughput prediction[C]∥ Proceedings of the 2016 ACM SIGCOMM Conference.New York:ACM,2016:272-285.
7 HIGUCHI T, SHINGU H, SHIMIZU N,et al .Real-time video streaming based on TFRC using communication logging for 5G HetNet[J].IEICE Transactions on Communications2019,E102.B(8):1538-1546.
8 KHANGURA S K, AKIN S .Online available bandwidth estimation using multiclass supervised learning techniques[J].Computer Communications2021170:177-189.
9 BENTALEB A, BEGEN A C, HAROUS S,et al .Data-driven bandwidth prediction models and automated model selection for low latency[J].IEEE Transactions on Multimedia202023:2588-2601.
10 POKHARKAR S R, WAGH S J, DESHMUKH S N .Machine learning based predictive mechanism for internet bandwidth[C]∥ Proceedings of 2021 the 6th Inter-national Conference for Convergence in Technology.Maharashtra:IEEE,2021:1-4.
11 MEI L, HU R, CAO H,et al .Realtime mobile bandwidth prediction using LSTM neural network and Bayesian fusion[J].Computer Networks2020182:107515/1-11.
12 MEI L, GOU J, CAI Y,et al .Realtime mobile bandwidth and handoff predictions in 4G/5G networks[J].Computer Networks2022204:108736/1-11.
13 RIBEIRO V J, RIEDI R H, BARANIUK R G,et al .PathChirp:efficient available bandwidth estimation for network paths [R].Washington D C:United States Department of Energy,2003
14 KURDOGLU E, LIU Y, WANG Y,et al .Real-time bandwidth prediction and rate adaptation for video calls over cellular networks[C]∥ Proceedings of the 7th International Conference on Multimedia Systems.New York:ACM,2016:1-11.
15 SAMBA A, BUSNEL Y, BLANC A,et al .Instantaneous throughput prediction in cellular networks:which information is needed?[C]∥ Proceedings of 2017 IFIP/IEEE Symposium on Integrated Network and Service Management.Lisbon:IEEE,2017:624-627.
16 TAANI B, ZIMMERMANN R .Spatio-temporal analysis of bandwidth maps for geo-predictive video streaming in mobile environments[C]∥ Proceedings of the 24th ACM International Conference on Multimedia.New York:ACM,2016:888-897.
17 SLIWA B, FALKENBERG R, LIEBIG T,et al .Machine learning based context-predictive car-to-cloud communication using multi-layer connectivity maps for upcoming 5G networks [C]∥ Proceedings of 2018 IEEE the 88th Vehicular Technology Conference.Chicago:IEEE,2018:1-7.
18 YUE C, JIN R,SUH K,et al .LinkForecast:cellular link bandwidth prediction in LTE networks[J].IEEE Transactions on Mobile Computing201716(7):1582-1594.
19 MINOVSKI D, ?GREN N, MITRA K,et al .Throughput prediction using machine learning in LTE and 5G networks[J].IEEE Transactions on Mobile Computing202322(3):1825-1840.
20 RIKI? B, SAMARD?IJA D, ?ADOVSKI O,et al .Cellular network bandwidth prediction in consumer applications[C]∥ Proceedings of 2021 IEEE International Conference on Consumer Electronics.Las Vegas:IEEE,2021:9427757/1-3.
21 ?ADOVSKI O, ILI? V, RIKI? B,et al .Proposal for bandwidth prediction using hybrid division model[C]∥Proceedings of 2021 IEEE International Conference on Consumer Electronics.Las Vegas:IEEE,2021:9427751/1-2.
22 NARAYANAN A, RAMADAN E, MEHTA R,et al .Lumos5G:mapping and predicting commercial mmWave 5G throughput[C]∥ Proceedings of the ACM Internet Measurement Conference.New York:ACM,2020:176-193.
23 RACA D, LEAHY D, SREENAN C J,et al .Beyond throughput, the next generation:a 5G dataset with channel and context metrics[C]∥ Proceedings of the 11th ACM Multimedia Systems Conference.New York:ACM,2020:303-308.
24 HAARNOJA T, ZHOU A, HARTIKAINEN K,et al .Soft actor-critic algorithms and applications[EB/OL].(2019-01-29)[2022-10-20]..
25 CHRISTODOULOU P .Soft actor-critic for discrete action settings[EB/OL].(2019-10-18)[2022-10-20]..
26 迈思源 .Holowan网络损伤仿真仪[EB/OL].(2020-01-12)[2022-10-20]..
27 ZHOU Z H, FENG J .Deep forest[J].National Science Review20196(1):74-86.
28 HAYKIN S .Adaptive filter theory[M].4 ed.Delhi:Pearson Education,2002
29 WAHAB A, AHMAD N, SCHORMANS J .Variation in QoE of passive gaming video streaming for different packet loss ratios[C]∥ Proceedings of 2020 the Twelfth International Conference on Quality of Multimedia Experience.Athlone:IEEE,2020: 1-4.
30 LAGHARI A A, LAGHARI R A, WAGAN A A,et al .Effect of packet loss and reorder on quality of audio streaming[J].EAI Endorsed Transactions on Scalable Information Systems20207(24):1-7.
31 ADEYEMI-EJEYE A O, ALRESHOODI M, AL-JOBOURI L,et al .Impact of packet loss on 4K UHD video for portable devices[J].Multimedia Tools and Applications201978:31733-31755.
32 AHMAD N, WAHAB A, SCHORMANS J .Importance of cross-correlation of QoS metrics in network emulators to evaluate QoE of video streaming applications[C]∥ Proceedings of 2020 the 11th International Conference on Network of the Future.Bordeaux:IEEE,2020:43-47.
Outlines

/