面向边缘反走样的屏幕内容索引图自适应预测

doi:10.16451/j.cnki.issn1003-6059.202103007

Abstract
Figure/Table
References
Related Citation (1)

Download: PDF (1132 KB) HTML (1 KB)
Export: BibTeX | EndNote (RIS)

Abstract The prediction ability of the palette coding is limited in the edge anti-aliasing regions, since the adjacent indexes do not present equivalence relation. Therefore, an adaptive predictive coding method is proposed based on edge anti-aliasing decision and multiple directional templates. Eight 4-neighbor directional prediction templates are firstly designed by introducing the Pitteway anti-aliasing decision with area weight. Subsequently, a two-dimensional linear correlation model is exploited to describe the relationship between the index to be predicted and its four reference pixels. Finally, the least square method is applied to calculate a group of weight coefficients for each directional template. The anti-aliasing algorithm executed by the display adapter is adaptively learned, and thus the predictive coding of the index map is realized. Experiments show that the proposed method achieves a higher prediction accuracy and the adaptive prediction ability of the palette coding in the anti-aliasing regions and complex edge regions is improved.

Key words： Screen Content Coding Palette Coding Index Map Prediction Multi-direction Template,Anti-Aliasing

Received: 15 March 2021

ZTFLH:

TP 391

Fund:Natural Science Foundation of Liaoning Province(No.20180550570), Program for Liaoning Excellent Talents in University(No.[2018] 478, 64th), Open Foundation of State Key Laboratory for Novel Software Technology of Nanjing University(No.KFKT2018B07)

Corresponding Authors: SONG Chuanming, Ph.D., professor. His research inte-rests include image and video coding, and traffic surveillance video processing.LIU Dan, master, associate professor. Her research interests include image and video coding.

About author:: LIU Dingkun, master. Her research inte-rests include screen content video coding and video information processing.SUN Shiqi, master student. Her research interests include screen content video coding and motion estimation techniques.

	Service

	E-mail this article
	Add to my bookshelf
	Add to citation manager
	E-mail Alert
	RSS
	Articles by authors
	SONG Chuanming
	LIU Dingkun
	SUN Shiqi
	LIU Dan

Cite this article:

SONG Chuanming,LIU Dingkun,SUN Shiqi等. Edge Anti-Aliasing Oriented Adaptive Index Map Prediction of Screen Content[J]. , 2021, 34(3): 253-266.

URL:

http://manu46.magtech.com.cn/Jweb_prai/EN/10.16451/j.cnki.issn1003-6059.202103007 OR http://manu46.magtech.com.cn/Jweb_prai/EN/Y2021/V34/I3/253

[1] TSANG S H, CHAN Y L, KUANG W. Mode Skipping for HEVC Screen Content Coding via Random Forest. IEEE Transactions on Multimedia, 2019, 21(10): 2433-2446.
[2] SUN Y C, LOU J, CHAO Y H, et al. Analysis of Palette Mode on Versatile Video Coding // Proc of the IEEE Conference on Multimedia Information Processing and Retrieval. Washington, USA: IEEE, 2019: 455-458.
[3] KUANG W, CHAN Y, TSANG S, et al. Machine Learning-Based Fast Intra Mode Decision for HEVC Screen Content Coding via Decision Trees. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30(5): 1481-1496.
[4] 刘丹,陈规胜,宋传鸣,等.屏幕内容编码方法研究进展.计算机研究与发展, 2017, 54(9): 2059-2076.
(LIU D, CHEN G S, SONG C M, et al. Research Advances in Screen Content Coding Methods. Journal of Computer Research and Development, 2017, 54(9): 2059-2076.)
[5] CHEN J L, KARCZEWICZ M, HUANG Y W, et al. The Joint Exploration Model(JEM) for Video Compression with Capability beyond HEVC. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30(5): 1208-1225.
[6] ZHU W J, XU J Z, ZHANG L, et al. Fixed-Length Coding for Escape Samples in Palette Mode // Proc of the IEEE Data Compression Conference. Washington, USA: IEEE, 2020: 408.
[7] KUMAR G P, SREELEKHA G. Fast SCC in HEVC Using a Palette Mode Decision Tree Classifier // Proc of the International Confe-rence on Communication and Signal Processing. Washington, USA: IEEE, 2020: 1356-1360.
[8] 陈规胜,宋传鸣,王相海,等.用于屏幕图像编码的索引图快速预测算法.中国图象图形学报, 2016, 21(9): 1127-1137.
(CHEN G S, SONG C M, WANG X H, et al. Fast Prediction Algorithm of Index Maps for Screen Image Coding. Journal of Image and Graphics, 2016, 21(9): 1127-1137.)
[9] STRUTZ T, MÖLLER P. Screen Content Compression Based on Enhanced Soft Context Formation. IEEE Transactions on Multimedia, 2020, 22(5): 1126-1138.
[10] KUANG W, CHAN Y L, TSANG S H. Low-Complexity Intra Prediction for Screen Content Coding by Convolutional Neural Network // Proc of the IEEE International Symposium on Circuits and Systems. Washington, USA: IEEE, 2020. DOI: 10.1109/ISCAS45731.2020.9180754.
[11] ZHOU K L, ZHAO L P, LIN T. A Flexible and Uniform String Matching Technique for General Screen Content Coding. Multimedia Tools and Applications, 2018, 77(18): 23751- 23775.
[12] SANCHEZ V, AULÍ-LLINÀS F, SERRA-SAGRISTÀ J. DPCM-Based Edge Prediction for Lossless Screen Content Coding in HEVC. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016, 6(4): 497-507.
[13] XU J Z, JOSHI R, COHEN R A. Overview of the Emerging HEVC Screen Content Coding Extension. IEEE Transactions on Circuits and Systems for Video Technology, 2016, 26(1): 50-62.
[14] SUN Y C, HSIANG S T, KIM J, et al. Improvements of HEVC SCC Palette Mode and Intra Block Copy. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016, 6(4): 433-445.
[15] ZHU W J, DING W P, XU J Z, et al. Screen Content Coding Based on HEVC Framework. IEEE Transactions on Multimedia, 2014, 16(5): 1316-1326.
[16] XIU X Y, HE Y W, JOSHI R, et al. Palette-Based Coding in the Screen Content Coding Extension of the HEVC Standard // Proc of the IEEE Data Compression Conference. Washington, USA: IEEE, 2015: 253-262.
[17] PU W, KARCZEWICZ M, JOSHI R, et al. Palette Mode Coding in HEVC Screen Content Coding Extension. IEEE Journal of Emerging and Selected Topics in Circuits and Systems, 2016, 6(4): 420-432.
[18] ZHU W J, DING W P, XU J Z, et al. 2-D Dictionary Based Video Coding for Screen Contents // Proc of the IEEE Data Compression Conference. Washington, USA: IEEE, 2014: 43-52.
[19] MA Z, WANG W, XU M, et al. Advanced Screen Content Coding Using Color Table and Index Map. IEEE Transactions on Image Processing, 2014, 23(10): 4399-4412.
[20] XU Y L, HUANG W, WANG W, et al. 2-D Index Map Coding for HEVC Screen Content Compression // Proc of the IEEE Data Compression Conference. Washington, USA: IEEE, 2015: 263-272.
[21] 方诚,刘昱.HEVC-SCC自适应调色板模式快速决策算法.激光与光电子学进展, 2018, 55(7). DOI: 10.3788/LOP55.070 01.
(FANG C, LIU Y. HEVC-SCC Adaptive Palette Mode Fast Decision Algorithm. Laser and Optoelectronics Progress, 2018, 55(7). DOI: 10.3788/LOP55.07001.)
[22] ZHU W J, XU J Z, ZHANG L, et al. Compound Palette Mode for Screen Content Coding // Proc of the Picture Coding Symposium. Washington, USA: IEEE, 2019. DOI: 10.1109/PCS48520.2019.8954517.
[23] TSANG S, CHAN Y, KUANG W, et al. Reduced-Complexity Intra Block Copy(IntraBC) Mode with Early CU Splitting and Pruning for HEVC Screen Content Coding. IEEE Transactions on Multimedia, 2019, 21(2): 269-283.
[24] BADRY E, SHALABY A, SAYED M S. Fast Algorithm with Pa-lette Mode Skipping and Splitting Early Termination for HEVC Screen Content Coding // Proc of the 62nd IEEE International Midwest Symposium on Circuits and Systems. Washington, USA: IEEE, 2019: 606-609.
[25] ZHU W J, DING W P, XIONG R Q, et al. Compound Image Compression by Multi-stage Prediction // Proc of the IEEE International Conference on Visual Communications and Image Proce-ssing. Washington, USA: IEEE, 2012. DOI: 10.1109/VCIP.2012.6410758.
[26] PAN Z T, SHEN H F, LU Y, et al. A Low-Complexity Screen Compression Scheme for Interactive Screen Sharing. IEEE Transac-tions on Circuits and Systems for Video Technology, 2013, 23(6): 949-960.
[27] ZHU W J, ZHANG K, AN J C, et al. Inter-Palette Coding in Screen Content Coding. IEEE Transactions on Broadcasting, 2017, 63(4): 673-679.
[28] 宋传鸣,陈规胜,何兴,等.调色板编码中双向预测的索引值优化分配.模式识别与人工智能, 2017, 30(5): 385-393.
(SONG C M, CHEN G S, HE X, et al. Optimized Index Assignment with Bi-directional Prediction in Palette Coding. Pattern Re-cognition and Artificial Intelligence, 2017, 30(5): 385-393.)
[29] SUN Y C, CHUANG T D, KIM J, et al. Improved Palette Index Map Coding on HEVC SCC // Proc of the IEEE International Conference on Image Processing. Washington, USA: IEEE, 2016: 4210-4214.
[30] 宋传鸣,何兴,傅博,等.屏幕内容索引图的马尔可夫预测算法.中国图象图形学报, 2017, 22(7): 863-874.
(SONG C M, HE X, FU B, et al. Markov Prediction Algorithm of the Index Map of Screen Content. Journal of Image and Graphics, 2017, 22(7): 863-874.)
[31] 宋传鸣,何兴,闵新,等.调色板编码中2-邻域联合转移概率的索引图预测.计算机研究与发展, 2018, 55(11): 2557-2568.
(SONG C M, HE X, MIN X, et al. Index Map Prediction by 2-Neighbor Joint Transition Probability in Palette Coding. Journal of
Computer Research and Development, 2018, 55(11): 2557-2568.)
[32] PITTEWAY M L V, WATKINSON DJ. Bresenham's Algorithm with Grey Scale. Communications of the ACM, 1980, 23(1): 625-626.