CAJ | 학술논문

针对立体视频传输中右视点整帧丢失，提出了一种基于结构相似度(Structural Similarity，SSIM)的立体视频右视点整帧丢失错误隐藏算法。首先，提出了时域SSIM和视间SSIM的概念。然后，根据视频序列的时域相关性，将前一时刻右视点图像宏块的预测方式作为丢失图像宏块的预测方式。接着，将前一时刻右视点图像以宏块为单位进行时域和视间匹配，求取其以像素为单位的时域SSIM映射图和视间SSIM映射图。最后，计算并比较前一时刻右视点图像每个宏块的时域SSIM和视间SSIM值，得到每个宏块的预测方式，将其预测方式作为丢失帧中宏块的预测方式，从而使用运动补偿预测或者视差补偿预测的方法进行恢复。实验结果表明，与传统的算法和Pang的算法相比，PSNR值分别提高了2.76 dB和3.43 dB，且本文算法主观效果较好。
침대입체시빈전수중우시점정정주실，제출료일충기우결구상사도(Structural Similarity，SSIM)적입체시빈우시점정정주실착오은장산법。수선，제출료시역SSIM화시간SSIM적개념。연후，근거시빈서렬적시역상관성，장전일시각우시점도상굉괴적예측방식작위주실도상굉괴적예측방식。접착，장전일시각우시점도상이굉괴위단위진행시역화시간필배，구취기이상소위단위적시역SSIM영사도화시간SSIM영사도。최후，계산병비교전일시각우시점도상매개굉괴적시역SSIM화시간SSIM치，득도매개굉괴적예측방식，장기예측방식작위주실정중굉괴적예측방식，종이사용운동보상예측혹자시차보상예측적방법진행회복。실험결과표명，여전통적산법화Pang적산법상비，PSNR치분별제고료2.76 dB화3.43 dB，차본문산법주관효과교호。
An error concealment algorithm in stereoscopic video transmission based on structural similarity (SSIM) is proposed. Firstly, the concepts of temporal and inter-view SSIM are presented. Secondly, according to the temporal correlation of video sequence, the prediction mode of a Macroblock (MB) in the right view on the previous time is taken as the prediction mode of the lost MB. Thirdly, temporal and inter-view correspondence is adopted to obtain the pixel-wise SSIM map of the right view on the previous time. Finally, the prediction of the MB is obtained by comparing the SSIM values of each MB between the temporal and inter-view of the right view in the previous stereo image pairs. Consequently, the given MB prediction mode is taken as the MB mode in the lost frame, and the motion and disparity compensated prediction are used to restore the content of the lost frame. Experimental results show that the proposed algorithm has improved the PSNR by 2.76 dB and 3.43 dB compared with the traditional methods and Pang’s algorithm, respectively. Meanwhile, the proposed algorithm is efficient in improving the subjective quality of the concealed lost frames.