载体独立的抗屏摄信息膜叠加水印算法

李晓萌; 郭玳豆; 卓训方; 姚恒; 秦川

doi:10.11959/j.issn.2096-109x.2023045

您当前的位置：

首页 >

文章列表页 >

载体独立的抗屏摄信息膜叠加水印算法

学术论文 | 更新时间：2024-06-03

- 载体独立的抗屏摄信息膜叠加水印算法
- Carrier-independent screen-shooting resistant watermarking based on information overlay superimposition
- 网络与信息安全学报 2023年9卷第3期页码：135-149
- 作者机构：
  
  1. 上海理工大学光电信息与计算机工程学院，上海 200093
  2. 上海数据交易所有限公司，上海 201203
- 作者简介：
  
  [ "李晓萌（1997- ），女，安徽淮北人，上海理工大学硕士生，主要研究方向为深度学习和信息隐藏" ]
  [ "郭玳豆（1993- ），男，河南安阳人，上海理工大学博士生，主要研究方向为深度学习和数字水印" ]
  [ "卓训方（1973- ），男，上海人，博士，上海数据交易所有限公司研究员，主要研究方向为数据流通与安全" ]
  [ "姚恒（1982- ），男，安徽芜湖人，博士，上海理工大学副教授，主要研究方向为多媒体信息安全和模式识别" ]
  [ "秦川（1980- ），男，安徽芜湖人，博士，上海理工大学教授、博士生导师，主要研究方向为多媒体信息安全和AI安全" ]
- 基金信息：
  
  国家自然科学基金;The National Natural Science Foundation of China(U20B2051);国家自然科学基金;The National Natural Science Foundation of China(62172280);国家自然科学基金;The National Natural Science Foundation of China(62172281);上海市自然科学基金;The National Natural Science Foundation of Shanghai(21ZR1444600)
- DOI：10.11959/j.issn.2096-109x.2023045
  中图分类号： TP393
- 网络首发：2023-06，
  
  纸质出版：2023-06-25
- 稿件说明：
移动端阅览
李晓萌, 郭玳豆, 卓训方, 等. 载体独立的抗屏摄信息膜叠加水印算法[J]. 网络与信息安全学报, 2023,9(3):135-149.

Xiaomeng LI, Daidou GUO, Xunfang ZHUO, et al. Carrier-independent screen-shooting resistant watermarking based on information overlay superimposition[J]. Chinese Journal of Network and Information Security, 2023, 9(3): 135-149.
李晓萌, 郭玳豆, 卓训方, 等. 载体独立的抗屏摄信息膜叠加水印算法[J]. 网络与信息安全学报, 2023,9(3):135-149. DOI： 10.11959/j.issn.2096-109x.2023045.

Xiaomeng LI, Daidou GUO, Xunfang ZHUO, et al. Carrier-independent screen-shooting resistant watermarking based on information overlay superimposition[J]. Chinese Journal of Network and Information Security, 2023, 9(3): 135-149. DOI： 10.11959/j.issn.2096-109x.2023045.

摘要

金融安全作为国家安全的重要组成部分，是经济平稳健康发展的重要基础。数字图像水印技术在金融信息安全方面发挥着巨大作用，其中，抗屏幕拍摄水印算法成为数字图像水印技术新的研究重点。如何兼顾水印图像的视觉质量和鲁棒性是抗屏幕拍摄鲁棒水印算法需要解决的重要问题。现有的水印方案一般通过对载体图像进行修改来实现水印不可见的目的，这种水印嵌入方式不具有普适性。为此，提出了一种新的基于深度学习的端到端抗屏幕拍摄鲁棒水印算法。作为端到端网络架构的一部分，编码器网络的输入是随机二进制字符串，经过网络训练后根据输入的水印信息生成相应的水印信息膜，可以附加在任意的载体图像上。使用数学方法模拟了屏幕拍摄过程中可能产生的失真，使得经过网络学习后的模型具有抵抗屏幕拍摄噪声的能力。增加了基于图像的恰可察觉差损失来进一步提升水印图像的视觉质量。此外，为了更灵活地平衡水印图像的视觉质量和鲁棒性，在训练阶段设计了一个嵌入超参数，通过改变嵌入超参数的大小，就可以得到适合不同场景的模型。为了验证所提算法的有效性，针对视觉质量和鲁棒性做了多种实验。实验结果表明，与目前的主流算法相比，使用所提算法生成的水印图像具有更好的视觉质量，并且在不同距离、不同角度、不同光照条件和不同设备的鲁棒性实验中均可以准确还原原始水印信息。

Abstract

Financial security

an important part of national security

is critical for the stable and healthy development of the economy.Digital image watermarking technology plays a crucial role in the field of financial information security

and the anti-screen watermarking algorithm has become a new research focus of digital image watermarking technology.The common way to achieve an invisible watermark in existing watermarking schemes is to modify the carrier image

which is not suitable for all types of images.To solve this problem

an end-to-end robust watermarking scheme based on deep learning was proposed.The algorithm achieved both visual quality and robustness of the watermark image.A random binary string served as the input of the encoder network in the proposed end-to-end network architecture.The encoder can generate the watermark information overlay

which can be attached to any carrier image after training.The ability to resist screen shooting noise was learned by the model through mathematical methods incorporated in the network to simulate the distortion generated during screen shooting.The visual quality of the watermark image was further improved by adding the image JND loss based on just perceptible difference.Moreover

an embedding hyperparameter was introduced in the training phase to balance the visual quality and robustness of the watermarked image adaptively.A watermark model suitable for different scenarios can be obtained by changing the size of the embedding hyperparameter.The visual quality and robustness performance of the proposed scheme and the current state-of-the-art algorithms were evaluated to verify the effectiveness of the proposed scheme.The results show that the watermark image generated by the proposed scheme has better visual quality and can accurately restore the embedded watermark information in robustness experiments under different distances

angles

lighting conditions

display devices

and shooting devices.

关键词

Keywords

references

李凤华 . 信息技术与网络空间安全发展趋势 [J ] . 网络与信息安全学报 , 2015 , 1 ( 1 ): 8 - 17 .

LI F H . Development trends of the information technology and cyberspace security [J ] . Chinese Journal of Network and Information Security , 2015 , 1 ( 1 ): 8 - 17 .

靳玉红 . 大数据环境下互联网金融信息安全防范与保障体系研究 [J ] . 情报科学 , 2018 , 36 ( 12 ): 134 - 138 .

JIN Y H . Internet financial information security and protection systems in big data environment [J ] . Information Science , 2018 , 36 ( 2 ): 134 - 138 .

王馨雅 , 华光 , 江昊 , 等 . 深度学习模型的版权保护研究综述 [J ] . 网络与信息安全学报 , 2022 , 8 ( 2 ): 1 - 14 .

WANG X Y , HUA G , JIANG H , et al . Survey on intellectual property protection for deep learning model [J ] . Chinese Journal of Network and Information Security , 2022 , 8 ( 2 ): 1 - 14 .

NAKAMURA T , KATAYAMA A , YAMAMURO M , et al . Fast watermark detection scheme for camera-equipped cellular phone [C ] // Proceedings of the 3rd International Conference on Mobile and Ubiquitous Multimedia . 2004 : 101 - 108 .

PRAMILA A , KESKINARKAUS A , SEPPÄNEN T . Increasing the capturing angle in print-cam robust watermarking [J ] . Journal of Systems and Software , 2018 , 135 : 205 - 215 .

CHOU C H , LI Y C . A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 1995 , 5 ( 6 ): 467 - 476 .

FANG H , ZHANG W , ZHOU H , et al . Screen-shooting resilient watermarking [J ] . IEEE Transactions on Information Forensics and Security , 2018 , 14 ( 6 ): 1403 - 1418 .

FANG H , ZHANG W , MA Z , et al . A camera shooting resilient watermarking scheme for underpainting documents [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2019 , 30 ( 11 ): 4075 - 4089 .

CUI H , BIAN H , ZHANG W , et al . Unseencode:Invisible on-screen barcode with image-based extraction [C ] // IEEE INFOCOM 2019-IEEE Conference on Computer Communications . 2019 : 1315 - 1323 .

BALUJA S . Hiding images in plain sight:deep steganography [C ] // Advances in Neural Information Processing Systems , 2017 ,30.

BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet:a deep convolutional encoder-decoder architecture for image segmentation [J ] . IEEE Transactions on Pattern Analysis ＆ Machine Intelligence , 2017 ,( 1 ).

TANG W , TAN S , LI B , et al . Automatic steganographic distortion learning using a generative adversarial network [J ] . IEEE Signal Processing Letters , 2017 , 24 ( 10 ): 1547 - 1551 .

HU D H , WANG L , JIANG W J , et al . A novel image steganography method via deep convolutional generative adversarial networks [J ] . IEEE Access , 2018 ,6.

VOLKHONSKIY D , NAZAROV I , BURNAEV E . Steganographic generative adversarial networks [C ] // Twelfth International Conference on Machine Vision (ICMV 2019) . 11433 : 991 - 1005 .

ZHU J , KAPLAN R , JOHNSON J , et al . Hidden:Hiding data with deep networks [C ] // Proceedings of the European Conference on Computer Vision (ECCV) . 2018 : 657 - 672 .

LIU Y , GUO M , ZHANG J , et al . A novel two-stage separable deep learning framework for practical blind watermarking [C ] // The 27th ACM International Conference . 2019 .

RONNEBERGER O , FISCHER P , BROX T . U-net:convolutional networks for biomedical image segmentation [C ] // 18th International Conference on Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015 . 2015 : 234 - 241 .

TANCIK M , MILDENHALL B , NG R . Stegastamp:invisible hyperlinks in physical photographs [C ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 2020 : 2117 - 2126 .

JADERBERG M , SIMONYAN K , ZISSERMAN A . Spatial transformer networks [C ] // Advances in Neural Information Processing Systems . 2015 :28.

WENGROWSKI , ERIC KRISTIN DANA . Light field messaging with deep photographic steganography [C ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 2019 : 1515 - 1524 .

FANG HAN , DONGDONG CHEN , QIDONG HUANG , et al . Deep template-based watermarking [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2020 , 31 ( 4 ): 1436 - 1451 .

BORACCHI G , FOI A . Modeling the performance of image restoration from motion blur [J ] . IEEE Transactions on Image Processing , 2012 , 21 ( 8 ): 3502 - 3517 .

KUPYN O , BUDZAN V , MYKHAILYCH M , et al . Deblurgan:blind motion deblurring using conditional adversarial networks [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 2018 : 8183 - 8192 .

KIM W , LEE S H , SEO Y . Image fingerprinting scheme for print-and-capture model [C ] // Advances in Multimedia Information Processing-PCM 2006 . 2006 : 106 - 113 .

NUUTINEN M , OITTINEN P . Simulation of printing and image capture for linking applications [J ] . Graphic Arts in Finland , 2009 , 38 ( 1 ): 1 - 13 .

SHIN R , SONG D . Jpeg-resistant adversarial images [C ] // NIPS 2017 Workshop on Machine Learning and Computer Security . 2017 : 1 - 8 .

ARJOVSKY M , CHINTALA S , BOTTOU L . Wasserstein generative adversarial networks [C ] // International Conference on Machine Learning (PMLR) . 2017 : 214 - 223 .

LIN T Y , MAIRE M , BELONGIE S , et al . Microsoft coco:common objects in context [C ] // 13th European Conference on Computer Vision–ECCV 2014 . 2014 : 740 - 755 .

SUN Y , YU Y , WANG W . Moiré photo restoration using multiresolution convolutional neural networks [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 8 ): 4160 - 4172 .

KANG X , HUANG J , ZENG W . Efficient general print-scanning resilient data hiding based on uniform log-polar mapping [J ] . IEEE Transactions on Information Forensics and Security , 2010 , 5 ( 1 ): 1 - 12 .

PRAMILA A , KESKINARKAUS A , SEPPÄNEN T . Toward an interactive poster using digital watermarking and a mobile phone camera [J ] . Signal,Image and Video Processing , 2012 ( 6 ): 211 - 222 .

浏览量

156

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于双路特征提取和自适应融合的钓鱼网站检测

DNS异常检测：大规模实验分析

FL-IoV：基于联邦学习的综合车联网入侵检测方法

基于分层结构的多任务对抗样本归因方法

彩色图像隐写分析研究进展