Construction of multi-modal social media dataset for fake news detection

Guopeng GAO; Yaodong FANG; Yanfang HAN; Zhenxing QIAN; Chuan QIN

doi:10.11959/j.issn.2096-109x.2023060

您当前的位置：

首页 >

文章列表页 >

Construction of multi-modal social media dataset for fake news detection

Papers | 更新时间：2024-06-03

- Construction of multi-modal social media dataset for fake news detection
- Chinese Journal of Network and Information Security Vol. 9, Issue 4, Pages: 144-154(2023)
- 作者机构：
  
  1. 上海理工大学光电信息与计算机工程学院，上海 200093
  2. 复旦大学计算机科学技术学院，上海 200433
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2023060
  CLC： TP393
- Online First：2023-08，
  
  Published：25 August 2023
- 稿件说明：
移动端阅览
Guopeng GAO, Yaodong FANG, Yanfang HAN, et al. Construction of multi-modal social media dataset for fake news detection[J]. Chinese Journal of Network and Information Security, 2023, 9(4): 144-154.
DOI：

Guopeng GAO, Yaodong FANG, Yanfang HAN, et al. Construction of multi-modal social media dataset for fake news detection[J]. Chinese Journal of Network and Information Security, 2023, 9(4): 144-154. DOI： 10.11959/j.issn.2096-109x.2023060.

摘要

社交媒体的出现正在改变着人们的生活，通过社交媒体可以便捷地获取和分享新闻，但同时助力了虚假新闻的滋生和传播，从而严重影响社会安全和稳定。因此，虚假新闻检测引起了研究者广泛关注。尽管存在多种基于深度学习的解决方案，但这些方法需要大量的数据作为支撑。现有的虚假新闻数据集，尤其是中文数据集不仅稀缺，而且数据集中的新闻大多属于同一个类别。为了更好地检测虚假新闻，构建了一个新的多模态的虚假新闻数据集（MFND，multi-modal fake news dataset），其中包含政治、经济、娱乐、体育、国际、科技、军事、教育、健康和社会生活这 10 个类别的中文和英文新闻数据。对提出的虚假新闻数据集的词频和类别进行分析，并与现有的虚假新闻数据集在新闻数量、新闻类别、模态信息和新闻语种等方面进行了对比，结果显示 MFND 在类别信息和新闻语种方面表现突出。另外，利用现有的典型虚假新闻检测方法在 MFND 上进行训练和验证，实验结果表明，相较于现有主流的虚假新闻数据集，MFND可以为模型提供10%左右的性能提升。

Abstract

The advent of social media has brought about significant changes in people’s lives.While social media allows for easy access and sharing of news

it has also become a breeding ground for the dissemination of fake news

posing a serious threat to social security and stability.Consequently

researchers have shifted their focus towards fake news detection.Although several deep learning-based solutions have been proposed

these methods heavily rely on large amounts of supporting data.Currently

there is a scarcity of existing datasets

particularly in Chinese

and the collected news articles are often limited to the same category.To enhance the detection of fake news

a new multi-modal fake news dataset (MFND) was developed

which comprised Chinese and English news data from ten diverse categories: politics

economy

entertainment

sports

international affairs

technology

military

education

health

and social life.The word frequencies and categories of the proposed fake news dataset were analyzed and compared with existing fake news datasets in terms of number of news

news categories

modal information and news languages.The results of the comparison demonstrate that the MFND dataset excels in terms of category information and news languages.Moreover

training and validating existing typical fake news detection methods with MFND dataset

the experimental results show an improvement of approximately 10% in model performance compared to existing mainstream fake news datasets.

关键词

Keywords

references

ALLCOTT H , GENTZKOW M . Social media and fake news in the 2016 election [J ] . Journal of Economic Perspectives , 2017 , 31 ( 2 ): 211 - 36 .

CONROY N K , RUBIN V L , CHEN Y . Automatic deception detection:methods for finding fake news [J ] . Proceedings of the Association for Information Science and Technology , 2015 , 52 ( 1 ): 1 - 4 .

SHU K , SLIVA A , WANG S H , et al . Fake news detection on social media:a data mining perspective [J ] . ACM SIGKDD Explorations Newsletter , 2017 , 19 ( 1 ): 22 - 36 .

VOSOUGHI S , ROY D , ARAL S . The spread of true and false news online [J ] . Science , 2018 , 359 ( 6380 ): 1146 - 1151 .

LI L , CAI G , CHEN N . A rumor events detection method based on deep bidirectional GRU neural network [C ] // Proc of 2018 IEEE 3rd International Conference on Image,Vision and Computing . 2018 : 755 - 759 .

郑洪浩 , 郝一诺 , 于洪涛 , 等 . 基于改进 Transformer 的社交媒体谣言检测 [J ] . 网络与信息安全学报 , 2022 , 8 ( 4 ): 168 - 174 .

ZHEN H H , HAO Y N , YU H T , et al . Rumor detection in social media based on eahanced Transformer [J ] . Chinese Journal of Network and Information Security , 2022 , 8 ( 4 ): 168 - 174 .

CHENG M X , NAZARIAN S , BOGDAN P . Vroc:variational autoencoder-aided multi-task rumor classifier based on text [C ] // Proc of the Web Conference 2020 . 2020 : 2892 - 2898 .

MA J , GAO W , MITRA P , et al . Detecting rumors from microblogs with recurrent neural networks [C ] // Proc of the 25th International Joint Conference on Artificial Intelligence . 2016 : 3818 - 3824 .

YU F , LIU Q , WU S , et al . A convolutional approach for misinformation identification [C ] // Proc of the 26th International Joint Conference on Artificial Intelligence . 2017 : 3901 - 3907 .

BIAN T , XIAO X , XU T Y , et al . Rumor detection on social media with bi-directional graph convolutional networks [C ] // Proc of the AAAI Conference on Artificial Intelligence . 2020 : 549 - 556 .

ZHANG H W , FANG Q , QIAN S S , et al . Multi-modal knowledge-aware event memory network for social media rumor detection [C ] // Proc of the 27th ACM International Conference on Multimedia . 2019 : 1942 - 1951 .

AZRI A , FAVRE C , HARBI N , et al . Calling to CNN-LSTM for rumor detection:a deep multi-channel model for message veracity classification in microblogs [C ] // Proc of Joint European Conference on Machine Learning and Knowledge Discovery in Databases . 2021 : 497 - 513 .

亓鹏 , 曹娟 , 盛强 . 语义增强的多模态虚假新闻检测 [J ] . 计算机研究与发展 , 2021 , 58 ( 7 ): 1456 - 1465 .

QI P , CAO J , SHENG Q . Semantics-enhanced multi-modal fake news detection [J ] . Journal of Computer Research and Development , 2021 , 58 ( 7 ): 1456 - 1465 .

JIN Z W , CAO J , GUO H , et al . Multimodal fusion with recurrent neural networks for rumor detection on microblogs [C ] // Proc of the 25th ACM International Conference on Multimedia . 2017 : 795 - 816 .

TUAN N M D , MINH P Q N . Multimodal fusion with BERT and attention mechanism for fake news detection [C ] // Proc of 2021 RIVF International Conference on Computing and Communication Technologies . 2021 : 1 - 6 .

GOODFELLOW I , POUGET-ABADIE J , MIRZA M , et al . Generative adversarial nets [C ] // Proc of the 27th International Conference on Neural Information Processing Systems . 2014 : 2672 - 268 .

MITRA T , GILBERT E . Credbank:a large-scale social media corpus with associated credibility annotations [C ] // Proc of the International AAAI Conference on Web and Social Media . 2015 : 258 - 267 .

POTTHAST M , KIESEL J , REINARTZ K , et al . A stylometric inquiry into hyperpartisan and fake news [J ] . arXiv Preprint arXiv:1702.05638 , 2017 .

WANG W Y . “Liar,liar pants on fire”:a new benchmark dataset for fake news detection [J ] . arXiv Preprint arXiv:1705.00648 , 2017 .

GAO Z W , YADA S , WAKAMIYA S , et al . Naist covid:multilingual covid-19 Twitter and Weibo dataset [J ] . arXiv Preprint arXiv:2004.08145 , 2020 .

SHAHI G K , NANDINI D . FakeCovid—a multilingual cross-domain fact check news dataset for COVID-19 [J ] . arXiv Preprint arXiv:2006.11343 , 2020 .

DU J S , DOU Y T , XIA C Y , et al . Cross-lingual covid-19 fake news detection [C ] // Proc of 2021 International Conference on Data Mining Workshops . 2021 : 859 - 862 .

BOIDIDOU C , ANDREADOU K , PAPADOPOULOS S , et al . Verifying multimedia use at mediaeval 2015 [C ] // Proc of the MediaEval 2015 Multimedia Benchmark Workshop . 2015 . 14 - 15 .

TACCHINI E , BALLARIN G , DELLA VEDOVA M L , et al . Some like it hoax:automated fake news detection in social networks [J ] . arXiv Preprint arXiv:1704.07506 , 2017 .

YANG Y , ZHENG L , ZHANG J W , et al . TI-CNN:convolutional neural networks for fake news detection [J ] . arXiv Preprint arXiv:1806.00749 , 2018 .

NAKAMURA K , LEVY S , WANG W Y . Fakeddit:a new multimodal benchmark dataset for fine-grained fake news detection [J ] . arXiv Preprint arXiv:1911.03854 , 2019 .

LI Y C , JIANG B H , SHU K , et al . MM-COVID:a multilingual and multimodal data repository for combating covid-19 disinformation [J ] . arXiv Preprint arXiv:2011.04088 , 2020 .

SLANEY M , CASEY M . Locality-sensitive hashing for finding nearest neighbors [J ] . IEEE Signal Processing Magazine , 2008 , 25 ( 2 ): 128 .

WANG Y Q , MA F L , JIN Z W , et al . Eann:event adversarial neural networks for multi-modal fake news detection [C ] // Proc of the 24th ACM SIGKDD International Conference on Knowledge Discovery＆ Data Mining . 2018 : 849 - 857 .

KIM Y . Convolutional neural networks for sentence classification [C ] // Proc of the 2014 Conference on Empirical Methods in Natural Language Processing . 2014 : 1746 - 1751 .

DEVLIN J , CHANG M W , LEE K , et al . Bert:pre-training of deep bidirectional transformers for language understanding [J ] . arXiv Preprint arXiv:1810.04805 , 2018 .

SINGHAL S , SHAH R R , CHAKRABORTY T , et al . SpotFake:a multi-modal framework for fake news detection [C ] // Proc of 2019 IEEE 5th International Conference on Multimedia Big Data . 2019 : 39 - 47 .

Views

487

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Twitter user geolocation method based on single-point toponym matching and local toponym filtering

Related Author

Jin XUE

Fuxiang YUAN

Yimin LIU

Meng ZHANG

Yaqiong QIAO

Xiangyang LUO

Related Institution

School of Cyber Science and Engineering, Zhengzhou University

Henan Key Laboratory of Cyberspace Situation Awareness

School of Information Engineering, North China University of Water Resources and Electric Power

⁰