KREDIBILITAS SINTETIS DALAM IKLAN ENDORSEMENT DEEPFAKE: ANALISIS SEMIOTIKA MULTIMODAL DI MEDIA SOSIAL INDONESIA

Authors

DOI:

https://doi.org/10.37802/candrarupa.v5i2.1580

Keywords:

Deepfake advertising, Public figure impersonation, Online gambling advertising, Social semiotics, Multiple case study

Abstract

Deepfake endorsement advertisements that attach the faces and voices of well known Indonesian figures to online gambling sites and investment schemes have become a recurring form of digital fraud. This study examines how such advertisements construct credibility for an endorsement that never took place. Using a qualitative multiple case design with multimodal semiotic analysis, it combines the meaning transfer model of celebrity endorsement, the three dimensions of source credibility, and the grammar of visual design. Seven cases from 2024 to 2026, each declared synthetic by fact checkers, by the impersonated figure, or by the institution concerned, were purposively selected and analysed through the documentation in verification reports. The analysis shows that synthetic credibility is assembled in three cumulative layers. The first layer appropriates the credibility dimension already attached to a public persona: expertise for financial officials and business leaders, trustworthiness for journalists and news presenters, and attractiveness for entertainers. The second layer fabricates the fit between endorser and product through scripts of ownership, generosity, insider access, and success testimony, so that a figure with no relation to gambling appears to have a reason to recommend it. The third layer converts that credibility into action through direct address or overheard testimony, concrete financial promises, and exit routes to external links or private messaging groups. The study concludes that the decisive weakness of these advertisements lies in their fabricated endorsement relation rather than in their technical realism, and it proposes endorser consent verification and fit literacy as complements to technical detection in design education and platform governance

Author Biographies

  • Ernawati Ernawati, Universitas Maarif Hasyim Latif

    Program Studi Desain Komunikasi Visual

  • Bayu Setiawan, University of Pembangunan Nasional Veteran Jawa Timur

    Program Studi Desain Komunikasi Visual

  • Risma Andini, Universitas Maarif Hasyim Latif

    Program Studi Desain Komunikasi Visual

References

Birrer, A., & Just, N. (2025). What we know and don’t know about deepfakes: An investigation into the state of the research and regulatory landscape. New Media & Society, 27(12), 6819-6838. https://doi.org/10.1177/14614448241253138

Braniwati, M. (2025). Privatisasi iklan konvensional di ruang publik. CandraRupa: Journal of Art, Design, and Media, 4(1), 1-7. https://doi.org/10.37802/candrarupa.v4i1.815

Campbell, C., Plangger, K., Sands, S., & Kietzmann, J. (2022). Preparing for an era of deepfakes and AI-generated ads: A framework for understanding responses to manipulated advertising. Journal of Advertising, 51(1), 22-38. https://doi.org/10.1080/00913367.2021.1909515

Cek Fakta Tempo. (2025). Keliru: Video Raffi Ahmad promosikan situs judi online miliknya. Tempo. https://www.tempo.co/cekfakta/keliru-video-raffi-ahmad-promosikan-situs-judi-online-miliknya-1216123

CNBC Indonesia. (2026, September 17). CT jadi korban rekayasa AI, video promo investasi dipastikan hoaks. https://www.cnbcindonesia.com/tech/20260917165919-37-768797/ct-jadi-korban-rekayasa-ai-video-promo-investasi-dipastikan-hoaks

CNN Indonesia. (2024, Januari 16). Waspada hoaks iklan judi online Najwa Shihab, Raffi, Atta pakai AI. https://www.cnnindonesia.com/teknologi/20240116154203-192-1050246/waspada-hoaks-iklan-judi-online-najwa-shihab-raffi-atta-pakai-ai

Detikcom. (2026, September 17). Video promosi investasi catut Chairul Tanjung dipastikan hoax. https://news.detik.com/berita/d-8666838/video-promosi-investasi-catut-chairul-tanjung-dipastikan-hoax

Groh, M., Epstein, Z., Firestone, C., & Picard, R. (2022). Deepfake detection by human crowds, machines, and machine-informed crowds. Proceedings of the National Academy of Sciences, 119(1), e2110013119. https://doi.org/10.1073/pnas.2110013119

Hancock, J. T., & Bailenson, J. N. (2021). The social impact of deepfakes. Cyberpsychology, Behavior, and Social Networking, 24(3), 149-152. https://doi.org/10.1089/cyber.2021.29208.jth

Jayanti, G. T. (2025). Analisa semiotika Roland Barthes: Representasi citra Belle Epoque pada iklan parfum Chanel No 5 tahun 1960. CandraRupa: Journal of Art, Design, and Media, 4(1), 41-45. https://doi.org/10.37802/candrarupa.v4i1.749

Katadata. (2026, Juli 22). Waspada, nama Deputi Gubernur BI dan Menkeu dicatut hoaks rekomendasi saham. https://katadata.co.id/digital/teknologi/6a60b3e6dca91/waspada-nama-deputi-gubernur-bi-dan-menkeu-dicatut-hoaks-rekomendasi-saham

Köbis, N. C., Doležalová, B., & Soraperra, I. (2021). Fooled twice: People cannot detect deepfakes but think they can. iScience, 24(11), 103364. https://doi.org/10.1016/j.isci.2021.103364

Koning, B., & Voorveld, H. A. M. (2025). Disclaimer! This content is AI-generated: How AI-disclosures influence trust in advertisements and organizations. Journal of Interactive Advertising, 25(3), 240-253. https://doi.org/10.1080/15252019.2025.2554149

Kontan. (2026, Agustus 10). Per Juni 2026, IASC terima 1.379 laporan penipuan terindikasi memanfaatkan AI. https://keuangan.kontan.co.id/news/per-juni-2026-iasc-terima-1379-laporan-penipuan-terindikasi-memanfaatkan-ai

Kress, G., & van Leeuwen, T. (2021). Reading images: The grammar of visual design (3rd ed.). Routledge.

McCracken, G. (1989). Who is the celebrity endorser? Cultural foundations of the endorsement process. Journal of Consumer Research, 16(3), 310-321. https://doi.org/10.1086/209217

Medcom.id. (2025, Mei 5). Pandji Pragiwaksono jadi korban deepfake AI, wajahnya dipakai promosi judi online. https://www.medcom.id/hiburan/montase/8kozQqlb-pandji-pragiwaksono-jadi-korban-deepfake-ai-wajahnya-dipakai-promosi-judi-online

Miles, M. B., Huberman, A. M., & Saldaña, J. (2020). Qualitative data analysis: A methods sourcebook (4th ed.). SAGE.

Milkha, & Arissuta, D. P. (2026). Visualisasi fenomena microtrend dan fear of missing out (FOMO) generasi Z dalam karya seni digital. CandraRupa: Journal of Art, Design, and Media, 5(1), 72-85. https://doi.org/10.37802/candrarupa.v5i1.1368

Noerman, C. T., & Ibrahim, A. L. (2024). Kriminalisasi deepfake di Indonesia sebagai bentuk pelindungan negara. Jurnal USM Law Review, 7(2). https://doi.org/10.26623/julr.v7i2.8995

Ohanian, R. (1990). Construction and validation of a scale to measure celebrity endorsers’ perceived expertise, trustworthiness, and attractiveness. Journal of Advertising, 19(3), 39-52. https://doi.org/10.1080/00913367.1990.10673191

Putri, N. F., & Lobodally, A. (2024). A multimodal analysis of a brand ambassador post on social media. Jurnal ASPIKOM, 9(1), 45-60. https://doi.org/10.24329/aspikom.v9i1.1254

Sands, S., Campbell, C. L., Plangger, K., & Ferraro, C. (2022). Unreal influence: Leveraging AI in influencer marketing. European Journal of Marketing, 56(6), 1721-1747. https://doi.org/10.1108/EJM-12-2019-0949

Seftiani, & Hasuri. (2025). Effectiveness of law enforcement on online gambling promotion among influencers. KRTHA Bhayangkara, 19(1), 260-271. https://doi.org/10.31599/krtha.v19i1.3603

Tempo. (2025). CekFakta #302: Waspada deepfake mencatut tokoh publik untuk menipu. https://www.tempo.co/newsletter/cekfakta-302-waspada-deepfake-mencatut-tokoh-publik-untuk-menipu-1216218

Tirto. (2024a). Hoaks iklan judi online mencatut tvOne. https://tirto.id/hoaks-iklan-judi-online-mencatut-tvone-g2vQ

Tirto. (2024b, April 22). Hoaks Komeng promosikan situs judi online. https://tirto.id/hoaks-komeng-promosikan-situs-judi-online-gX2i

Tirto. (2024c, April 1). Hoaks situs judi online buatan Nikita Mirzani. https://tirto.id/hoaks-situs-judi-online-buatan-nikita-mirzani-gXr5

Torrance, J., John, B., Greville, J., O’Hanrahan, M., Davies, N., & Roderique-Davies, G. (2021). Emergent gambling advertising; a rapid review of marketing content, delivery and structural features. BMC Public Health, 21, 718. https://doi.org/10.1186/s12889-021-10805-w

Whittaker, L., Letheren, K., & Mulcahy, R. (2021). The rise of deepfakes: A conceptual framework and research agenda for marketing. Australasian Marketing Journal, 29(3), 204-214. https://doi.org/10.1177/1839334921999479

Wortel, C., Vanwesenbeeck, I., & Tomas, F. (2024). Made with artificial intelligence: The effect of artificial intelligence disclosures in Instagram advertisements on consumer attitudes. Emerging Media, 2(3), 547-570. https://doi.org/10.1177/27523543241292096

Downloads

Published

2026-10-26