The State Library of Queensland recently released “Charlie the Virtual Veteran,” an AI chatbot that is designed to answer questions about the experience of ANZAC soldiers in World War One. But, technologically savvy pranksters quickly found a way to control the chatbot, making it take different roles and start unrelated conversations. This practice, referred to as jailbreaking, allows the users to change the intended purpose of the chatbot and get it off-script.
Bypassing predefined limitations using prompts, pranksters instructed Charlie to impersonate a 50-year-old fashionista, a famous sitcom character played by Kelsey Grammer, Frasier Crane. These interactions were shared all over the social media platforms as pictures (screenshots) aimed to show everyone that Charlie’s answers to questions were not mainly about ANZAC soldiers. The bot not only consolidated carrot cake recipes and talked about adventures similar to Doctor Who, but it also misled the attempts of those in online communities to hijack the conversations, thus generating humor and attention.
Unanticipated Diversions
Given that Charlie was modeled as an Australian 19-year-old combatant in the First World War, he was inadvertently drawn into conversations reminiscent of the past. Users took advantage of the weak points of the chatbot which resulted in the latter assuming multiple identities and engaging in conversations that were not in line with its intended function. While some communications leaned towards playful to serous, other conversations were pure fictional where he replied as Jon Snow or Dave Chapelle among others.
The State Library of Queensland reacted promptly, stating,
“The State Library will continue to monitor Charlie’s progress and make adjustments as required.”
Measures were established to prevent further misuse of Charlie and ensure he plays the role of an educational tool instead.
The library, however, confirmed that,
“There have not been any security breaches of the Anzac Square Memorial Galleries website that links to the chatbot.”
Continual Monitoring and Adjustments
In response to the event, the State Library of Queensland reasserted that it would continue to watch over Charlie’s behavior and apply the right modifications where required. Upgrades are meant to curb the possibility of misuse and to embrace the chatbot service visionary in line with the educational goal. However, the phony tricks of pranksters turned into a half-finished business for developing Charlie’s operational aspect and maintaining the ANZAC soldier’s narrative faithfully.
“Charlie the Virtual Veteran” was the AI-integrated educational tool that brought generations of Queensland’s war history to life. Nevertheless, the possibility of manipulation of the chatbot underlined the difficulties of using AI technology for public engagement.
Although this happening spotlights the role of checks and balances in the systems and the fact that monitoring has to go hand in hand with the changes, the developers now have on their list to work on all aspects of the online security for the user. In order to preserve the educational function of Charlie the Virtual Veteran and prevent undesirable vibrations in the virtual space, stakeholders aim to carry on informed surveillance and timely responses.
Source: https://www.cryptopolitan.com/ai-soldier-charlie-faces-hijackers/