Election Officials on High Alert Amid AI Deepfake Concerns

Following the incident involving a deepfake robocall of President Joe Biden urging New Hampshire voters to abstain from the primary, there is growing apprehension that election officials themselves could be impersonated during the upcoming election cycle.

(Photo : CHRIS DELMAS/AFP via Getty Images)

This illustration photo show the Facebook page of former President Donald Trump on a smartphone screen in Los Angeles, March 17, 2023.

Targeting Election Officials

Ahead of the November elections, election officials are increasingly concerned about the potential for malicious attacks on the democratic process facilitated by the rise of generative AI. These instances highlight the urgent need for proactive measures.

Election officials are particularly susceptible targets due to their relative anonymity. Unlike well-known figures such as Joe Biden or Donald Trump, people may not readily discern anything amiss with falsified content involving election officials.

Politico reported that election officials hold a crucial role in the electoral process, making them appealing targets for manipulation.

Despite being widely trusted by the American public, election officials lack effective channels to directly engage with voters. This combination of factors renders a well-crafted fake involving election officials both highly hazardous and challenging to mitigate.

New Mexico Secretary of State Maggie Toulouse Oliver expressed a firm expectation that the dissemination of deepfake videos or other forms of disinformation targeting elections will occur during this election cycle.

During the National Association of Secretaries of State winter meeting last month, secretaries of state shared that they have commenced incorporating AI scenarios into their training sessions with local officials. They also plan to address the potential risks associated with AI-driven misinformation in their communication strategies with voters.

Previous Concerns

Over the past few years, election officials have grappled with addressing a deteriorating election landscape marked by rampant misinformation, which has eroded public confidence in the electoral process and led to physical threats.

Now, their concerns are mounting as they anticipate that AI technology will exacerbate this already formidable challenge.

Arizona Secretary of State Adrian Fontes, who conducted a training session last year featuring a deepfake simulation of himself disseminating false information, emphasized the potential for significant harm posed by AI.

He revealed ongoing discussions among staff with various stakeholders nationwide, underscoring the widespread apprehension regarding the detrimental impact of AI-driven misinformation.

Advancements in technology have progressed so swiftly that many individuals fail to recognize the ease and efficacy with which AI can impersonate them.

During election AI training sessions organized by the Brennan Center for Justice, participants are provided with a concrete demonstration of AI-driven misinformation. For instance, participants were recorded during a tabletop exercise and later shown deepfake videos of themselves disseminating misleading messages to the public.

Election officials emphasize their ongoing struggle against misinformation, citing the surge of doubts and conspiracy theories post-2020, largely driven by former President Trump's unfounded claims of election rigging and voter fraud.