Geek-Guy.com

Category: deepfakes

California AG launches investigation into X’s sexualized deepfakes

California Attorney General Rob Bonta announced an investigation Wednesday into xAI over allegations that its artificial intelligence model Grok is being used to create nonconsensual sexually explicit images of women and children on a large scale, marking the latest escalation in regulatory efforts to address AI-generated deepfakes. The California investigation focuses on Grok’s “spicy mode,”…

British regulator Ofcom opens investigation into X

The UK’s top internet regulator opened a formal investigation into social media network X after users, with the help of its AI chatbot Grok, flooded the site with nonconsensual, AI-manipulated nude and undressed photos of real people. On Monday, the Office of Communications (Ofcom), which regulates internet and telecommunications companies, said the investigation will determine…

FCC finalizes new penalties for robocall violators

The Federal Communications Commission finalized new financial penalties for telecoms that submit false, inaccurate or late reporting to a federal robocalling system. The new regulations, which go into effect Feb. 5, will require providers to recertify every year that their information is accurate in the Robocall Mitigation Database (RMD). It would also impose fines on…

French authorities investigate AI ‘undressing’ deepfakes on X

France will probe AI-generated sexual deepfakes made with Grok on X after hundreds of women and teens reported “undressed” images shared online. French authorities will investigate AI-generated sexually explicit deepfakes created with Grok on X after hundreds of women and teens reported manipulated “undressed” images shared on social media. Grok is an artificial intelligence chatbot…

Organizations can now buy cyber insurance that covers deepfakes

Synthetic media, including AI-generated deepfake audio and video, has been increasingly leveraged by criminals, scammers and spies to deceive individuals and businesses. Sometimes they do so by imitating an employee’s CEO, urging them to transfer large sums of money or provide them access to work accounts. Other times this fake media is created by a…

Advocacy group calls on OpenAI to address Sora 2’s deepfake risks

Throughout 2024, OpenAI teased the public release of Sora, its new video generation large language model, capable of creating lifelike visuals out of user prompts. But due to concerns about the tool being used to create realistic disinformation during a  critical U.S. election year, the company delayed its release until after the elections.  Now, a…

Why a new anti-revenge porn law has free speech experts alarmed 

The newly signed Take It Down Act makes it illegal to publish nonconsensual explicit images – real or AI-generated – and gives platforms just 48 hours to comply with a victim’s takedown request or face liability. While widely praised as a long-overdue win for victims, experts warn its vague language, lax standards for verifying claims,…

 FTC wants a new, segregated software system to police deepfake porn 

The head of the Federal Trade Commission described to lawmakers Thursday new technology, personnel and infrastructure the agency needs as it prepares to implement and enforce the Take It Down Act, placing the FTC’s enforcement wing at the forefront of the fight against nonconsensual deepfake pornography. The FTC’s proposed budget holds funding at $425.7 million,…

FBI warns of fake texts, deepfake calls impersonating senior U.S. officials

The FBI said Thursday that malicious actors have been impersonating senior U.S. government officials in a text and voice messaging campaign, using phishing texts and AI-generated audio to trick other government officials into giving up access to their personal accounts. The warning provided few details about the campaign, which started in April and appears to…

House passes legislation to criminalize nonconsensual deepfakes

The House passed a bill Monday evening that would criminalize using a person’s likeness to create nonconsensual deepfake pornography. The Take It Down Act sailed through the chamber on a vote of 402-2, marking one of the first major pieces of legislation passed by Congress to address AI-generated deepfakes. The bill makes it a federal…

Has GetReal cracked the code on AI deepfakes? $18M and an impressive client list says yes

The proliferation of scarily realistic deepfakes is one of the more pernicious byproducts of the rise of AI, and falling victim to scams based on these deepfakes is already costing companies millions of dollars — not to mention the implications these could have on national security. A startup that’s built a toolset aimed at governments…

Microsoft IDs developers behind alleged generative AI hacking-for-hire scheme

Microsoft has identified individuals from Iran, China, Vietnam and the United Kingdom as primary players in an alleged international scheme to hijack and sell Microsoft accounts that could bypass safety guidelines for generative AI tools. In December, Microsoft petitioned a Virginia court to seize infrastructure and software from 10 unnamed individuals who the company claims…

UK’s internet watchdog toughens approach to deepfake porn

Ofcom, the U.K.’s internet safety regulator, has published another new draft guidance as it continues to implement the Online Safety Act (OSA) — the latest set of recommendations aim to support in-scope firms to meet legal obligations to protect women and girls from online threats like harassment and bullying, misogyny, and intimate image abuse. The…

Deepfake videos are getting shockingly good

Researchers from TikTok owner ByteDance have demoed a new AI system, OmniHuman-1, that can generate perhaps the most realistic deepfake videos to date. Deepfaking AI is a commodity. There’s no shortage of apps that can insert someone into a photo, or make a person appear to say something they didn’t actually say. But most deepfakes…

UK confirms plans to criminalize the creation of sexually explicit deepfake content

The U.K. is forging ahead with plans to make the act of creating sexually explicit “deepfake” images a specific criminal offence. A deepfake refers to manipulated media, often video or audio, created using AI to make someone appear to say or do something they didn’t. The U.K. had already made sharing — and the threat…