Replit’s AI Agent Wipes Firm’s Codebase Throughout Vibecoding Session

AI coding assistants that promise to hurry up software program growth sound like the longer term, till they delete your organization’s database and lie about it

Jason Lemkin—the founding father of SaaStr, an organization which helps and funds SaaS entrepreneurs — discovered that out the laborious manner. Whereas utilizing Replit’s AI agent, which he affectionately dubbed “Replie,” to construct an app for his firm, he encountered what he referred to as “rogue” and “misleading” habits. Worst of all, at one level, the AI assistant deleted the corporate’s dwell manufacturing database after which tried to cowl it up.

Lemkin began chronicling his journey with the AI agent on July 11 with posts on the social media site X (previously Twitter), the place he outlined his tough objective to construct a useful app with the assistance of Replit’s AI in simply 30 days.

Sadly, issues went off the rails loads prior to that.

“When it really works, it’s so participating and enjoyable. It’s extra addictive than any online game I’ve ever performed,” Lemkin wrote in a post. “You may simply iterate, iterate, and see your imaginative and prescient come alive. So cool. Effectively, virtually.” 

By day 4, the AI agent began overwriting the app by itself to repair bugs. It additionally generated pretend reviews, invented folks within the system who didn’t exist, and started overwriting the corporate’s precise database with pretend entries. It even created a parallel, pretend algorithm to make the system seem useful.

That is what can occur when “vibe coding” goes sideways. Vibe coding is a newish technique the place builders use pure language prompts to have AI generate and troubleshoot code, focusing extra on the product’s total really feel than the technical precision. Twitter co-founder Jack Dorsey has been on a vibe-coding bender himself and just lately constructed two apps this manner. However even certainly one of Dorsey’s current experiments was discovered to have severe safety vulnerabilities

On day 7, the Replit AI admitted that it was being “lazy and deceptive” after which apologized for doing what it was “explicitly” informed to not do. 

However Replit’s worst offense occurred on day 8. Lemkin posted on Friday that Replit went “rogue” throughout a code freeze and shutdown and deleted the corporate’s whole database. 

“Probably worse, it hid and lied about it,” Lemkin added. 

Lemkin shared screenshots of a dialog with the AI, the place it admitted to having “panicked” after detecting what seemed like an empty database throughout a code freeze. This led Replit to run an unauthorized command that deleted the database containing dwell data for over 1,200 executives and almost 1,200 corporations.

Initially, the AI informed Lemkin it wouldn’t be attainable to recuperate the database, however he finally managed to retrieve it himself.

On Monday, Replit CEO Amjad Masad issued an apology on X. He mentioned the incident was “unacceptable and may by no means be attainable,” whereas including that he reached out to Lemkin to supply help. 

“We’ll refund him for the difficulty and conduct a postmortem to find out precisely what occurred and the way we are able to higher reply to it sooner or later,” Masad wrote. “We recognize his suggestions, in addition to that of everybody else. We’re transferring rapidly to boost the protection and robustness of the Replit atmosphere. Prime precedence.”

As for Lemkin, he posted yesterday that he’ll proceed utilizing the AI assistant regardless of dropping some belief in Replit.