Post

Fuzzers vs. AI: Comparing Fuzzilli and BigSleep on JavaScript Engines

Google Project Zero’s comparison finds that LLM-based bug hunting and traditional fuzzing catch substantially different V8 vulnerabilities, so security teams get better coverage by using both.

Over six months in production, BigSleep reported 45 vulnerabilities and Fuzzilli 37, with 25% overlap in the reported bugs. A separate experiment estimated overlap closer to 60%, and the authors caution that the comparison method may undercount shared findings. Either way, each approach found bugs the other missed.

The Lobsters discussion included a practitioner’s observation that agent-assisted review plus generative and deterministic tests can expose more and more interesting bugs; another reader called the article heavy on management framing.