TLDR Tech / Dev
Will It Mythos?
Mythos is a security tool believed to be amazing at finding vulnerabilities, but there's skepticism about the validity of its claims and operational costs that may limit broader access. Therefore, a benchmarking project was launched to test whether other AI models could match Mythos's performance in identifying security bugs, using a collection of confirmed vulnerabilities it had previously found. Preliminary results show that, while some models performed surprisingly well, none consistently outperformed Mythos.
Read the full story