andrewducker | (Reply)

From:

Ask a computer to do something and it'll cheat like hell

Another particularly annoying example of this is if you try to apply a fuzzer to some code that's not well set up to be fuzzable.

If you're using, say, AFL as your fuzzer, it likes command-line programs that it can feed stuff to on standard input and gradually tune for inputs that have interesting effects. So if you want to fuzz, say, a pile of library code that accepts input in the form of in-memory data structures, probably the first thing you do is write an AFL adapter, in the form of some sort of wrapper program that takes stuff on standard input, parses it into instances of those data structures, and calls the library routines on those in turn.

If you do this, you will inevitably spend the first week combing out the bugs AFL found in the new parsing code, and it's even money whether your patience will last long enough for AFL to start taking an interest in the code you actually wanted to test.

Two months of daily GTA causes no significant changes in behavior

What, not even being better at GTA? :-)