When people start running out of tests to benchmark it against humans. But that won't be as scary as when the agent is given (by humans) the ability to execute tasks outside of a sandbox. A lot of dumb animals are scary, after all.