Rate Limit when they throw exception?

Hi!
I have an annoying spammer who will occasionally trigger lots of error logs for bad CSRF tokens.
Basically they keep throwing the throw SecurityException::forDisallowedAction(); action from system/Security/Security.php

Is there a way to trigger a rate limit so that for every time this error occurs, they will eventually get blocked from using the site? This person did it like 500+ times over the course of an hour so it wouldn't catch many innocent users.