CSRF The action you have requested is not allowed

How could I manage to get the error message posted within the regular error messages returned with the form, instead of having this ugly(!) default page error?

You will have to extend the core class CI_Security and override the method csrf_show_error()

But the point of CSRF is deflecting cross-site scripting attacks and returning a helpful message to the hacker may not be the best idea.