So simple! Moved App/Config/Tasks.php to my Module Config folder and it works.
I did try sticking a copy in the Module Config directory before but had not removed the copy in the App Config folder.
As you suggested the trick must be just having one Task.php config file.