Plugin disregards 404 template in Production mode

[gbowne-quickbase]

We had an issue with our 404 template not showing in production and on a whim I disabled Canary and the 404 template showed up again.

This is the behavior in production mode when a 404 fires:

I've added ./craft plugin/disable canary to my production deploy script so I can keep it on in dev and test environments, but it would be great if it didn't do that!