As an enhancement, could the notification always stay up while the key is ON, e.g. always show "Caps Lock On" while caps is on.
Also, while deleting the OSD message eliminates the Caps Lock Off message, it would be good if the sounds could be applied individually to each state, eg play sound for CAPS ON, but no sound for CAPS OFF.
Nice program, simple, thanks for creating it.