Assuming the late charge is spelled out in your note and disclosed consistently in your TIL, it's a breach of contract to charge more. Breach of contract probably creates more exposure than the TIL violation. Discuss this problem with bank counsel and prepare to identify all affected customers and refund the overcharges.
_________________________
...gone fishing.