Depends what's said, and in what context. And obviously things are very different if it isn't a one off.

The 'I made a mistake' defence has its limitations.

Plus sincerity is notoriously difficult to judge.