I cannot fathom how people miss the fact that it wasn't about him dipping his quill in another inkwell. It was about perjury directly related to a sexual harassment case with multiple complainants.
Infidelity, while it speaks to moral condition, is not a criminal issue. Perjury and sexual harassment are criminal issues.
Sadly, perjury and sexual harassment are probably some of the most trivial of his misdeeds.