I agree completely with other’s advice of “move forward” –there’s plenty of fish in the ocean, thank goodness you found out before marriage.
This guy’s been lying to you and he’s confessed (more or less) only to what he’s been caught at. Guarantee he is holding back/hiding more from you. Guaranteed. 100% guaranteed. And he’s not going to change his sexual impulses or fetishes, no matter what he might promise you.
Chalk one up to life experience and move along, find a new guy.