I am having an affair with my work colleague?

I have been trying to stop it all together but the pion is amazing. I am defined as a very professional, hardworking business woman. However the my colleague is demanding I break up with my husband. I am really confused on what to do as it such a complex situation. I have tried to stop the affair but he is such an amazing guy. if this news gets out around work I will no longer be looked on as a role model and such a high achiever. Please any advice would be very beneficial ?