Physical infidelity is not the end of the world. It is different for both men and women. Women are usually emotionally involved, but men generally don't need to be emotionally involved to have an affair. I can deal with that in my head, although I do believe there needs to be fidelity in a relationship.
But anyone can make a mistake. It depends on your relationship whether or not you can survive that difficulty. Sometimes it can make your relationship better.