I tried to get pastoral counselling and our pastor took HIS side. ... What kind of advice is that? It's like telling him it was ok to cheat.
Change churches. Today. Go find yourself a church that will give you the bible in context instead of just picking and choosing to benefit one party and not the other.
Yes, forgiveness is important. And yes, we need to eventually forgive. But when adultery is involved, "the faithful spouse is under no obligation to take the adulterer back" (this statement is an actual quote from my own pastor, said during the sermon recently).
Think of it - even your spouse committing murder does not give you right to D. But adultery is the only biblically sanctioned reason for dissolution of marriage besides satanism in modern Christian dogma. Because it's about protecting yourself from a future of sin and pain not of your doing. So you have to be sure he has changed, and you always have the option to bolt if he cheats.
And taking him back and forgiving him in your heart are two completely different things. You can forgive him but still divorce him. I'm very close to forgiving my STBXWW now. But she hasn't changed. So I'm Ding. If she changes, there's always remarriage.
You'd be following both Matthew 6:14-15:
For if you forgive others their trespasses, your heavenly Father will also forgive you, but if you do not forgive others their trespasses, neither will your Father forgive your trespasses
But also following Proverbs 5-8 (about an adulterer, in this case a woman):
Keep to a path far from her, do not go near the door of her house,
lest you lose your honor to others and your dignity to one who is cruel,
lest strangers feast on your wealth and your toil enrich the house of another.
About my STBXWW, if this doesn't describe NC and the 180, I don't know what does.
All of Proverbs is great to read when in infidelity recovery, I think.
On taking STBXWW back before she has done the work on herself first, I rather like Prov 6:24-35:
keeping you from your neighbor’s wife, from the smooth talk of a wayward (woman).
Do not lust in your heart after her beauty or let her captivate you with her eyes.
For a prostitute can be had for a loaf of bread, but another man’s wife preys on your very life.
Can a man scoop fire into his lap without his clothes being burned?
Can a man walk on hot coals without his feet being scorched?
So is he who sleeps with another man’s wife no one who touches her will go unpunished.
People do not despise a thief if he steals to satisfy his hunger when he is starving.
Yet if he is caught, he must pay sevenfold, though it costs him all the wealth of his house.
But a man who commits adultery has no sense whoever does so destroys himself.
Blows and disgrace are his lot, and his shame will never be wiped away.
You do your work, find a church and a pastor who gets it (is there a DivorceCare group in that church? They are usually better informed on these matters), and let WH work on his own stuff.