Confused...In need of advice!?

He's married to you. Your paranoia will only work against you and destroy your relationship. You are clinging to stuff that happened long before you got together. Let it go as he's not doing anything that doesn't appear to be innocent at this moment in time but keep your eyes wide open...just in case.