To simply answer your question: Yes you should be concerned.
There is more to it than that though however. If you have more partners in your life other than your wife it is possible you have had since then. Frequently in men HPV is silent, until it rears is ugly head, and causes bad things, like oral cancers.
You need to be tested. The fact that she has cheated more recently, and that she was positive 2 years ago indicates that she probably picked it up someplace else, if she would have gotten it from you it most likely would have shown up sooner.
Please make an appointment with your Dr and go get tested. You need to know, so you can take care of you, and possibly any future partners you may have.