What can I do about this coworker of mine?

Just don't take his bait. Smile and do your job. Make it very clear that he is not getting to you and can't, and it will stop.