I'm going to agree with Kate.
Most peoples first kisses do suck.
So you have nothing to worry about.
Maybe he didn't mean the comment in an offensive way.
Don't worry about it.
If he really likes you then he'll forget about the first kiss and enjoy all the ones in the future!