Should I be jealous or annoyed that he's sleeping with someone else?

Yea its understandable when you like him and you got all your feelings up because you thought he liked you too. You can still feel jealous because you like previously someone even if they can an utter ***. My guess is annoyance because he wouldn't give you a proper relationship and he's still carrying on on what sounds like a man whore mission.