Yeah he might be annoying and you may be getting sick of him, but dont beat him up. Just Tell him to quit or just dont hang out with him anymore if it is bothering you so much. No need to start with the violence.