If it's angle is too severe, it could cause you problems with sex. Was it ever injured when you were young? If so, you could have Peyronie's Syndrome. It doesn't take a major trauma to cause that. But it can be corrected with surgury if necessary. If your doctor said it was alright, it probably is fine. But you can always get a second opinion.