Ray J's Manager's PISSED at Kanye West ... Watch Your F****** Mouth! (VIDEO)

If Kanye West wanted to get under people's skin with his "Famous" music video ... it worked, and now he's got Ray J's manager on his ass ... making serious threats. Ray was in downtown L.A. when we asked what he thought of his nude appearance in…