It is better to tell them that you are not interested and hang up. After all, these folks are just trying to make a living, also.
I agree with you, until they get rude, and then the gloves are off in my opinion. I try to give them a no, instead of hanging up in there ear. That is sometimes long enough for them to say something inappropiate.