I heard that people gave you trouble over that, and it still baffles me. I mean, even if BDSM is not your cup of tea, compared to what the darker side of HP fandom gets up to it is positively tame.
And omg, yes, it's so much fun. One of my new hobbies is going through TV series, movies or books I like and pairing people up into tops and subs. :D