Sure it raises eyebrows, sometimes I get shocked laughter, once I was asked if I wrote things like 50 Shades of Grey. Today I got asked if I was promiscuous. I grinned and said, "only in my imagination."
As an erotic author its very interesting to think about the "image" we portray. Much like major celebrities, the transition to into the "Limelight" comes with a certain amount of stereotyping. I read a forum post written by an erotic author, her very first post was to "debunk" the stereotype that she was an old, fat male. But the truth is with the anonymity of pen-names many of us are old, or fat, or male, or ugly, or ... and many of us are also your next door neighbor, your teacher, your cleaning lady, your nurse, your sister, your cousin.
The good news is that no one really cares any more. Promiscuity is no longer the "horror-filled" shock it once was. Look at Nelly Fertado's clothing in this video. Whether or not you agree with the "skimpy" nature, the shown belly button, the tank tops, the halters... its considered NORMAL. Finding "one piece" swimsuits at the water park is considered strange!
100 years ago it was considered immodest to show ankles. Sure some cultures still are like that, but at least the American standard is continually changing, flashing ankles, baring tummies... accepting "porn books." Maybe in ten years people won't be so shocked when I say I write erotica.