There are plenty of people on here who prefer Pamporovo, a quick search of the forums will show that. Personally I felt Bansko had more character and life about it. However I know Pamporovo is developing quickly (so far I believe tourist numbers are up 20% on 2004-5) and haven't been there recently. News to me that there are 3 lifts there, I must admit.
As far as I know, the "apres-ski" and general facilities in Bansko are better and there is a pile of money being invested, with talk of a new gondola, ring road and even an airport
. When the E84 upgrades are finished it will be easier to get to as well. Again, this has all been referred to at length on other threads.
However, I wouldn't spend too much time worrying about what other people think, it's pretty obvious what your gut feeling is. If I were you I'd go with it. Best of luck