That sounds so similar to the view I had of mine - I had the 950 SM R. When I bought it, it was really as so many people on TRC (or may have even been VD) raved about them, and I loved the looks, and V twins in general so thought it would be my perfect bike
I think some of the problem was that I also had a Tuono at the time, and decent as it was, the KTM engine was a bit lacking compared to the Rotax V60 , even with the X-Bikes tune.
Mine was also very twitchy too and would wobble and weave quite scarily north of 100- I fannied around playing with suspension, fork and ride height etc and swapping tyres, but the high-speed scariness was always there, I strongly suspect due to the front mudguard, albeit I never proved it, as looks aside, the bike was just a bit meh for me and didn't stick around that long as a result