Yeah, Banff is certainly busier. But it has its good sides as well. I used to avoid it (in favour of Jasper), but have spent more time there in the last five years or so. The museum (the natural history one) is really cool, like you say.
The drive between Jasper and Banff on the Icefields Parkway is a must-do. Some fantastic sights along the way. Did you stop at the pull out at the top of the "big bend" hill (you'll know which one I mean if you've done the drive) where there's a look out to "Bridal Falls". I always find it amusing to watch the tourists stop, look in semi-awe at Bridal Falls, and get back in the car and drive away, not knowing that there's a much more impressive waterfall (Panther Falls) just metres from the upper edge of the parking area. To get a view of it, though, requires a walk of about 200 metres down some switchbacks. There's a tiny little sign at one end of the parking area marking the start of the trail. Actually, there are at least six waterfalls within a couple hundred metres of that spot, and most people only see Bridal Falls.
And if you have a couple extra hours, a side trip across to Yoho NP is worthwhile.