First, that's not a good sign that the nut was loose and you could pull the hub off by hand. When they are that loose almost always the keyway in either the hub or the axle shaft is damaged, sometimes both are. Usually too the key itself is buggered. Often the hole in the hub is wallowed out as well.
Second, why are you changing drums? Are they damaged? Frankly I would not try to take those hubs and drums apart unless
absolutely necessary. They are held together by the studs being hydraulically pressed in from the rear. The studs are swagged to force a tight fit in the hub. If you must do it you will need to have a shop do it with a hydraulic press in order to avoid damaging the hubs. You also should replace all the studs with new ones as ones that have been pressed in and then pressed out won't be as tight the second time.
Third, those don't look like the right drums for this application.
Here's a recent discussion of the same issue:
http://cj-3a.com/forum/YaBB.pl?num=1303485390/9#9Larry