Well if your were in riggins and seeing the deer coming down then they were most likely killed off the river by boaters.. Possibly be a few horse back hunters coming off wind river. My point is that that is not quite the same as the Dixie area. There is a road that goes to the river, (Macky Bar) and it is a good access point to hunt some of that country. The thing is that the snow is likely to come in November and you may not be able to drive bakc up or out to Dixie, at least very easy. bring shovels and two sets of tire chains...
there is also the the road that goes down to White Water Ranch. less likely to get snowed in. not as much country to access either.
there will be a lot of elk hunters in the area early. Fish and Game just cut a week or so off the late season in these untis. I think it closes the 11th now instead of the 18th of Nov... for elk any way. In my opinio that will help the herd, as it can be very very good elk hunting that time depending on snow level. I have hunted it a few times and always saw lot of elk. and lots of elk shot. lots!
There are some very nice mulies in there, but they are few and far between. also, a lot more whitetails then one would expect in the river breaks.
Is it worth it. yes.
Will you see other hunters, yes. and they are likely to be pretty hard core, and experienced with the area. Possibly even with an outfitter.
If you want to hunt deer and go from Dixie, I would look at the crooked creek drainiage. It is opened up by fire to say the least... you can look at it pretty good from jersey mountain. another option would be to hike off the top out to the breaks from cove mountain, or mammoth mountain and hike down towards the river and then bakc to Macky Bar and try to hitch back up to your truck..
I am sure you are aware that the mountains do not get any smaller as you go up river from riggins.
good luck.