There's not a ton of difference. I prefer the 10x42s but when I'm backpacking 5-10 miles in, the 10x32 are the way to go. I have a pair of 10x50 vultures, and you can't tell much difference in light gathering. I can tell you that the Furys have better features and are very comfortable. The Vultures are nice too, but They are bulky and the eye piece came loose on mine a few times.
I sit next to someone while glassing all the time and they usually have 10x42s. I can tell you that I have never had a problem seeing what the guy next to me sees in the early morning, day, or evening.