It could be the Through Out Bearing giving up the Ghost.
It could be - but if it is - that means the clutch is incorrectly adjusted.
Under normal circumstances the throw out bearing should be sitting there doing nothing, not even rotating - until you depress the clutch pedal, bringing it into contact with the fingers on the clutch plate.
If a defective throw out bearing is going to make noise, it'll usually do it when the pedal is depressed, not when it's released.
It is possible, if the clutch has been incorrectly adjusted, for the throw out bearing to be in contact with the clutch plate, and to go silent when you push the pedal, but, I don't think it's going to be a "pronounced whine/rumble" that varies "power on/power off".
Put the transfer case in neutral and run it through the gears - if the noise is still present, it'll be either in the transmission or transfer case - if it's not, it'll be the axle or the transfer case ouput