Bob, from the discussions I have seen, Inyo set the rules after meeting with Yosemite. If you look at the Yosemite rules, they get so detailed that it's ok to walk across a paved road, but not ok to ride in a vehicle -- no hitch-hiking, etc. That would void a permit.

They specifically say it's ok to camp overnight in the Tuolumne
Backpackers camp one night. And they say that traveling around Yosemite Valley would void a permit.

Desk-jockey is right. Go figure.