Jim, that's too bad!
Have you called Inyo wilderness permit office? There is a ranger's cabin on the north side of Charlotte, and if they can radio the ranger, he might be able to walk over and look for it. I would talk to them, and see if you could email or fax the text of what you have written here to them, so there is less chance of the message getting lost in transmission.
Edit: In fact, you might be able to identify the spot better on the Aerial Google Satellite map available via Gmap4:
(Map Link)
