This map might help. I hope the site allows direct links like this, 'cause this map is a pretty good guide, if I remember correctly.

One tip - when you're trying to find the key, don't worry about following the line-of-sight of the various workers. Ignore them, and just dig in the right spot