You'r not the only one... I was close to trow my whole PS into a wall.
But after a while I found a way. Try to force him into the wall in way that prevent him from running away. Then slowly walk towards the elevator.