You can avoid every single elder drake. However, I do not remember how exactly to avoid the ones in the little holes. I think there may be little stepping stones immediately inside that you can't see.