The rock removal isn't much of an issue if you, say, ring your local council and ask where they stockpile material. Our council has several acres with piles of sand, clay, rock, mixed, etc. that gets dumped after trenching, levelling, et al. jobs and reused when fill is needed.

"Good" rock (for some value of) can even fetch a bit of cash from garden centres and elsewhere.