Stone is first encountered at about -1600 ft. and becomes increasingly common as one gets deeper. It is impossible to dig through a stone (unless you completed Challenges before starting and got the multidrill reward); instead you have to find a way around it, or use Dynamite or Plastic Explosives to destroy it.
A stone.
The demo version of the game is filled with walls of stone past -825 ft.