endocarp

the hard inner (usually woody) layer of the pericarp of some fruits (as peaches or plums or cherries or olives) that contains the seed; "you should remove the stones from prunes before cooking"