Mahlab is a delicious but somewhat obscure spice that comes from the seed of a cherry tree. A member of the peach and almond family, mahlab or St. Lucie cherries are harvested for their pits, which are cracked open to reveal small light-brown kernels.