Hydrostatic pressure is defined on dictionary.com as:
A fluid at equilibrium at a given point within the fluid, due to the force of gravity. Hydrostatic pressure increases in proportion to depth measured from the surface because of the increasing weight of a fluid exerting downward force from above.
That's quite an involved definition. So I'm going to elaborate with pictures to make this important force a bit easier to understand.