1824, in pony up "to pay," of uncertain origin. OED says from pony (n.), but not exactly how. In other sources said to be from slang use of Latin legem pone to mean "money" (first recorded 16c.), because this was the title of the Psalm for March 25, a Quarter Day and the first payday of the year (the Psalm's first line is Legem pone michi domine viam iustificacionum "Teach me, O Lord, the ways of thy statutes").