If I recall correctly I think it originally meant they served on the crusades.
That's what I've heard as well, though I've recently heard that may be apocryphal.
I'm also curious as to whether or not the choice of animal at their feet have any significance. Almost every brass or effigy I've seen has either a dog or lion at the knight's feet, though I believe occasionally there are other animals.