I prefer to grind the spacer with the pad as well (epoxied together). That way everything lines up perfectly, and it will never shift. It is much more difficult to get everything to line up, and stay lined up, otherwise, and any misalignment will look horrible.
Every professional stock smith that I've come across does the same thing, unless the customer requests otherwise.