When setting up Custom Fields, whether at the Agency or Site level, the Selection List field must be set to "Required" in order for a validation error to fire. The check will validate that the value entered by the user is one of the configured selection options in the selection list.