They can definitely fail you on the agility test. For example, when I tested with AMR there was one candidate that failed because they dropped the weight that simulated a chair lift. From what I heard it was due to the loss of grip on the 75lbs curl bar.
That's just one example of an infraction...