Why can't I remove a workout I didn't do?

I schedule a workout on Saturday that I didn't complete but now I can't remove it as the Remove button isn't available. Why is that?