Chirrut pales, balking, and rears back.

"No, I... Baze, Baze, how can I face her, I..." Eiko trusted him to train her, to lift her up - he threw that in her face.

He and Baze have been friends for the vast majority of their lives - he can trust Baze's reassurance about his forgiveness. For Eiko... he doesn't have that grounding.