If the characters you meet are criticizing your appearance, this might mean your Style points are too low. Your Style value is shown in the top left corner of the Clothing Store. Having enough Style gives you free bonus progress during projects.
Gain Style by purchasing more clothing items from the store. Each item will boost your Style value.