It is normal for your Star Score to fluctuate even if you win.

Your Star Score may not raise if your winning score is close to your average. Lower winning scores can slightly drop your Star Score.