That face on the second panel...I think it's warping my mind.

Wait, where did Koishi's helmet go?

So the hat wasn't part of it after all!