Translating a shader takes CPU cycles. If the game needs a shader that hasn't been translated yet, the frame will drop or "hitch" while the CPU finishes the work.
While common in the community, downloading pre-compiled caches is generally for two main reasons: Xenia Shader Cache Download
\xenia\cache\ or \xenia\shaders\