Consulting titles are difficult to compare across firms, so I would be careful about treating Manager to Associate as a literal demotion. The more useful comparison is scope, compensation, learning curve, promotion timing, and what the role positions you to do next.
At McKinsey, the Associate role can still involve substantial client responsibility and is a core post-graduate or experienced-hire entry point. Your Big 4 management experience may help you ramp faster, but the firm will still want you to learn its problem-solving approach, communication standards, and team model before moving into the next level.
The emotional part is real, though. If you have tied a lot of identity to the Manager title, the change can feel uncomfortable even if the underlying opportunity is stronger. It helps to ask whether you are optimizing for the next twelve months or the next five years.
I would compare the actual trajectory. If the McKinsey role gives you stronger work, better exits, faster development, or a path you genuinely want, the temporary title difference may be a small price. If those benefits are not compelling, then the brand alone is not enough reason to move. A useful reference is MBB vs Big 4 if you want to go deeper on that part.