Do I need to involve Microsoft directly to switch CSP partners, or just the two partners?

The relationship change happens through Microsoft's partner center/admin systems, but as the customer, your role is mainly to approve the new partner's relationship request — you don't typically need to contact Microsoft support directly for a standard partner switch. Your new (and sometimes outgoing) partner generally drives the process on the Microsoft side.