Marginal Income tax rate/s and pension pot and Carers Allowance

A while ago I took my 25% tax free lump sum from my private pension and thanks to folks advice on here it was fine and has had no impact on my Carers Allowance,
However we find ourselves in a position where we need to move house and the properties that are suitable for my husband’s wheelchair come at a premium - so I am trying to find out if I take another lump sum, which I will pay marginal income tax on will I lose my Carers Allowance - the person who is my adviser for my pension doesn’t know - thanks everyone in advance