We shouldn't go thinking that this was because they were ideologically similar - a hell of a lot more to do with SA numbers climbing & public opinion shifting.
Many clung to the KPD until it was essentially banned - a number of the first KZ inmates were staunch KPD.
Also, always remember Carl didn't challenge 'Tommy' when he claimed I sent dudes to his place with AK-47s.