Bengaluru: Senior Congress leader Roshan Baig, who criticised the party and urged Muslims to join hands with the BJP if there arises a need, will not join the saffron party because it had once conspired to end his political career, Karnataka minister U T Khader asserted Friday.