The Congress on Saturday asserted that Devendra Fadnavis, who was sworn in as Maharashtra chief minister early this morning, will have to step down "shamefully" as all its MLAs and those of the NCP, except a few from the Sharad Pawar-led party, are together.