New Delhi, April 30: Convicted RJD chief Lalu Prasad on Monday blamed Prime Minister Narendra Modi after he was told to leave AIIMS where he was being treated to return to Ranchi, shortly after Congress President Rahul Gandhi called on the former Bihar Chief Minister.