New Delhi: Former Finance Minister P. Chidambaram on Monday said that RBI Governor Raghuram Rajan had the right to speak on all issues and not only on those within his brief. "Two mature people can disagree but that doesn't mean one has to abuse the other, question the other's patriotism, question the other's intellectual capability. That is where I think he felt deeply hurt and decided to quit. India is the loser," Chidambaram told NDTV news channel. BJP leader Subramanian Swamy had publicly attacked Rajan saying he was "mentally not fully Indian". He also wrote to Prime Minister Narendra Modi demanding that Rajan be denied an extension. Later, Rajan announced that he was not taking a second term. Asked if Rajan had exceeded his brief, Chidambaram said: "What is the RBI Governor's brief? Where is it written? He is an acknowledged academic, author and intellectual. He spoke on issues which are in the public domain." "He said only tolerant societies can move forward fast. You cannot have a high degree of intolerance. With one section of people living in fear, and still hoping for inclusive growth. Why not? What is wrong in these words? Did he use abusive language? Did he maim anyone?" he asked.