Even more important than the warmth and affection we receive, is the warmth and affection we give. It is by giving warmth and affection, by having a genuine sense of concern for others, in other words through compassion, that we gain the conditions for genuine happiness. More important than being loved, therefore, is to love.
How can one be compassionate if you belong to any religion, follow any guru, believe in something, believe in your scriptures, and so on, attached to a conclusion? When you accept your guru, you have come to a conclusion, or when you strongly believe in god or in a saviour, this or that, can there be compassion? You may do social work, help the poor out of pity, out of sympathy, out of charity, but is all that love and compassion?
Without religion, also there is a way, it could be this way, through education, through scientific findings, then you get conviction. Not necessarily really love other, but for their own interest they are showing love, compassion to other like that.
I presume that you are compassionate: to be without pity means to be sick in body and spirit. But one should have spirit in abundance, so as to be permitted to be compassionate! For your pity is detrimental to you and to everyone.