Why is it so hard to leave religion?

Why is it so difficult for people to leave their religion, and potentially abandon their beliefs to which they may have clung most of their lives?

There are multiple aspects to this answer, obviously. On the one hand, people may leave their community (such as a church, mosque or synagogue) for a wide variety of reasons, but still very much maintain their belief system in that religion.