Yes, you can leave attachment to all worldly things, too. But it must be done from the consciousness that they are not real and they are not eternal. If you approach this from the point of view that you are buying yourself into heaven, it will not be an effective way. It all must take place in the Now and not be put off to some future event.
Finding that silence within, unperturbed by the ceaselessly chattering mind, is the path to discovering your soul. There are many paths that lead to this state of Unity. You may even find it by reading the words of an inspired yogi who is speaking from the heart.