Freeing the bird from its cage is the easy half of the couplet; the hard, lasting work is named in the second line — getting the cage out of the bird's heart. The image quietly relocates captivity from the world to the mind, where a habit of confinement outlasts the bars themselves.