Hey Breanna! First, thank you for taking an interest in the poem!
So, even though I wrote this poem, what I'm going to say not be taken literally because I'm like everyone else now, a reader with his own interpretations since it's now "complete." I'm confident that you know that, but this just for anyone else reading this comment.
I wrote that line because I see that there is so much emphasis on forgiveness within Christianity (not that there's anything wrong with that, I applaud it actually). The poem takes place in the summer night, so it's already a "sinful" time of day. At the beginning of the poem, the speaker took the signs of the black cats and the moon very literally like it was the sign of God himself that he gives himself up to the music that he forsook a long time ago. So the speaker uses Christianity as forgiveness, hence the wine and confession, as an excuse to come back to his love, which is music and trying to make himself feel guilt-free about it. I know the speaker might not sound likable after saying that, but yeah, I hope this gives you some perspective!