I think this song has something to do with a person (female) leaving the two men, an artist and an outlaw, that she had loved. It probably has to do with her relationship with both. That's what the "You want to leave, but don't want to take me." brings to my mind. The artist probably feels somewhat at fault for her leaving or he's trying to keep her from leaving. "And you should know I'm not asking anything from you."