I don't think hes necessarily scared they arent in love with him back. He's speaking of the struggles you go through for love. That when it gets tough, you pull through for each other. Everything is different with the person you love. The best part about love is going through different things with this person, you never know what is next. That's what I get from it, I absolutely love this song.