What should i do? Give him time or just let go?

I married when i was 20 to the guy i thought was the love of my life, we have a son together and at that point in life we were happy and everything seemed fine. Well unfortunately i cheated on him before we got married once with my oldest sons father. i told him, he forgave me and still chose to marry me. As our marriage went on he said that i always treated him like he was the one who cheated. My only conclusion to this is it was because i thought he was going to do it to get back to me and honestly i didn't even realize i was doing it. He ended up leaving me for another woman and now 4 years later around the beginning of november we got back together. He broke up wih me like 2 weeks before thanksgiving because he said he wasn't ready...He called me the day before we were planning on going to ky for thanksgiving and told me he was sorry and he wanted to try it again. So i accepted with letting him know he needed to be sure that was what he really wanted and he ured me it was. Well everything seemed to be going fine until last night when he told me that he loves me but he is not "in love" with me and he is not sure what he wants. That sometimes when he is with me he is happy and wants to be there but others he just doesn't want to be there and that i do make him happy and that it's not me it's him..He just doesn't see that flame anymore like he did when we were first together. He is so set in his ways now and being able to do whatever he wants when he wants and not having anyone to answer to or check in with for so long, that's what he is used to. He will not give me a definate answer as to whether we are together still or not and i can't handle it. What should i do or think even? Someone help...i really need an outsiders advice please!