Should I break up with my bf?

So i started dating this guy for about three weeks now. We moved kinda fast in that he became my boyfriend only after 2 weeks. It just felt right. We really enjoyed each others company and we were seeing each other every day. I was really happy. This last week has been kinda weird though. He's been a little more distant and im wondering if he feels we rushed into things too quickly. We went from wanting to see each other all the time to now when we do have plans like we did friday night he texted me an hour before i was supposed to meet him and asked if he could just go out with his guy friend without me. I kept asking if everything was ok and he keeps insisting everything is fine and not to worry but then today he texted me at 6 that he got a promotion at his job and i congratulated him and said I would love to take him out this week to celebrate.. he never responded then I texted him again at 11:30 at night saying how happy i was for him and that I was going to bed and would talk in the morning and he still hasn't responded. It seems like he's being shady and my gut just doesn't feel right about this situation anymore and I'm not sure what to do. He seemed great but he's quickly changing and I feel like I can't even be myself around him. Maybe I'm reading into things to much but I don't know...Any thoughts?