Boyfriend situation! help!?

I live on a busy schedule with two jobs and school and I barely have time with my boyfriend who isn't doing either (he got a full time job but is waiting for all his security background check to be performed - it's a fed government job so you know..). Anyway so I told him I would come over his place tonight after school at 10pm to hang out for a little bit. BUT I am just swamped with homework! I have midterms all of this week and I was to tell him that I can't come over anymore. Would it be mean if I called him and told him that? Or should I just suck it up and hang out with him? I love him so much and I love spending time with him but I have to sacrifice fun for work sometimes. Help! WHAT SHOULD I DO??