You're correct; the first one is the right one. You could easily tell him that if he removed "My boyfriend and," then you would have, "I [am] going to the concert." You definitely don't say "Me [am] going to the concert."