I wouldn't, Steven. While "meet" does mean "get togther and talk", it can also mean to be introduced to someone for the first time.
"Pleased to meet you"
For clarity, I would add "with" if I was using "meet" to mean have a discussion.
"What do you want to meet with me for?"
That's just a personal preference. Your version is not incorrect.