Controllers with analog sticks (joysticks) will make it seem like analog sticks were moved when pressing other buttons. This is common in old controllers but newer controllers rarely have this problem. Use a newer controller or be extra careful when configuring the buttons.