LOS ANGELES—A Justice Department push for immigration courts to prioritize cases involving unaccompanied minors has raised concern among lawyers and judges that the move could undermine children's rights and lead to an even greater backlog of cases.

On Monday, attorneys here representing minors seized at the southwest border said that clients weren't being properly notified that their court dates had been moved up, and they expressed...