The change to PERL_CONFIGURE_WITH results in configure args that look like this when the perl option is enabled:
$ make -V CONFIGURE_ARGS
--without-loadable-filters --without-iconv --without-locale --with-/usr/local/bin/perl --prefix=/usr/local ${_LATE_CONFIGURE_ARGS}
The "--with-/usr/local/bin/perl" is invalid.