By default, it uses the file in test/data/rest_config.yml but you can modify with --mode_config the location.

th tools/rest_multi_models.lua -gpuid 1

Note

The default host is set to 127.0.0.1 which only allows local access. If you want to support remote access, use 0.0.0.0 instead. Default port is 7784. You can change the unload time with --unload_time Xsec