What did you restart? If you meant a web server, then make sure to set the env vars in the script that starts it.
For example, with the default Apache installation, export LD_LIBRARY_PATH & TNS_ADMIN in /etc/sysconfig/httpd
You don't need to set ORACLE_HOME when you use Instant Client.