Disallow reading contacts..is it possible??

I am new to Note5 . Coming from OneOlus Cynogen. Could not find setttings to Disallow all Apps from reading my contacts by Default and Allow where its really needed.
This was easy todo on Cynogen using Privacy Guard settings. (Per App control)