Google supports different techniques that allows you to decide outside of crawling and indexing of the URLs. If you have to block some documents, directories, and even your full web site from Google Research, have a look at our guide about approaches to circumvent written content from showing in search https://zakabet.com/