Sure will be one or the other when "Googling", especially in the "Images" search mode, noticed the oddly contained pictures and texts from access guns pages in the search index. Such results are notable in that one does not get further on the landing page without previous login or user account.
But as the Google bot then came to the contents, finally he did so in the search index?
The answer are HTTP headers, such as the browser ID differ identify the Google bot as a bot and of normal web surfers. Some Site Admins have therefore a browser switch tinkered certain bots to pass through, but requires normal web surfers an application.
This makes the content of a site for the Google bots available without so equal for the general release. Background for such behavior is, of course, that some sites owe their popularity to search engines respectively their findability, but derives its revenues by ABO, pay-per-view or similar models, which definitely require a user login.
But even for those Browerweichen there are elegant way to circumvent this as a normal user. Surely you can manipulate the HTTP header of the browser directly, which means Firefox Extensions even goes pretty easy. The course assumes some knowledge and some handles.
It is better because of the way through a web proxy such as Be-The-Bot , must they not change the browser and the access to certain sites are "more or less" anonymous through the proxy.