.Google.com's Gary Illyes discloses Googlebot gathers web links instead of "following" them, contradicting official paperwork.Googlebot gathers hyperlinks as opposed to observing all of them in real-time.Gary Illyes discussed this details in Google's 'Search Off The Record' podcast.Google's records contradicts the actual spider behavior.