.Google's Gary Illyes exposes Googlebot picks up hyperlinks as opposed to "observing" them, negating official paperwork.Googlebot gathers web links as opposed to observing all of them in real-time.Gary Illyes shared this info in Google's 'Browse Off The Record' podcast.Google's documentation negates the true crawler behavior.