Can fake websites or profiles fool AI models?
Yes. Fake profiles and sites are common, and while Google usually filters them out, AI models sometimes repeat what they say.
See what eight AI engines say about your company. We track ChatGPT, Gemini, Google AI Mode, Perplexity and more, every day.
In our analysis of prominent companies, a meaningful share had a prominent fake profile or website, impersonations that looked official enough to pass a quick glance. Google’s ranking systems generally kept them off page one. AI engines were less careful: in one case, a model repeatedly presented a fake site’s claim about a new CEO as fact.
The risk is highest for facts that change, like leadership, ownership and locations, where a model cannot easily tell an update from an invention. We monitor for impersonation sites and profiles, report them through each platform’s process and strengthen the official sources so the engines have a clear, consistent record to trust.