The current landscape of AI visibility strategies reveals a surprising disconnect — despite claims, some tools may not yet be delivering the benefits they promise. A recent in-depth analysis conducted by SE Ranking, examining approximately 300,000 domains, indicates that the implementation of the llms.txt file does not have a clear or measurable impact on how often websites are referenced or cited in large language model (LLM) responses. This might come as unexpected news to those who believed that simply adding a specific file could influence AI behavior or enhance visibility.
What the Data Reveals
Limited Adoption Among Websites: The study found that only about 10.13% of the domains analyzed have adopted the llms.txt file, meaning nearly nine out of ten websites surveyed have yet to implement it. Despite some being touted as a new standard for improving AI recognition, the data indicates that usage remains scattered and experimental rather than widespread. Interestingly, the adoption appears fairly consistent across websites with different traffic levels, with even the high-traffic sites slightly less likely to have the file than mid-tier sites. This suggests that the adoption of llms.txt is not concentrated among major brands but is evenly distributed across various levels of web traffic.
No Clear Impact on AI Citation Frequency: To evaluate whether having the llms.txt file influences how often a website gets quoted or referenced by prominent large language models, SE Ranking analyzed the correlation at the domain level. They used statistical tools including correlation tests and machine learning models like XGBoost. Their main conclusion was quite telling: removing the llms.txt feature actually improved the accuracy of their model, implying that the presence of the file does not enhance AI citation chances. In fact, the data shows no significant relationship between having this file and increased citations, at least so far.
Insights in Light of Platform References: SE Ranking points out that their findings are consistent with official guidance from major platforms. Google, for instance, has not indicated that llms.txt influences AI-based search results or rankings. Currently, Google describes its AI search updates as developments that build upon existing signals, without mentioning llms.txt as a factor. Similarly, OpenAI’s documentation emphasizes controlling crawler access via robots.txt rather than relying on or suggesting a role for llms.txt. Some logs indicate that OpenAI’s GPTBot occasionally visits sites with llms.txt files, but this appears rare and unrelated to citation metrics.
Implications for Website Owners and Content Creators: If your goal is to keep your website prepared for future potential shifts in AI recognition, adding llms.txt is straightforward and unlikely to cause any harm from a technical standpoint. However, if you’re aiming for immediate boosts in your visibility within AI-generated answers, the current evidence suggests you should not rely on this tactic. It’s similar to other experimental strategies in the early stages of AI visibility—worth testing if it fits your workflow, but definitely not a guaranteed or proven method for quick gains.
In Summary: While the idea of influencing AI citations with a simple file is appealing, the reality seems more complex. For now, the data indicates that llms.txt remains an experimental feature without clear benefits in the current landscape. As AI systems evolve, though, the landscape could change, so staying informed and testing cautiously remains a wise approach. What do you think? Could the significance of such files grow in the future, or are we better off focusing on proven SEO tactics? Share your thoughts below—your opinion could spark an interesting debate.
