Evaluating Brand Retrieval and Ranking in Large Language Model Recommendations
Edward C. Malthouse, Kun-Yu Lee, Jing Yang, Sanchary Pal, and Xueyan Feng
arXiv preprint arXiv:2609.16304, 2026Preprint
A shorter version is under review.
Proposes a framework for evaluating open-ended LLM brand recommendations that defines the competitive set independently of model outputs and estimates recommendation prevalence and prominence through repeated sampling (BRP@k, MRR@k), applied to six LLMs across five product categories.
PaperarXiv
@misc{malthouse2026evaluating,
title = {Evaluating Brand Retrieval and Ranking in Large Language Model Recommendations},
author = {Malthouse, Edward and Lee, Kun-Yu and Yang, Jing and Pal, Sanchary and Feng, Xueyan},
year = {2026},
eprint = {2609.16304},
archivePrefix = {arXiv},
primaryClass = {cs.IR},
url = {https://arxiv.org/abs/2609.16304}
}