Preprint · 2026 · Open access
Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations
arXiv (Cornell University) · Published 8 February 2026 · DOI 10.48550/arxiv.2603.29888
In brief
“Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations” is a 2026 preprint by XIAO YAN NI and 5 co-authors, published in arXiv (Cornell University). OpenAlex counts 3 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 3
- Most cited in
- 2026 (3)
- References
- 3
- Authors
- 6
Abstract
In collaboration with Alibaba, we study how a generative AI assistant affects service performance in e-commerce after-sales operations. In a large-scale field experiment, human agents providing digital chat support were randomly assigned access to a gen AI assistant. The assistant drafts issue diagnoses and solution proposals in the opening stage only; agents can adopt, modify, or disregard them. Because of this discretion, we estimate the effects of both gen AI access and usage. On average, gen AI improves service speed and subjective service quality, measured by customer ratings, but has no significant effect on objective service quality, measured by customer retrials. These gains come from more than automation. Gen AI reshapes agent-customer interactions: treated agents respond faster and take a more proactive role, while customers provide less input; both patterns persist into later chat stages. These average effects, however, mask heterogeneity across agents. Lower-performing agents benefit the most, indicating that gen AI can narrow performance gaps. Top-performing agents experience declines in both subjective and objective service quality. This decline is consistent with workflow disruption: among top performers, gen AI use increases shift-away time, response delays, and immediate customer retrials, suggesting weakened service continuity in the focal chat. Successful gen AI deployment therefore requires careful performance evaluation and rollout tailored to agent skill.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
NI, X. Y., Wang, Y., Feng, T., Lu, L. X., Wang, Y., & Zhou, C. (2026). Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888
MLA 9
NI, XIAO YAN, et al. “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations.” arXiv (Cornell University), 2026. https://doi.org/10.48550/arxiv.2603.29888.
Chicago
NI, XIAO YAN, Yiwei Wang, Tianjun Feng, Lauren Xiaoyan Lu, Yitong Wang, and Congyi Zhou. 2026. “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888.
Harvard
NI, X. Y. et al. (2026) ‘Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations’, arXiv (Cornell University). doi:10.48550/arxiv.2603.29888.
IEEE
X. Y. NI, Y. Wang, T. Feng, L. X. Lu, Y. Wang, and C. Zhou, “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations,” arXiv (Cornell University), 2026, doi: 10.48550/arxiv.2603.29888.
BibTeX
@misc{ni2026generative,
title = {{Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations}},
author = {NI, XIAO YAN and Wang, Yiwei and Feng, Tianjun and Lu, Lauren Xiaoyan and Wang, Yitong and Zhou, Congyi},
howpublished = {arXiv (Cornell University)},
year = {2026},
doi = {10.48550/arxiv.2603.29888},
url = {https://doi.org/10.48550/arxiv.2603.29888}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- generative AI
- customer service
- chatbots
- human-AI collaboration
- service quality
- heterogeneous agents
- workflow disruption
- response time
Work with this paper
Most-cited papers in Business, Management and Accounting
- Firm Resources and Sustained Competitive AdvantageJay Bryan Barney · Journal of Management · 1991 · 57,081 citations
- The Iron Cage Revisited: Institutional Isomorphism and Collective Rationality in Organizational FieldsPaul DiMaggio, Walter W. Powell · American Sociological Review · 1983 · 42,816 citations
- Building Theories from Case Study ResearchKathleen M. Eisenhardt · Academy of Management Review · 1989 · 39,809 citations
- Firm resources and sustained competitive advantageJay Bryan Barney · Advances in strategic management · 2004 · 38,183 citations
- Absorptive Capacity: A New Perspective on Learning and InnovationWesley M. Cohen, Daniel A. Levinthal · Administrative Science Quarterly · 1990 · 37,030 citations
Questions about this paper
How do I cite this paper in APA style?
NI, X. Y., Wang, Y., Feng, T., Lu, L. X., Wang, Y., & Zhou, C. (2026). Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888
How many times has this paper been cited?
3 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
XIAO YAN NI, Yiwei Wang, Tianjun Feng, Lauren Xiaoyan Lu, Yitong Wang, Congyi Zhou.
What is the DOI of this paper?
10.48550/arxiv.2603.29888. The permanent link is https://doi.org/10.48550/arxiv.2603.29888.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.