Preprint · 2026 · Open access

Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations

XIAO YAN NI, Yiwei Wang, Tianjun Feng, Lauren Xiaoyan Lu, Yitong Wang, Congyi Zhou

arXiv (Cornell University) · Published 8 February 2026 · DOI 10.48550/arxiv.2603.29888

Free PDFView at the publisherCite this paper

In brief

“Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations” is a 2026 preprint by XIAO YAN NI and 5 co-authors, published in arXiv (Cornell University). OpenAlex counts 3 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
3
Most cited in
2026 (3)
References
3
Authors
6

Abstract

In collaboration with Alibaba, we study how a generative AI assistant affects service performance in e-commerce after-sales operations. In a large-scale field experiment, human agents providing digital chat support were randomly assigned access to a gen AI assistant. The assistant drafts issue diagnoses and solution proposals in the opening stage only; agents can adopt, modify, or disregard them. Because of this discretion, we estimate the effects of both gen AI access and usage. On average, gen AI improves service speed and subjective service quality, measured by customer ratings, but has no significant effect on objective service quality, measured by customer retrials. These gains come from more than automation. Gen AI reshapes agent-customer interactions: treated agents respond faster and take a more proactive role, while customers provide less input; both patterns persist into later chat stages. These average effects, however, mask heterogeneity across agents. Lower-performing agents benefit the most, indicating that gen AI can narrow performance gaps. Top-performing agents experience declines in both subjective and objective service quality. This decline is consistent with workflow disruption: among top performers, gen AI use increases shift-away time, response delays, and immediate customer retrials, suggesting weakened service continuity in the focal chat. Successful gen AI deployment therefore requires careful performance evaluation and rollout tailored to agent skill.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

NI, X. Y., Wang, Y., Feng, T., Lu, L. X., Wang, Y., & Zhou, C. (2026). Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888

MLA 9

NI, XIAO YAN, et al. “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations.” arXiv (Cornell University), 2026. https://doi.org/10.48550/arxiv.2603.29888.

Chicago

NI, XIAO YAN, Yiwei Wang, Tianjun Feng, Lauren Xiaoyan Lu, Yitong Wang, and Congyi Zhou. 2026. “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888.

Harvard

NI, X. Y. et al. (2026) ‘Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations’, arXiv (Cornell University). doi:10.48550/arxiv.2603.29888.

IEEE

X. Y. NI, Y. Wang, T. Feng, L. X. Lu, Y. Wang, and C. Zhou, “Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations,” arXiv (Cornell University), 2026, doi: 10.48550/arxiv.2603.29888.

BibTeX

@misc{ni2026generative,
  title     = {{Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations}},
  author    = {NI, XIAO YAN and Wang, Yiwei and Feng, Tianjun and Lu, Lauren Xiaoyan and Wang, Yitong and Zhou, Congyi},
  howpublished = {arXiv (Cornell University)},
  year      = {2026},
  doi       = {10.48550/arxiv.2603.29888},
  url       = {https://doi.org/10.48550/arxiv.2603.29888}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions

  • generative AI
  • customer service
  • chatbots
  • human-AI collaboration
  • service quality
  • heterogeneous agents
  • workflow disruption
  • response time

Work with this paper

Most-cited papers in Business, Management and Accounting

All highly cited Business, Management and Accounting papers

Questions about this paper

How do I cite this paper in APA style?

NI, X. Y., Wang, Y., Feng, T., Lu, L. X., Wang, Y., & Zhou, C. (2026). Generative AI in Action: Field Experimental Evidence from Alibaba's Customer Service Operations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2603.29888

How many times has this paper been cited?

3 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

XIAO YAN NI, Yiwei Wang, Tianjun Feng, Lauren Xiaoyan Lu, Yitong Wang, Congyi Zhou.

What is the DOI of this paper?

10.48550/arxiv.2603.29888. The permanent link is https://doi.org/10.48550/arxiv.2603.29888.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.