The Impact of Generative AI on Collaboration at Work
Abstract
Generative AI tools are increasingly capable of performing complex knowledge-based tasks, fueling excitement about their potential to substantially increase worker productivity. At the same time, a key question remains: whose work will be augmented and whose will be replaced? Forecasting the impact of generative AI on labor demand (and understanding its attendant implications for economic inequality) requires understanding not just what tasks new AI systems are good at, but how their use shapes how responsibilities and opportunities are allocated to workers.We conduct a novel large-scale field experiment that randomizes access to a general purpose LLM-based tool to assist information workers with their regular work. Our study includes data from 60 major multinational firms across a range of industries. Each participating firm identified 100 employees, who were randomized (50/50) into receiving early access to Copilot for Microsoft 365 (Copilot). Firms agreed to maintain this randomized access to Copilot for six months so we can follow the evolution of work patterns as workers adapt to using this new AI tool.
Copilot integrates GPT-like capabilities (e.g. creating and summarizing) into Microsoft Word, Excel, PowerPoint, Outlook and Teams, which these workers already use regularly. Using data from Microsoft applications, we observe email and meeting behavior and collaborative document creation for all workers at these firms. We contrast the behavior of four distinct groups: treated workers, their managers and teammates, control workers, and their managers and teammates.
Treated workers edit more documents and use more advanced (non-Copilot) features available in Word/Excel/PowerPoint. They also view fewer emails (presumably because they use Copilot’s summary function), reply to emails faster, and participate in shorter email threads. We are also analyzing how collaboration networks evolve and how access to the tool affects the division of tasks within teams.