• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechAI

Generative AI copilots could promise ‘a workplace utopia’

By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
June 6, 2024, 10:00 AM ET
More tech companies are introducing copilots.
More tech companies are introducing copilots.Illustration by Michele Marconi

As Jamf Software grows globally and adds new employees in markets without an office, chief information officer Linh Lam must make technology investments that can keep everyone on the same page. 

“We’re not just trying to provide information and resources and the latest and greatest things just for those that are in the office,” says Lam.

Jamf, which helps enterprise customers manage Apple devices, operates a fully hybrid workplace, and in some smaller markets, it would be costly to hire support staff. That led Lam to invest in Moveworks’ artificial intelligence copilot, integrated in Slack, and provide automated support for functions like IT and HR.

Over 70% of Jamf’s workforce is using the Moveworks copilot today, known internally as Caspernicus. Lam says the copilot helps Jamf automate some work and helps employees be more productive as they don’t always have to wait for an IT colleague to get back to them when a problem arises. But she’s also wary of perpetuating tech sprawl. “We don’t want to end up in a situation where we are doing five or six different copilots,” says Lam. 

Copilots promise a workplace utopia, making employees more productive, improving workflows, and helping share knowledge across an organization. One study found that software developers using Microsoft’s GitHut Copilot were able to complete tasks 56% faster than those not using the tool.

During Microsoft’s latest earnings call in April, the tech giant said GitHub Copilot had 1.8 million paid subscribers, up over 35% from the prior quarter. Nearly 60% of Fortune 500 companies use Copilot for Microsoft 365, with a client roster that includes Nvidia and Amgen.

But at a cost of $30 per user for Copilot for Microsoft 365, some companies have been cautious about how many employees they are willing to sign up to the service. 

For rivals looking to compete with Microsoft, Boston Consulting Group partner John Pineda says, niche copilot offerings need to go beyond the underlying power of the models they sit on and focus more on domain specificity that reflects decades of servicing a specific field, like healthcare.

“The onus is on the more specialized players,” says Pineda. “If it looks a lot like your Microsoft Copilot, I think it’s going to be a lot harder.”

Thomson Reuters has a plugin with Microsoft’s Copilot, a combination that allows users to work in Microsoft Word but have access to Reuters’ expertise in more dense topics including taxes and law. 

“Copilot on its own is not designed to answer legal questions or help with tax-related work,” says Kriti Sharma, chief product officer of legal tech at Thomson Reuters. “Our partnership with Microsoft is to bring us intelligence right where the users work.”

For businesses that operate outside Microsoft’s ecosystem, Thomson Reuters also sells a generative AI assistant called CoCounsel, which can handle research, drafting, and document review. “The use case for our CoCounsel experience is how we can speed that up, give them more confidence in the answers, and most importantly cite the sources, which is really important for legal work,” says Sharma.

In May, software provider ServiceNow and Microsoft announced the integration of two generative AI assistants, ServiceNow Now Assist and Microsoft Copilot, allowing a user in Microsoft Teams to ask workplace-related questions to Now Assist. The integration will be sold as a premium ServiceNow offering beginning this fall. Future capabilities will include allowing employees to create documents, like a PowerPoint presentation, based on ServiceNow prompts.

“It’s just a series of features that get enabled inside of your existing ServiceNow applications that use generative AI,” says Pat Casey, chief technology officer and a cofounder at ServiceNow. “The idea that we would need an external entity to coordinate AI services and interact with the underlying application, that’s just not the approach we took.”

Last year, consulting giant Accenture was one of the first companies to have access to Copilot for Microsoft 365, Security Copilot, and GitHub Copilot. Arnab Chakraborty, chief responsible AI officer at Accenture, says that whenever a copilot is built—either in house or by a third-party vendor—an easy feedback loop needs to be established so that those testing the technology during the pilot phase can share problems that need to be addressed.

Chakraborty says guardrails are also needed to ensure employee personas are established to ensure that when a copilot shares a response to an inquiry, it isn’t giving every employee access to information that may be more restrictive.

And then there’s training. As copilots roll out across organizations, Chakraborty says workers are getting access to a new tool they’ve either never used before or have had little past experience with. “We’re giving them a guidebook,” says Chakraborty, of Accenture’s workforce. “That goes a long way to have the right discipline in using those agents.”

SAP launched a generative AI copilot, Joule, last fall; since then, the enterprise software company has horizontally expanded the assistant to support HR tool SuccessFactors, SAP’s cloud offering, and by the end of this year, will be fully integrated within all major SAP applications. “We see great uptick by customers,” says SAP chief AI officer Philip Herzig.

Integrating Joule horizontally will allow a manager to look up an employee’s compensation, which would be found in a HR application; but then, if the next question is about if there’s room in the budget to give this employee a raise, that’s a financial question. The intent is that rather than requiring a manager to switch applications, Joule sits in both and can assist with questions across multiple departments.

“In order to make it a really conversational experience that follows what the user wants, this integrated approach is key,” says Herzig.

Unstructured, a startup that ingests and pre-processes unstructured data that can be ready for use with foundational models, has leaned on kapa.ai’s chatbot to help answer questions from the 3,000 engineers that are part of a free Slack community created by Unstructured.

The chatbot is cheap to operate and helps answer user questions across the globe. Unstructured CEO and cofounder Brian Raymond says success of the chatbot is based on the company providing feedback to the chatbot and then making adjustments to the documentation.

When it comes to copilots, AI chatbots, or AI agents, Raymond says Unstructured had been “very skeptical of the efficacy of it. We’ve actually grown more confident over time.” 

But he says success is still narrow. The technology is most adept at digesting a question and providing an answer. Raymond is more skeptical of complex, multistep automation that’s being demoed by copilot vendors.

“The reality is the tech just needs quite a bit more maturing in order to do it,” Raymond says.

This article is part of the Chief AI Officer’s must-read guide to AI’s potential.

About the Author
By John KellContributing Writer and author of CIO Intelligence

John Kell is a contributing writer for Fortune and author of Fortune’s CIO Intelligence newsletter.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Lists Calendar
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Lists Calendar
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Marc benioff
AIHiring
Salesforce CEO Marc Benioff says AI won’t kill entry-level jobs. He’s hiring 1,000 new grads to prove it
By Jake AngeloApril 27, 2026
9 seconds ago
John Ternus, incoming CEO of Apple
SuccessCareers
Incoming Apple CEO John Ternus tells Gen Z an early mistake taught him an important lesson: ‘The care you put into your work really matters’
By Emma BurleighApril 27, 2026
40 minutes ago
A bank robber made off with $195,000 and got caught after his cell pinged a geofence. Now SCOTUS decides whether that violated the Fourth Amendment
Lawsmartphones and mobile devices
A bank robber made off with $195,000 and got caught after his cell pinged a geofence. Now SCOTUS decides whether that violated the Fourth Amendment
By The Associated Press and Mark ShermanApril 27, 2026
2 hours ago
How a chance encounter in Texas sparked a $1 billion Kleiner Perkins-backed AI startup
NewslettersTerm Sheet
How a chance encounter in Texas sparked a $1 billion Kleiner Perkins-backed AI startup
By Allie GarfinkleApril 27, 2026
4 hours ago
Palantir Technologies CEO Alex Karp in Davos, Switzerland in January 2026. (Photo by Fabrice Coffrini/AFP/Getty Images)
NewslettersFortune Tech
Palantir staff reportedly question company’s commitment to civil liberties
By Andrew NuscaApril 27, 2026
5 hours ago
John Ternus, Apple’s new CEO, inherits a rebounding China business—and some messy headaches
AsiaApple
John Ternus, Apple’s new CEO, inherits a rebounding China business—and some messy headaches
By Nicholas GordonApril 26, 2026
19 hours ago

Most Popular

The U.S. military may have already used up half of its most expensive missiles, and it could take up to 4 years to rebuild its stockpiles
Politics
The U.S. military may have already used up half of its most expensive missiles, and it could take up to 4 years to rebuild its stockpiles
By Sasha RogelbergApril 24, 2026
3 days ago
'You feel radicalized': A Meta AI exec watched agents beat her top workers. Now she's built a nonprofit to help Gen Z find jobs before they disappear
Future of Work
'You feel radicalized': A Meta AI exec watched agents beat her top workers. Now she's built a nonprofit to help Gen Z find jobs before they disappear
By Jake AngeloApril 26, 2026
1 day ago
Elon Musk says saving for retirement is irrelevant because AI is going to create a world of abundance: 'It won't matter'
Future of Work
Elon Musk says saving for retirement is irrelevant because AI is going to create a world of abundance: 'It won't matter'
By Marco Quiroz-GutierrezApril 26, 2026
22 hours ago
More than 90,000 tech workers have been laid off this year. But here’s why companies like Microsoft are offering voluntary buyouts instead
Big Tech
More than 90,000 tech workers have been laid off this year. But here’s why companies like Microsoft are offering voluntary buyouts instead
By Jacqueline MunisApril 26, 2026
1 day ago
Baby boomers have now 'gobbled up' nearly one-third of America's wealth share, and they're leaving Gen Z and millennials behind
Investing
Baby boomers have now 'gobbled up' nearly one-third of America's wealth share, and they're leaving Gen Z and millennials behind
By Sasha RogelbergApril 26, 2026
22 hours ago
This CEO lived on canned soup and took just two days off for his daughter’s birth. Now he admits he lost sight of proper work-life balance
Success
This CEO lived on canned soup and took just two days off for his daughter’s birth. Now he admits he lost sight of proper work-life balance
By Preston ForeApril 25, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.