Blog

Maximilian Kenfenheuer

Manager · Microsoft 365 & AI Transformation @ BearingPoint

Maximilian Kenfenheuer

Featured

Measuring Completed Work: Baselines, Assisted Hours and Business Outcomes

A team can generate thousands of prompts without improving a single core process. Another uses AI rarely but saves hours in contract review. Microsoft increasingly measures Copilot value by completed work and assisted hours instead of activity. Its internal guidance recommends baselines for painful processes before the rollout. In this article, I describe a three-layer measurement model of adoption signals, time and effort indicators and business outcomes, and explain why role-based deployment makes value measurable.

Continue reading

Posts tagged #AIGovernance

Agent Evaluation with Custom Graders in Copilot Studio

#MicrosoftAI #Microsoft365Copilot #CopilotStudio #AIGovernance #AgenticAI

"The demo worked" and "users liked it" are not enough once agents support customer interactions, approvals or system actions. Copilot Studio now offers custom graders for agent evaluations. Organizations assess agents against their own criteria: approved terminology, correct internal sources, escalation at low confidence and compliance with process boundaries. In this article, I explain why evaluation and governance belong together and how organizations can define and measure agent quality in five steps.

Domain Exclusion in Practice: Ownership, Maintenance and Limits

#Microsoft365Copilot #MicrosoftAI #Copilot #AIGovernance #ResponsibleAI

AI governance used to ask whether employees may use AI and which model is approved. Today, organizations need finer controls, including which external sources may influence Copilot answers. Domain exclusion lets admins exclude up to 1,000 websites from web grounding in Microsoft 365 Copilot. The scope is limited to web page results, and the list is maintained via PowerShell and CSV. In this article, I explain why source controls shape answer quality and who in the organization should own the exclusion list.

Source-Level Governance for Copilot Web Grounding

#Microsoft365Copilot #MicrosoftAI #AIGovernance #EnterpriseAI #Copilot #ResponsibleAI

Web grounding sounds technical, but it is becoming a leadership question: which sources may influence Copilot answers in an enterprise? Microsoft Learn documents domain exclusion for up to 1,000 sites, managed via PowerShell by admin roles. At the same time, Microsoft has rolled the feature back for now. That makes it a signal rather than a finished feature. In this article, I explain why source-level governance becomes part of the enterprise AI operating model and which questions organizations should clarify now.

Domain Exclusion: Defining Which Web Sources Copilot Must Not Use

#Microsoft365Copilot #MicrosoftAI #AIGovernance #EnterpriseAI #Copilot #ResponsibleAI

Admins can now exclude up to 1,000 domains from web grounding in Microsoft 365 Copilot and Copilot Chat. Configuration runs via a PowerShell script, optionally including subpages. The feature looks like a configuration detail. It shows, however, where enterprise AI is heading: organizations want to define which sources Copilot must not use, not only extend what it can see. In this article, I explain the feature, its current limits and why administrative precision should weigh more in platform decisions.

Unleashing New Potentials: Incorporating Generative AI in Enterprise Environments

#GenerativeAI #ArtificialIntelligence #AIinBusiness #EnterpriseAI #DigitalTransformation #Innovation #PredictiveAnalytics #AIGovernance #AIEthics #CustomizedCustomerExperience #FutureTech #AIRevolution #AIFuture #EnterpriseDigitalTransformation #AIChallenges

Generative AI, a rapidly emerging aspect of the artificial intelligence field, shows substantial potential for revolutionizing enterprise operations, decision-making, and customer experiences including personalized responses, expediting document creation, and enabling advanced predictive analytics, although its implementation necessitates proper understanding, strategic planning and AI governance.