Blog

Maximilian Kenfenheuer

Manager @ BearingPoint

Maximilian Kenfenheuer

Featured

Why Agent Evaluation May Become a Defining Capability in Microsoft AI Solutions

Evaluation is starting to look like one of the most important enterprise AI capabilities that people still underestimate. What caught my attention is Microsoft’s growing emphasis on agent evals in Copilot Studio, including custom graders and the data science behind how agent quality is measured and improved. For Microsoft AI solutions, that matters because the next phase of value will not come from simply deploying more agents. It will come from knowing which ones are reliable, where they fail, how they should be governed, and how quality can be improved systematically rather than anecdotally. In the article, I explore why this deserves more attention: • why agent evaluation is becoming a strategic layer, not just a technical checkpoint • how custom graders help organizations measure quality against business-specific standards • why reliability, governance, and continuous improvement are inseparable in enterprise AI • and what organizations should consider as they move from pilot agents to production-scale agent ecosystems The next phase of enterprise AI may depend not only on what agents can do, but on whether organizations can evaluate them with enough rigor to trust them in real work. How important do you think agent evaluation will become as enterprises scale Microsoft AI solutions?

Continue reading

Why Work IQ Could Become a Foundational Layer in Microsoft AI Solutions

Work IQ may become one of the most important Microsoft AI signals this year. What stands out to me is not just the API announcement itself. It is the architectural shift behind it: Microsoft is turning workplace intelligence into a reusable, governed layer that agents can access across Microsoft 365 and external systems. That matters for Microsoft AI solutions because the next stage of enterprise value will not come from isolated chat experiences alone. It will come from whether agents can work with the right context, under the right permissions, with the right controls, at production scale. In the article, I explore why this deserves attention: • why Work IQ changes the conversation from app-level AI features to an enterprise intelligence layer • how chat, context, tools, and workspaces are being combined for more capable agentic work • why governance, cost management, and permission-aware access become even more important as agents scale • and what organizations should consider as they prepare for a more API-driven Microsoft AI operating model The next phase of enterprise AI may depend not only on model quality or interface design, but on whether intelligence itself becomes portable, governed, and usable across the workflows where work actually happens. How important do you think intelligence layers like Work IQ will become in shaping enterprise AI architecture?

Why Model Choice in Microsoft 365 Copilot Matters More Than It First Appears

Model choice inside Microsoft 365 Copilot is becoming a more important enterprise signal than it may first appear. Microsoft’s recent addition of Anthropic models in Copilot points to something bigger for Microsoft AI solutions: the platform is evolving beyond a one-model experience toward a governed model layer, where different reasoning strengths can be brought into the flow of work. In the article, I explore why that matters: • why model optionality changes the enterprise AI conversation from access to fit • how different models can better support different kinds of work, from drafting to deeper reasoning • why governance, evaluation, and admin oversight become more important as model choice expands • and what organizations should consider as they move toward a more plural AI operating model inside Microsoft 365 The next phase of enterprise AI may depend not only on having AI available in the tools people use, but on whether the right model can be applied to the right task under the right controls. How important do you think model choice will become as organizations mature their Microsoft AI strategy?

Latest posts

Why Agent Evaluation May Become a Defining Capability in Microsoft AI Solutions

#MicrosoftAI #Microsoft365Copilot #CopilotStudio #AIGovernance #AgenticAI

Evaluation is starting to look like one of the most important enterprise AI capabilities that people still underestimate. What caught my attention is Microsoft’s growing emphasis on agent evals in Copilot Studio, including custom graders and the data science behind how agent quality is measured and improved. For Microsoft AI solutions, that matters because the next phase of value will not come from simply deploying more agents. It will come from knowing which ones are reliable, where they fail, how they should be governed, and how quality can be improved systematically rather than anecdotally. In the article, I explore why this deserves more attention: • why agent evaluation is becoming a strategic layer, not just a technical checkpoint • how custom graders help organizations measure quality against business-specific standards • why reliability, governance, and continuous improvement are inseparable in enterprise AI • and what organizations should consider as they move from pilot agents to production-scale agent ecosystems The next phase of enterprise AI may depend not only on what agents can do, but on whether organizations can evaluate them with enough rigor to trust them in real work. How important do you think agent evaluation will become as enterprises scale Microsoft AI solutions?

Why Work IQ Could Become a Foundational Layer in Microsoft AI Solutions

#Microsoft365Copilot #MicrosoftAI #CopilotStudio #AI #EnterpriseAI

Work IQ may become one of the most important Microsoft AI signals this year. What stands out to me is not just the API announcement itself. It is the architectural shift behind it: Microsoft is turning workplace intelligence into a reusable, governed layer that agents can access across Microsoft 365 and external systems. That matters for Microsoft AI solutions because the next stage of enterprise value will not come from isolated chat experiences alone. It will come from whether agents can work with the right context, under the right permissions, with the right controls, at production scale. In the article, I explore why this deserves attention: • why Work IQ changes the conversation from app-level AI features to an enterprise intelligence layer • how chat, context, tools, and workspaces are being combined for more capable agentic work • why governance, cost management, and permission-aware access become even more important as agents scale • and what organizations should consider as they prepare for a more API-driven Microsoft AI operating model The next phase of enterprise AI may depend not only on model quality or interface design, but on whether intelligence itself becomes portable, governed, and usable across the workflows where work actually happens. How important do you think intelligence layers like Work IQ will become in shaping enterprise AI architecture?

Why Model Choice in Microsoft 365 Copilot Matters More Than It First Appears

#Microsoft365Copilot #MicrosoftAI #AI #Copilot #EnterpriseAI

Model choice inside Microsoft 365 Copilot is becoming a more important enterprise signal than it may first appear. Microsoft’s recent addition of Anthropic models in Copilot points to something bigger for Microsoft AI solutions: the platform is evolving beyond a one-model experience toward a governed model layer, where different reasoning strengths can be brought into the flow of work. In the article, I explore why that matters: • why model optionality changes the enterprise AI conversation from access to fit • how different models can better support different kinds of work, from drafting to deeper reasoning • why governance, evaluation, and admin oversight become more important as model choice expands • and what organizations should consider as they move toward a more plural AI operating model inside Microsoft 365 The next phase of enterprise AI may depend not only on having AI available in the tools people use, but on whether the right model can be applied to the right task under the right controls. How important do you think model choice will become as organizations mature their Microsoft AI strategy?

Why Domain Exclusion Matters More Than It Seems in Microsoft 365 Copilot

#Microsoft365Copilot #MicrosoftAI #Copilot #AIGovernance #ResponsibleAI

Up to 1,000 domains can now be excluded from web grounding in Microsoft 365 Copilot. I think that is more important than it may first appear. For Microsoft AI solutions, this is not just a settings update. It is a signal that 𝑔𝑟𝑜𝑢𝑛𝑑𝑖𝑛𝑔 𝑐𝑜𝑛𝑡𝑟𝑜𝑙 is becoming part of enterprise AI architecture. As Copilot becomes more capable, organizations will need sharper ways to shape what external sources it can and cannot rely on. In the article, I explore why this matters: • why domain exclusion changes the governance conversation from broad trust to source-level control • how web grounding policies affect accuracy, risk, and organizational confidence • why admin tooling now matters just as much as model capability in enterprise AI adoption • and what organizations should consider as they operationalize Copilot more seriously The next phase of enterprise AI may depend not only on what AI can access, but on how deliberately organizations can define the boundaries around that access. How important do you think source-level controls like domain exclusion will become as enterprises scale AI use?

Why Copilot Tasks Matters: The Shift from AI Answers to AI Execution

#Microsoft365Copilot #MicrosoftAI #Copilot #AI #EnterpriseAI #DigitalTransformation

Copilot Tasks points to a shift that is easy to underestimate. What matters is not just that AI can generate a good response. It is that Microsoft is pushing toward AI that can 𝑐𝑎𝑟𝑟𝑦 𝑜𝑢𝑡 𝑤𝑜𝑟𝑘 in the background across apps, websites, schedules, and recurring routines, while still keeping the user in control. That changes the conversation for Microsoft AI solutions. In the article, I explore why this is strategically important: • why task execution may become a more meaningful measure of AI value than chat quality alone • how recurring, scheduled, and real-world actions change expectations for everyday productivity • why consent, oversight, and operational controls become even more important as AI moves from assistance to action • and what organizations should consider as they prepare for a more execution-oriented AI model The next phase of enterprise AI may depend less on whether AI can respond intelligently, and more on whether it can complete useful work reliably, safely, and at the right moment. How important do you think action-taking AI like Copilot Tasks will become in shaping user expectations for enterprise AI?