Blog

Maximilian Kenfenheuer

Manager @ BearingPoint

Maximilian Kenfenheuer

Featured

Why Agent Evaluation May Become a Defining Capability in Microsoft AI Solutions

Evaluation is starting to look like one of the most important enterprise AI capabilities that people still underestimate. What caught my attention is Microsoft’s growing emphasis on agent evals in Copilot Studio, including custom graders and the data science behind how agent quality is measured and improved. For Microsoft AI solutions, that matters because the next phase of value will not come from simply deploying more agents. It will come from knowing which ones are reliable, where they fail, how they should be governed, and how quality can be improved systematically rather than anecdotally. In the article, I explore why this deserves more attention: • why agent evaluation is becoming a strategic layer, not just a technical checkpoint • how custom graders help organizations measure quality against business-specific standards • why reliability, governance, and continuous improvement are inseparable in enterprise AI • and what organizations should consider as they move from pilot agents to production-scale agent ecosystems The next phase of enterprise AI may depend not only on what agents can do, but on whether organizations can evaluate them with enough rigor to trust them in real work. How important do you think agent evaluation will become as enterprises scale Microsoft AI solutions?

Continue reading

Why Work IQ Could Become a Foundational Layer in Microsoft AI Solutions

Work IQ may become one of the most important Microsoft AI signals this year. What stands out to me is not just the API announcement itself. It is the architectural shift behind it: Microsoft is turning workplace intelligence into a reusable, governed layer that agents can access across Microsoft 365 and external systems. That matters for Microsoft AI solutions because the next stage of enterprise value will not come from isolated chat experiences alone. It will come from whether agents can work with the right context, under the right permissions, with the right controls, at production scale. In the article, I explore why this deserves attention: • why Work IQ changes the conversation from app-level AI features to an enterprise intelligence layer • how chat, context, tools, and workspaces are being combined for more capable agentic work • why governance, cost management, and permission-aware access become even more important as agents scale • and what organizations should consider as they prepare for a more API-driven Microsoft AI operating model The next phase of enterprise AI may depend not only on model quality or interface design, but on whether intelligence itself becomes portable, governed, and usable across the workflows where work actually happens. How important do you think intelligence layers like Work IQ will become in shaping enterprise AI architecture?

Why Model Choice in Microsoft 365 Copilot Matters More Than It First Appears

Model choice inside Microsoft 365 Copilot is becoming a more important enterprise signal than it may first appear. Microsoft’s recent addition of Anthropic models in Copilot points to something bigger for Microsoft AI solutions: the platform is evolving beyond a one-model experience toward a governed model layer, where different reasoning strengths can be brought into the flow of work. In the article, I explore why that matters: • why model optionality changes the enterprise AI conversation from access to fit • how different models can better support different kinds of work, from drafting to deeper reasoning • why governance, evaluation, and admin oversight become more important as model choice expands • and what organizations should consider as they move toward a more plural AI operating model inside Microsoft 365 The next phase of enterprise AI may depend not only on having AI available in the tools people use, but on whether the right model can be applied to the right task under the right controls. How important do you think model choice will become as organizations mature their Microsoft AI strategy?

Posts tagged #AgenticAI

Why Agent Evaluation May Become a Defining Capability in Microsoft AI Solutions

#MicrosoftAI #Microsoft365Copilot #CopilotStudio #AIGovernance #AgenticAI

Evaluation is starting to look like one of the most important enterprise AI capabilities that people still underestimate. What caught my attention is Microsoft’s growing emphasis on agent evals in Copilot Studio, including custom graders and the data science behind how agent quality is measured and improved. For Microsoft AI solutions, that matters because the next phase of value will not come from simply deploying more agents. It will come from knowing which ones are reliable, where they fail, how they should be governed, and how quality can be improved systematically rather than anecdotally. In the article, I explore why this deserves more attention: • why agent evaluation is becoming a strategic layer, not just a technical checkpoint • how custom graders help organizations measure quality against business-specific standards • why reliability, governance, and continuous improvement are inseparable in enterprise AI • and what organizations should consider as they move from pilot agents to production-scale agent ecosystems The next phase of enterprise AI may depend not only on what agents can do, but on whether organizations can evaluate them with enough rigor to trust them in real work. How important do you think agent evaluation will become as enterprises scale Microsoft AI solutions?