--- title: "Azure AI Foundry vs. Google Vertex AI: Comparison Guide [2026]" url: "https://atlan.com/know/ai-agent/ai-agent-applications/azure-ai-foundry-vs-google-vertex-ai/" description: "Compare Azure AI Foundry and Google Vertex AI (now the Gemini Enterprise Agent Platform) on architecture, models, tools, and enterprise context for AI agents." author: "Ayswarrya G" author_role: "Contributing Writer, Data Engineering & Metadata" published: "2026-09-11" updated: "2026-09-11T00:00:00.000Z" --- --- Microsoft Foundry (formerly Azure AI Foundry) and the Gemini Enterprise Agent Platform (formerly Google Vertex AI, evolved into this developer platform at Google Cloud Next 2026) are agent platforms for building agents and agentic applications. The main difference comes down to the cloud each platform lives on and each vendor's starting point. Start from your existing cloud commitment and preferred model families, since both platforms cover model access, deployment, governance, and agent orchestration. Here's where the two platforms actually diverge: * Core design differences * Ecosystem of services * Models these platforms can run * Process of building, deploying, and maintaining agents * How agents retrieve and use context --- ## Azure AI Foundry vs. Google Vertex AI: at a glance | Dimension | Azure AI Foundry | Google Vertex AI | | :---- | :---- | :---- | | Official name | [Renamed](https://devblogs.microsoft.com/foundry/whats-new-in-microsoft-foundry-oct-nov-2025/) Microsoft Foundry in 2025 | [Evolved](https://cloud.google.com/blog/products/ai-machine-learning/introducing-gemini-enterprise-agent-platform) into the Gemini Enterprise Agent Platform at Google Cloud Next 2026. Not to be confused with Gemini Enterprise, the separate business-user app that Google Agentspace became in October 2025 | | What is it? | Microsoft's app and agent platform on Azure, [launched at Ignite in November 2024](https://techcrunch.com/2024/11/19/microsoft-brings-together-its-enterprise-ai-offerings-in-the-azure-ai-foundry) and rebranded Microsoft Foundry a year later | Google Cloud's ML and generative AI platform, [generally available since May 2021](https://cloud.google.com/blog/products/ai-machine-learning/google-cloud-launches-vertex-ai-unified-platform-for-mlops) and evolved into the Gemini Enterprise Agent Platform in April 2026 | | Design organization | Control plane, resource hierarchy | Build, scale, govern, optimize | | Entry point | Azure AI Foundry resource and projects | Agents | | Agent definition method | No-code prompt agents and hosted agents | No-code agents with Google Agent Studio, and hosted agent-equivalent with Google's ADK | | Agent runtime | Prompt agents run on Foundry's fully managed runtime; hosted agents run in micro VMs on per-session sandboxes | Both agent types run on Google's managed runtime, Agent Runtime (formerly Agent Engine) | | Agent development | Build prompt agents from the Foundry portal or the Foundry SDK. Build hosted agents using an agent framework like LangGraph or Microsoft Agent Framework | Build agents using the open-source and model-agnostic ADK by Google or any other open-source framework of your choice | | Tools catalog | Built-in tools like file search, code interpretation, etc. Add new tools with remote MCP. Foundry also has its RAG solution in Foundry IQ | Built-in tools, such as Grounding with Google Search, Vertex AI Search, RAG Engine, and code execution. You can also register your own APIs and MCP servers | | Models used | Most frontier models, and others via Hugging Face Hub | Most frontier models, and any models published in the Model Garden | | Multi-agent support | Only A2A for calling remote agents | Any framework built for multi-agent orchestration and using A2A is supported | | Context from enterprise data sources | Context grounding with Bing Search, Foundry IQ, and Fabric | Context grounding via Google Search, along with access to Cloud Storage, Google Drive, BigQuery, and the Apigee API Hub | | Context from RAG sources | Foundry IQ knowledge bases built on Azure AI Search | Vertex AI Search, RAG Engine, and Vector Search | | Knowledge graph, semantic layer, ontology, glossary | No built-in graph, semantic layer or ontology within Azure AI Foundry currently | No built-in graph, semantic layer, or ontology | | Agent memory and session state | Supports short-term, long-term, and procedural memory (fully managed) | Separates session memory from cross-session memory | | Best fit | Enterprises already standardized on Azure and Microsoft 365 | Enterprises on Google Cloud that want native Gemini models, and direct BigQuery data integration | --- ## How do Azure AI Foundry and Google Vertex AI differ in their core design? Azure AI Foundry (now known as Microsoft Foundry) is designed as a control plane for agents, models, connections, and other services that interact with agents. It follows a resource hierarchy, with a Foundry resource at the top that handles security and deployments, and Foundry projects as the isolation boundary. Google Vertex AI (now evolved into the Gemini Enterprise Agent Platform) handles the organization slightly differently, with everything structured around agents across four pillars: build, scale, govern, and optimize. While the design is slightly different, the methods of creating and deploying agents are similar. Here's a quick comparison of the core design features across the two platforms. | Design feature | Azure AI Foundry | Google Vertex AI | | ----- | ----- | ----- | | Isolating unit | Foundry resource and projects | Agents | | Entry point | [Responses API](https://learn.microsoft.com/en-us/azure/foundry/agents/overview) | Model-agnostic [Google's ADK](https://cloud.google.com/agent-builder/overview) (Agent Development Kit) for all communication | | Per-agent identity | [Entra Agent ID](https://learn.microsoft.com/entra/agent-id) | [Agent Identity](https://docs.cloud.google.com/gemini-enterprise-agent-platform/agents#agent_identity) | --- ## What is the difference between building and running agents in Azure AI Foundry vs. Google Vertex AI? Both platforms support two paths for building and running agents: one that lets you build configuration-only agents without code, and the other is where you bring the code, the agent loop, choose the runtime, and more. Here's a side-by-side comparison considering agents on the platforms. | Aspect | Azure AI Foundry | Google Vertex AI | | ----- | ----- | ----- | | How is an agent defined? | You can create [prompt agents](https://learn.microsoft.com/en-us/azure/foundry/concepts/choose-build-approach) that are no-code configuration-only and also [hosted agents](https://learn.microsoft.com/en-us/azure/foundry/agents/concepts/hosted-agents) where you bring and build your own code | You can have the no-code option with Google [Agent Studio](https://docs.cloud.google.com/gemini-enterprise-agent-platform/agent-studio). You can have the hosted agent-equivalent with Google's Agent Development Kit | | Where does the agent run? | Prompt agents run on Foundry's fully managed runtime, while hosted agents run in micro VMs on per-session sandboxes | Both types of agents run on Google's managed runtime, [Agent Runtime](https://docs.cloud.google.com/gemini-enterprise-agent-platform/build/runtime) (formerly Agent Engine) | | How do you develop an agent? | Prompt agents can be built from the Foundry portal directly or the Foundry SDK. Hosted agents can use an agent framework of their choice, such as [LangGraph](https://atlan.com/know/ai-agent/ai-agent-memory/what-is-langgraph/), [OpenAI Agents SDK](https://openai.github.io/openai-agents-python/), Microsoft Agent Framework, among others | You can use the open-source and model-agnostic [ADK by Google or use any other open-source framework of your choice](https://atlan.com/know/ai-agent/ai-agent-applications/google-adk-vs-langgraph-vs-autogen/) and deploy it to Agent Runtime | | What tools can the agent access? | Foundry agents have access to built-in tools like file search, code interpretation, etc. You can add any new tool using a [remote MCP server](https://atlan.com/know/ai-agent/how-to-build-mcp-servers-for-enterprise-data/). Foundry also has its RAG solution in [Foundry IQ](https://learn.microsoft.com/en-us/azure/foundry/agents/concepts/what-is-foundry-iq) | Google Vertex AI agents use built-in tools, such as Grounding with Google Search, Vertex AI Search, RAG Engine, and code execution. In addition, you can also register your own APIs and MCP servers that you can route through [Agent Gateway](https://docs.cloud.google.com/gemini-enterprise-agent-platform/govern/gateways/agent-gateway-overview) | | What models can the agent use? | Azure AI Foundry gives you access to most frontier models, along with thousands of models via [Hugging Face Hub](https://huggingface.co/docs/hub/en/models-the-hub) | Google Vertex AI gives you access to most frontier models, including Gemini and Gemma, along with any models published in the [Model Garden](https://cloud.google.com/model-garden) | | What about multi-agent? | Currently, Foundry agents can only use A2A for calling remote agents. [Incoming A2A calls](https://learn.microsoft.com/en-us/azure/foundry/agents/how-to/enable-agent-to-agent-endpoint) that expose a Foundry agent as an A2A endpoint are currently in public preview as of August 2026 | Google created the [A2A protocol](https://atlan.com/know/google-a2a-protocol/). The ADK or any other framework built for [multi-agent orchestration](https://atlan.com/know/multi-agent-system-orchestration/) and using A2A can be used with Google Vertex AI agents | Building the agent is only the beginning. How efficiently the agent works is primarily a function of the knowledge and context it has access to at any given time, especially while it is in action. Here's a look at the different ways both platforms make knowledge and context available to their agents. --- ## How do Azure AI Foundry and Google Vertex AI connect agents to the knowledge and context they need? Agents in Azure AI Foundry can be registered in the Entra Agent Registry. Those agents have access to Azure services like Purview, Azure Database for PostgreSQL, Cosmos DB, as well as OneLake and SharePoint via Foundry IQ. Similarly, Vertex AI agents have access to [Google BigQuery](https://cloud.google.com/bigquery), [Colab Enterprise](https://docs.cloud.google.com/colab/docs/introduction), and Google Search, among other things. But there are many other ways agents can get knowledge and context from within and outside your enterprise systems. Here are the broad categories and how the two platforms support them. | Context | Azure AI Foundry | Google Vertex AI | | ----- | ----- | ----- | | Documents, files, APIs, and databases from the enterprise | Context grounding using Bing Search, Foundry IQ (SharePoint, OneLake, and Blob Storage), and Fabric; agents can use 1,400+ connectors to connect to enterprise systems | Context grounding using Google Search, along with access to Cloud Storage and Google Drive, BigQuery, and the Apigee API Hub | | RAG context sources like vector and hybrid indexes | Foundry IQ knowledge bases built on Azure AI Search at the heart of agentic retrieval following the RAG pattern | Vertex AI Search, RAG Engine, and Vector Search powering the RAG pattern for Vertex AI agents | | Knowledge graph, semantic layer, ontology, glossary, and lineage | No built-in graph or semantic layer or ontology within Azure AI Foundry currently. Fabric IQ has an ontology feature in preview that can be exposed to agents as a Foundry IQ knowledge source; otherwise, the best route is to go to an external tool via MCP | Similar to Azure AI Foundry, Google Vertex AI also doesn't have a built-in graph, semantic layer, or ontology. The only option is to go to an external tool via MCP | | Agent memory and session state | Azure AI Foundry supports short-term, long-term, and procedural memory, all of which is fully managed | Google Vertex AI separates session memory from cross-session memory using Sessions and Memory Bank, both of which are useful for agents | Notice that there are two clear patterns where neither platform makes it easy to bring context to the agent: 1. While you can connect a lot of enterprise systems to your agent, it involves several separate integrations. These are one-to-one integrations. 2. There's no [knowledge graph](https://atlan.com/know/enterprise-data-graph/) or [semantic layer](https://atlan.com/know/semantic-layer/) or [ontology](https://atlan.com/know/ontology-101-explainer/) that stitches all the context and knowledge from various sources in your organization into one cogent and coherent context layer. This is why agents often don't get the right context, and often guess. What agents really need is a [context layer](https://atlan.com/know/what-is-context-layer/) spanning the entire enterprise. Both agent platforms, Azure AI Foundry and Vertex AI, support this pattern. That's where Atlan, the Context Layer for AI, comes into the picture. Here's how Atlan gives agents on either platform the context they need. --- ## How does Atlan help with context in Azure AI Foundry and Google Vertex AI? Atlan is the [Context Layer for AI](https://atlan.com/context-layer/). It serves agents on both platforms, Azure AI Foundry and Google Vertex AI, with the precise context they need at any given time. [Atlan's MCP server](https://atlan.com/know/what-is-atlan-mcp/) delivers context to agents at runtime by bringing context from all enterprise systems into the enterprise context layer. Atlan accumulates, organizes, and curates context using three core capabilities. **Enterprise Data Graph** is a [graph](https://atlan.com/know/enterprise-data-graph/) that contains the entity relationships between systems, assets, code, products, and more. **Active Ontology** distills organizational language and knowledge into glossary terms, domains, metrics, and relationships as a [semantic layer](https://atlan.com/know/semantic-layer/), aligned with [Open Semantic Interchange](https://atlan.com/snowflake-open-semantic-interchange-launch-partner/). And the **Context Engineering Studio** lets you build [Context Repos](https://atlan.com/know/ai-agent/context-repository-for-ai-agents/) for your projects, run evaluations across different contexts, and deploy the version that works best for your agents. Atlan's enterprise context layer offloads the complexity of making context available to agents. It's platform-agnostic and speaks MCP, which is why Foundry agents and Vertex agents can both talk to it and reach the same context at any given point. --- ## Moving forward with agentic platforms for Azure and Google Cloud AI Foundry and Vertex AI are both flagship agentic platforms for Azure and Google Cloud. They reach the same end goal, giving you the capability to create and customize agents, but each implements it slightly differently. Both platforms support most major frontier models, let you use MCP for tool calls, and allow multi-agent orchestration using A2A. Whichever platform you choose, the key constraint for agents is their ability to reach the right context at the right time during a run. In large enterprises, organizational knowledge, process documentation, communication channels, and decision registers, in other words, context, is spread across hundreds of systems. Both platforms contain information within their own boundaries. For agents to act effectively, they need context from multiple systems at once, which is where the need for a context layer comes in. Atlan is the Context Layer for AI: rather than maintaining separate integrations for each platform in your enterprise, you point your platform to Atlan instead. --- Book a Demo --- ## FAQs about Azure AI Foundry vs. Google Vertex AI ### 1. Is Azure AI Foundry the same as Microsoft Foundry? Yes, Azure AI Foundry was rebranded as Microsoft Foundry in November 2025. Microsoft Foundry lets you build agents, access models, and extend agents using enterprise-grade tools and knowledge with a single management plane, governance, security, and observability. ### 2. Is Google Vertex AI the same as the Gemini Enterprise Agent Platform? Yes. Google Vertex AI evolved into the Gemini Enterprise Agent Platform at Google Cloud Next 2026. The core functionality of Vertex AI is now part of the Gemini Enterprise Agent Platform, which lets you build and reuse AI agents, choose a runtime, and apply enterprise governance throughout. It is a distinct product from Gemini Enterprise, the business-user-facing app that Google Agentspace became in October 2025. ### 3. Do both Azure AI Foundry and Google Vertex AI support MCP? Yes, both platforms support MCP servers. ### 4. Which agent frameworks can you use for creating agents on Azure AI Foundry and Google Vertex AI? Azure AI Foundry allows hosted agents with Microsoft Agent Framework, LangGraph, or the OpenAI Agents SDK, among many others. Prompt agents don't need any framework at all. Google Vertex AI uses the open-source Google ADK project, but you can use any open-source agent framework and deploy agents using Agent Runtime. ### 5. How can agents on Azure AI Foundry and Google Vertex AI use the Atlan MCP server? Both platforms can use Atlan's MCP server to get enterprise context to agents. The mechanism differs slightly, but the end goal is the same: a Foundry agent adds Atlan's MCP server as a remote MCP tool, and a Vertex AI agent built with the ADK has built-in constructs to connect to Atlan's MCP server as a client. --- ## Sources 1. [What's New in Microsoft Foundry, October and November 2025, Microsoft Foundry Blog (December 2025)](https://devblogs.microsoft.com/foundry/whats-new-in-microsoft-foundry-oct-nov-2025/) 2. [Introducing Gemini Enterprise Agent Platform, Powering the Next Wave of Agents, Google Cloud Blog (April 2026)](https://cloud.google.com/blog/products/ai-machine-learning/introducing-gemini-enterprise-agent-platform) 3. [Gemini Enterprise Agent Platform Product Page, Google Cloud (2026)](https://cloud.google.com/products/gemini-enterprise-agent-platform) 4. [The New Gemini Enterprise: One Platform for Agent Development, Google Cloud Blog (2026)](https://cloud.google.com/blog/products/ai-machine-learning/the-new-gemini-enterprise-one-platform-for-agent-development) 5. [Microsoft Brings Together Its Enterprise AI Offerings in the Azure AI Foundry, TechCrunch (November 2024)](https://techcrunch.com/2024/11/19/microsoft-brings-together-its-enterprise-ai-offerings-in-the-azure-ai-foundry/) 6. [Google Cloud Unveils Vertex AI, One Platform, Every ML Tool You Need, Google Cloud Blog (May 2021)](https://cloud.google.com/blog/products/ai-machine-learning/google-cloud-launches-vertex-ai-unified-platform-for-mlops) 7. [What Is Microsoft Foundry Control Plane?, Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/control-plane/overview) 8. [What Is Microsoft Foundry Agent Service?, Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/agents/overview) 9. [Agent Platform Overview, Gemini Enterprise Agent Platform, Google Cloud](https://docs.cloud.google.com/gemini-enterprise-agent-platform/overview) 10. [Microsoft Entra Agent ID Documentation, Microsoft Learn](https://learn.microsoft.com/en-us/entra/agent-id/) 11. [Agents Overview, Gemini Enterprise Agent Platform, Google Cloud](https://docs.cloud.google.com/gemini-enterprise-agent-platform/agents#agent_identity) 12. [Choose How to Build With Microsoft Foundry, Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/concepts/choose-build-approach) 13. [What Are Hosted Agents?, Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/agents/concepts/hosted-agents) 14. [Agent Studio Overview, Gemini Enterprise Agent Platform, Google Cloud](https://docs.cloud.google.com/gemini-enterprise-agent-platform/agent-studio) 15. [OpenAI Agents SDK, OpenAI GitHub](https://openai.github.io/openai-agents-python/) 16. [What Is Foundry IQ?, Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/agents/concepts/what-is-foundry-iq?tabs=portal) 17. [Agent Gateway Overview, Gemini Enterprise Agent Platform, Google Cloud](https://docs.cloud.google.com/gemini-enterprise-agent-platform/govern/gateways/agent-gateway-overview) 18. [The Model Hub, Hugging Face](https://huggingface.co/docs/hub/en/models-the-hub) 19. [Enable Incoming A2A on a Foundry Agent (Preview), Microsoft Learn](https://learn.microsoft.com/en-us/azure/foundry/agents/how-to/enable-agent-to-agent-endpoint?tabs=portal%2Cverify-bash%2Cconnection-bash) 20. [Model Garden on Gemini Enterprise Agent Platform, Google Cloud](https://cloud.google.com/model-garden) 21. [Agent Runtime, Gemini Enterprise Agent Platform, Google Cloud](https://docs.cloud.google.com/gemini-enterprise-agent-platform/build/runtime) --- ## Azure AI Foundry vs. Google Vertex AI: Related reads * [What is an Agent Context Layer? Architecture Guide](https://atlan.com/know/agent-context-layer/) * [Agent Context Layer Design](https://atlan.com/know/ai-agent/agent-context-layer-design/): Principles and Decisions * [Context Repository for AI Agents](https://atlan.com/know/ai-agent/context-repository-for-ai-agents/): A Practical Guide for 2026 * [Context Engineering for Multi-Agent Systems](https://atlan.com/know/context-engineering/context-engineering-for-multi-agents/): A 2026 Guide * [What Snowflake Cortex Needs](https://atlan.com/know/context-layer-for-snowflake-cortex/) from a Context Layer in 2026 * [Genie Ontology and the Atlan Context Layer](https://atlan.com/know/ai-agent/databricks/genie-ontology-and-atlan-context-layer/): Better Together * [Context Engineering 101](https://atlan.com/know/context-engineering-for-ai-analyst/): How to Build a Deep Context Layer for AI Analysts * [What is MCP (Model Context Protocol)](https://atlan.com/know/what-is-model-context-protocol/): A 2026 Guide * [What OpenAI's Data Agent Reveals](https://atlan.com/know/ai-readiness/openai-data-agent/) About Enterprise AI * [Gartner on Context Graphs](https://atlan.com/know/gartner-context-graphs/): Top Insights, Capabilities & Implementation Recommendations for 2026 * [Context Engineering for AI Governance](https://atlan.com/know/context-engineering-ai-governance/): Complete 2026 Guide * [Semantic Layers](https://atlan.com/know/semantic-layer/): The Complete Guide for 2026 * [Who Should Own the Context Layer](https://atlan.com/know/context-layer-ownership-data-vs-ai-teams/): Data Teams vs. AI Teams? | A 2026 Guide * [Context Layer vs. Semantic Layer](https://atlan.com/know/context-preparation-vs-data-preparation/): What's the Difference & Which Layer Do You Need for AI Success? * [What is Context Engineering](https://atlan.com/know/what-is-context-engineering/): Why Does Enterprise AI Depend On It in 2026? * [Context Graph vs Knowledge Graph](https://atlan.com/know/context-graph-vs-knowledge-graph/): Key Differences for AI * [Context Graph](https://atlan.com/know/what-is-a-context-graph/): Definition, Architecture, and Implementation Guide * [Context Graph vs Ontology](https://atlan.com/know/context-graph-vs-ontology/): Key Differences for AI * [What Is Ontology in AI?](https://atlan.com/know/what-is-ontology-in-ai/) Key Components and Applications * [Context Layer 101](https://atlan.com/know/ai-readiness/context-layer-101/): Why It's Crucial for AI * [Combining Knowledge Graphs With LLMs](https://atlan.com/know/combining-knowledge-graphs-llms/): Complete Guide * [What Is an AI Analyst?](https://atlan.com/know/what-is-an-ai-analyst/) Definition, Architecture, Use Cases, ROI * [Ontology vs Semantic Layer](https://atlan.com/know/ontology-vs-semantic-layer/): Understanding the Difference for AI-Ready Data * [What Is Conversational Analytics](https://atlan.com/know/conversational-analytics/) for Business Intelligence? * [Google Agentspace (Now Gemini Enterprise)](https://atlan.com/know/ai-agent/ai-agent-applications/google-agentspace/): What It Is, How It Works