AI Infrastructure 101: Data Centers and Energy Needs

November X, 2026
A captivating view of a modern data center showcasing a complex arrangement of blue cables. This interior captures the essence of high-tech communication infrastructure.

The rapid adoption of artificial intelligence is creating significant demand for computing power, data center capacity, and energy infrastructure. Meeting these needs requires substantial capital investment across multiple industries, creating both opportunities and challenges for companies and investors. This paper explores how AI is reshaping infrastructure requirements, increasing demand for data centers and energy resources, and driving investment across multiple industries.  

What are the different types of AI?

There are several types of AI where the scope of capability is very different. Artificial narrow intelligence (ANI) is the most common and prevalent form of artificial intelligence today. ANI is highly specialized and restricted to performing a specific task based on predefined programming. Examples include voice assistants such as Siri, Alexa, and Google Assistant, image recognition that can identify objects, faces or emotions in images or video, such as facial recognition technology used in smartphones or security cameras. ANI is used in recommendation systems, where AI analyzes past behavior or browser history and recommends products, movies, or shows. Examples include shopping advertisements and recommendations for shows or music.

Generative AI refers to systems that create original content such as text, images, video, audio, and software based on user input. It relies on machine learning models, particularly deep learning models, to simulate the learning and decision-making processes of the human brain.

Agentic AI is an artificial intelligence system that can accomplish a specific goal with limited supervision, using machine learning models that mimic human decision-making to solve problems in real time to automate complex tasks, improve efficiency, and enable organizations to focus on strategic initiatives rather than routine operations. Unlike traditional AI models that operate within predefined constraints and require human intervention, agentic AI exhibits autonomy, goal-driven behavior, and adaptability.

An agentic AI system can use generated content to complete complex tasks autonomously by calling external tools. Examples include automated customer service, predictive maintenance in manufacturing where the AI continuously monitors machinery through sensors to detect anomalies and triggers maintenance before breakdowns occur to minimize unplanned downtimes and reduce maintenance costs. Agentic AI can be used to automate sales outreach communications by building custom messages, track responses, and follow up sales leads based on engagement levels. This integration with customer relationship management systems helps keep sales pipelines organized and updated in real time. To date, most of the agentic AI uses are to improve operating efficiency and productivity to lower costs.

How does AI computing differ from general-purpose computing?

The distinction between general compute and AI compute lies in their application and capabilities. General compute is used for a wide range of tasks, including data processing, simulations, and applications that do not require the level of intelligence or adaptability that AI systems do. AI compute uses large language models (LLMs), a type of artificial intelligence algorithm, to train on vast amounts of data to process and understand human languages, enabling them to perform a wide range of tasks. AI compute is specifically designed for tasks that require intelligence, such as learning, decision-making, and problem-solving. The amount of computing power used in AI training is significantly higher than general compute and the amount of high-performance compute usage has been increasing exponentially. As AI systems become more complex and capable, they will require more compute power to train, improve, and employ.

AI computing requires AI data centers equipped with cutting-edge technologies (GPUs (graphic processing units), TPUs (tensor processing units), and other AI accelerators), advanced storage architectures, resilient networking with broad bandwidth (maximum amount of data that can be transferred over a network connection in a given amount of time), low latency (delays in data transfer), and robust cooling systems to manage the heat generated from high energy demands of AI workloads.

Where are data centers located?

Older data centers were located closer to metropolitan centers where the businesses are, but the newer AI data centers are in rural or outer suburban areas with cheaper land, power availability, lower energy prices, connectivity to major digital infrastructure hubs for low latency connections for enterprises requiring fast data transfers, and regulatory incentives. As companies rush to build more datacenters, maps become outdated soon after publication.

 

Large cloud providers, including Amazon Web Services, Microsoft Azure, Google Cloud, Meta, and Oracle, continue to expand data center capacity to meet growing demand for AI training and usage. In addition to these established providers, developers, infrastructure operators, and investment partnerships are increasingly participating in data center construction and operations.

Investment in AI-related data centers continues to expand, particularly in the United States, as technology companies add computing capacity and secure the infrastructure required to support increasingly demanding workloads. This expansion requires significant capital investment from technology companies and infrastructure providers. At the same time, the growing pipeline of data-center development is increasing demand for electricity generation, transmission, and grid connections.1

Why do AI data centers require more energy infrastructure?

As data centers expand, their energy and water demands are increasing, raising concerns about sustainability and local resource management. Data centers have fluctuating demand throughout the day and need consistent energy availability to support high demand periods. The boom in data center construction has led to a backlog of data centers waiting for connection to the power grid, in some cases the wait could take five years according to the Lawrence Berkeley National Laboratory. The aging U.S. electrical grid needs significant infrastructure upgrades to support the much higher demand or create alternative backup systems to stabilize the grid during periods of intense usage.

Some data centers are going off-grid (or “behind the meter”, the energy industry’s term for generating one’s own power) by building their own power plants, mostly natural gas generators, to avoid waiting years to connect to the grid and quickly meet the enormous electricity demands of AI. Depending on the size of the data centers, the gas generation plants may not generate enough electricity to meet usage goals but is enough to start while it waits to connect to the grid. Once connected to the grid, the generators provide backup should high demand exceed the grid’s capacity.

Despite interest in renewable energy, all forms of renewable energy have intermittent generation and availability issues due to overcast weather or nighttime (solar), lack or change in wind patterns (wind), and draught (hydro). Use of renewable energy would require back-up alternatives such as gas, coal, nuclear, or battery power.

Nuclear power is one of several energy sources being considered to support growing electricity demand from data centers. In addition to existing nuclear facilities, there is interest in developing small modular reactors (SMRs), which are designed to have a smaller footprint than traditional nuclear power plants.  The SMRs are next-generation nuclear reactors with simpler designs for faster deployment and lower construction costs. Unlike other forms of electricity generation, nuclear plants will take much longer to build or refurbish. Traditional nuclear plants took around a decade to build.

Technology companies are also designing new semiconductor chips to require lower energy usage by improving efficiency and reducing cooling needs. There are increasing investments in battery storage systems to leverage all kinds of power generation – solar, wind, industrial gas turbines, and nuclear to provide back-up power to data centers.

Putting the pieces together

In the near term, technology companies are making significant upfront investments in product development and data center construction before they fully recognize revenue from the resulting products, services and computing capacity. Larger technology companies are also investing in or purchasing smaller hardware and software companies to expand their AI capabilities and ecosystems. As this ecosystem develops, suppliers of AI products, services, and infrastructure may help support broader corporate and consumer adoption.

The scale and pace of investment have raised questions about whether data center capacity could eventually exceed demand and how quickly new facilities will become profitable. Large technology companies are seeking to add capacity to meet growing demand, but building an AI data center can take years, depending on the facility’s size, location, and infrastructure requirements. As capacity becomes operational, providers can begin serving customers and generating revenue from the new infrastructure.

Organizations can support AI applications through on-premises data centers, public cloud services, private clouds, or hybrid models. As companies adopt AI to improve operating efficiency and develop new products and services, many will need to invest in AI-enabled software, modernize existing hardware and data architecture, or expand their use of cloud infrastructure. The pace of adoption will vary according to each organization’s technology needs, resources, and operating environment.

AI remains in the early stages of adoption and monetization. As more organizations use AI products and services, demand for both model training and inference, the process of using a trained model to generate a response or complete a task, may increase. Greater usage can generate additional data to refine AI models, while improved models can support wider adoption. Together, these developments can increase demand for data center capacity, electricity, storage, networking, and cooling.

If you have any questions about this report, please reach out to your relationship manager.

Looking for a deeper perspective

When Data Centers Come to Town examines the implications of data center development for local governments and public infrastructure.

The Credit Story Behind AI explores how AI infrastructure investment is affecting corporate financing, free cash flow, leverage, and credit quality.

 

1  North America Data Center Trends H2 2025 (CBRE Research, 2025), https://www.cbre.com/insights/books/north-america-data-center-trends-h2-2025.