Blogs

Telcos Are Building Sovereign AI. Now Comes the Hard Part.

Blog Banner

Written By

expert Image

Jayanth Nagarajan

Telecom Industry Leader & Board Advisor
LinkedIn Icon

More from Twimbit

Instagram IconLinkedIn IconInstagram Icon
Generate AI summary

Six months ago, the sovereign AI opportunity for telecom operators was becoming visible. Since then, operators from Korea to Indonesia and Europe have started putting serious infrastructure behind it.

But the opportunity is more complex than simply building local GPU capacity.

In February, I wrote about a window opening for telecom operators in sovereign AI. Governments and enterprises were becoming increasingly uncomfortable with the infrastructure underpinning their AI ambitions sitting almost entirely outside their control. Telcos, with their local infrastructure, regulated status, enterprise relationships and experience operating critical networks, appeared unusually well positioned to respond.

Six months later, the question is no longer whether telcos will participate. Several already are. The bigger question is who controls the AI stack, and how much of it needs to be controlled at all. That creates a much larger opportunity for telecom operators while also making the strategy considerably harder.

From sovereign cloud to sovereign stack

KT's recent NPU LLM Station in South Korea illustrates how far the concept is moving. The system combines a Korean-designed Rebellions ATOM-MAX AI accelerator, KT's own language model and an integrated operating and API platform in an appliance that can run entirely inside a customer's network. For government agencies, financial institutions, defence organisations and other customers operating under Korea's network-separation requirements, the proposition is clear: the model comes to the data.[1]

The architecture is interesting because sovereignty has moved down the stack. The chip, model, platform and deployment environment can all be controlled locally. But that does not mean every country or telco should attempt to build the entire AI stack domestically. Greater control can also create greater dependency on a particular architecture.

The emerging challenge is therefore not simply sovereignty. It is sovereignty without isolation.

Four strategic archetypes are emerging

There is no single telco sovereign AI model. Recent developments point to four approaches, noting that this isn’t an exhaustive list.

The sovereign appliance model. KT represents the clearest example, bringing tightly integrated AI infrastructure directly into secure enterprise and government environments, with control extending across model, software and silicon.[1]

The national-scale AI infrastructure model. SK Telecom is pushing beyond traditional telco cloud towards gigawatt-scale AI infrastructure supporting training, inference, sovereign AI, physical AI and agentic workloads. Its longer-term stated ambition extends to as much as 15GW of AI datacenter capacity, supported by a dedicated AI datacenter development company.[2][3][4]

The ecosystem orchestration model. Singtel's RE:AI combines AI-ready datacenters with its Paragon multi-cloud and multi-network orchestration platform and an ecosystem including NVIDIA, Mistral AI, Scale AI and Nscale. Indosat's GPU Merdeka initiative represents another version of this model, bringing together infrastructure, government, academia and industry.[5][7]

The distributed AI fabric. SoftBank's Telco AI Cloud vision combines centralised GPU infrastructure, regional computing and AI-RAN-based edge computing under its Infrinia AI Cloud OS. The objective is to move intelligence across the continuum from large-scale training to distributed inference.[6]

These approaches point to an important shift. The operator does not necessarily need to own every layer of the stack. The opportunity is to identify the layers where local control, network integration or ecosystem orchestration create an advantage that a global cloud platform cannot easily replicate.

The network matters again

The first wave of generative AI focused on massive centralised clusters and model training. AI is now moving towards inference, agents and physical AI. That changes the role of the network. These workloads introduce different requirements around latency, data movement, security, reliability and location. Some inference can happen in large AI datacenters. Other workloads may need to move closer to the enterprise edge.

This makes orchestration potentially more valuable than compute alone. Datacenter operators can build AI datacenters. Hyperscalers can build sovereign cloud regions. Specialist GPU providers and neoclouds can rent accelerated computing. Far fewer players combine distributed infrastructure, national connectivity, regulated operations, enterprise relationships and the ability to orchestrate workloads across cloud, edge and network environments.  

There is an obvious historical caution here. Telcos have tried before to move up the stack into cloud services, only to find themselves competing against hyperscalers with deeper software platforms, developer ecosystems and innovation cycles. The lesson is not simply that hyperscalers operated at a different scale. Many operators also lacked the product discipline, software capability and commercial motion required to compete higher up the stack. Sovereign AI does not automatically supply those capabilities, particularly as the hyperscalers expand their own sovereign and locally operated offerings.

The opportunity for telcos therefore cannot be a replay of “telco cloud”. Their advantage has to come from solving requirements that are harder to address through a global cloud model alone: distributed workload placement, national infrastructure integration, regulated operations, local ecosystem assembly and the ability to combine network and compute into a single operating environment.

That may be the more defensible telco proposition.

Sovereignty must extend beyond infrastructure

There is another boundary that will become increasingly important as AI becomes agentic. Controlling where a model runs does not necessarily mean controlling what it does. As AI systems gain authority to make decisions and act across enterprise systems, organisations will need to know which data and systems were touched, whether the agent operated within its intended authority and whether its decisions can be verified. Requirements around policy enforcement, auditability and decision provenance are still evolving, but they will become increasingly important alongside infrastructure controls. Keeping an AI system within national or enterprise boundaries addresses one category of risk. It does not prove that the system behaved as intended.

Infrastructure sovereignty without operational assurance may prove an incomplete form of control.

Europe exposes the sovereignty trade-off

A similar shift is visible in Europe. Deutsche Telekom's Industrial AI Cloud in Munich began operating with nearly 10,000 NVIDIA Blackwell GPUs and up to 0.5 exaflops of computing capacity. The platform now supports workloads spanning industrial AI, robotics, legal AI and autonomous systems.[8][9] But Europe also exposes an uncomfortable truth. A sovereign AI factory filled with NVIDIA GPUs may provide data and operational sovereignty while remaining heavily dependent on foreign technology.

Sovereignty is not binary. A country can control its data but not necessarily its silicon. It can control infrastructure but depend on foreign foundation models. It can develop a domestic model while relying on overseas cloud software. Trying to eliminate every dependency would be extraordinarily expensive and, for most countries, unrealistic.  

The more useful question is therefore: which dependencies matter enough to control?

The real test is economics

There is another test the emerging sovereign AI market has yet to pass: who will actually pay for all this capacity? Gigawatts, GPU counts and investment announcements demonstrate ambition. The next test will therefore be economic rather than architectural. Who are the anchor customers? Which workloads genuinely require sovereign infrastructure? What utilisation can operators realistically achieve? How much capital should they commit before demand becomes visible? Sovereignty does not suspend the economics of infrastructure.

Before making additional large capital commitments, operators should also ask whether they have a sufficiently granular demand-side view of which workloads will actually pay for sovereign capacity, at what utilisation and over what technology refresh cycle.

An AI factory can be strategically important and still be a questionable investment. Accelerated computing infrastructure can also turn over much faster than traditional network assets, while workload demand and model economics continue to evolve. For many operators, this investment decision also arrives after a decade of heavy network capital expenditure, making the burden of proof for another large infrastructure cycle considerably higher. Operators will need to shape the workloads, partnerships and customer commitments that justify the infrastructure rather than simply build capacity and wait for demand.  

The challenge is not only technology obsolescence but capital-cycle mismatch: telcos are accustomed to infrastructure designed to earn returns over much longer periods than successive generations of accelerated compute. That makes capital structure part of the strategy. Anchor tenants, government participation, infrastructure partners, joint ventures and staged capacity commitments may be as important as the technical architecture itself.

Six choices will determine who succeeds

The next phase is less about proving that telcos can participate in sovereign AI and more about deciding where to play, how to win and how much to commit. These decisions become difficult when treated as a technology roadmap in isolation. Operators need to test their assumptions against developments across markets, regulatory regimes, workload economics and operating models, particularly while the reference points are still emerging.

Against that backdrop, six choices can help operators work through the strategy.

1. Define what actually needs to be sovereign

Data, compute, models, silicon, operations and legal jurisdiction create different dependencies and risks. Start with the workload, not the infrastructure. Assess regulatory exposure, data sensitivity, operational criticality and acceptable external dependency. Then determine which layers genuinely require sovereign control. The objective should not be sovereignty at any cost. It should be clarity about which dependencies matter enough to control.

2. Decide where to own and where to orchestrate

Few operators can economically control the entire AI stack, nor should they necessarily try. The strategic question is where ownership creates genuine advantage. Elsewhere, orchestration may be more valuable. Orchestration does not necessarily mean building every layer of the software stack in-house. The stronger role may be to act as the integration layer across connectivity, compute, cloud platforms and regulatory requirements, while using partner technology where it is already superior.

3. Identify the advantage only a telco can bring

If the proposition stops at GPUs inside a domestic data centre, telcos will face competition from hyperscalers, datacenter operators and neoclouds. Many operators can point to assets that appear differentiated on paper: distributed infrastructure, national connectivity, regulated operations, enterprise relationships and orchestration. The harder test is whether those assets can be assembled into a product and commercial motion that wins against hyperscaler sovereign offerings and specialist AI infrastructure providers for reasons other than regulatory mandate. The advantage may be greatest where workloads must remain on-premise, operate within tightly controlled network environments, or require coordination between compute and connectivity that no cloud platform provides on its own. The question is not simply, ‘Can we build an AI factory?’ It is, ‘Why should customers buy this capability from us?’

4. Preserve customer choice while providing control

Sovereignty that replaces one dependency with another is incomplete. Customers will need control over where workloads and data reside without being locked into a particular accelerator, model or platform. Portability and interoperability therefore become strategic considerations. The strongest sovereign AI platforms may be those that provide practical control while preserving the ability to change technology as the market evolves.

5. Prove the economics before scaling

GPU counts demonstrate capacity. They do not demonstrate a business. Operators should work backwards from anchor demand, workload mix, utilisation, pricing and technology refresh cycles. Demand should progressively unlock capacity rather than capacity becoming a bet on future demand.

6. Become the transformation you intend to sell

Telcos should not treat sovereign AI purely as a new infrastructure product. Operators helping governments and enterprises transform with AI should also demonstrate how AI has changed their own networks, customer operations, workforce and decision-making. Working through AI adoption internally also exposes the control points, escalation paths and evidence requirements that enterprise customers will eventually demand. That experience creates something infrastructure alone cannot: practical credibility about what enterprise AI transformation actually requires.

The harder problem may be the more valuable one

The goal is not necessarily to own the sovereign AI stack. Nor is it simply to provide local compute. It is to determine which dependencies matter enough to control, where the operator can create differentiated value, which capabilities should come from an ecosystem and what level of investment the resulting demand can support.

Six months ago, the opportunity was for telcos to become credible providers of sovereign AI infrastructure. That window now appears very real. But the prize may not belong to own the most GPUs or control the most layers of the technology stack.

It may belong to the operators that can combine infrastructure, orchestration and operating-model transformation to give customers something more valuable: control over where intelligence runs, how it moves, how it acts and which dependencies they are willing to accept. The operators that succeed will be those that can answer these choices with evidence rather than assertion, under real competitive, regulatory and capital constraints.

That is a considerably harder problem than building a sovereign cloud. It may also be a much more valuable one.

References

1. RCR Wireless News, “KT unveils NPU LLM Station, a fully on-premise sovereign AI server,” 20 August 2026. The report describes the Rebellions ATOM-MAX NPU, KT Mi:dm model, integrated operating/API platform and fully on-premise deployment without external cloud connectivity.

2. SK Telecom, “SK Telecom and NVIDIA Build AI Infrastructure to Power Korea’s AI Innovation,” 8 June 2026. SKT describes a gigawatt-scale AI Cloud using NVIDIA DSX and supporting training, inference, sovereign AI, physical AI and agentic workloads.

3. SK Telecom, “SK Telecom Pursues 15GW AI Data Center Buildout, Aiming to Become Asia’s AI Infrastructure Hub,” 5 July 2026. The company describes a long-term 15GW ambition with an initial 5GW targeted for phased activation from 2029.

4. SK Telecom, “SK Telecom Launches Dedicated AI Data Center Business Development Company to Kick Off ‘Asia’s AI Infrastructure Hub’ Push,” 23 July 2026. SK Hyper is wholly owned by SKT, with the board approving up to KRW750 billion through 2030 for foundational investment including sites and substations.

5. NVIDIA, “Universitas Gadjah Mada, Indosat and NVIDIA Open Indonesia’s First University AI Center to Develop Local AI Talent,” 14 August 2026. The initiative involves Indonesia’s Ministry of Communication and Digital Affairs, UGM, Indosat and NVIDIA and provides access to AI infrastructure including GPU Merdeka.

6. SoftBank Corp., “SoftBank Corp. Announces Telco AI Cloud Vision to Build Social Infrastructure for the AI Era, Leveraging Its Telecommunications Foundation,” 2 March 2026. The proposed architecture integrates GPU cloud, regional computing, AI-RAN/MEC and the Infrinia AI Cloud OS.

7. Singtel Digital InfraCo, “RE:AI” and “Singtel Paragon,” accessed August 2026. This description reflects Singtel’s own positioning of RE:AI as a sovereign AI cloud integrating Nxera AI-ready data centres with Paragon multi-cloud and multi-network orchestration, alongside ecosystem partners including NVIDIA, Mistral AI, Scale AI and Nscale.

8. Deutsche Telekom, “Germany’s first AI factory for industry officially goes into operation in Munich,” 4 February 2026. Deutsche Telekom reports nearly 10,000 NVIDIA Blackwell GPUs and up to 0.5 exaflops of computing capacity.

9. Deutsche Telekom, “T-Systems and SupplyOn Bring AI to Europe’s Supply Chains,” June 2026. Deutsche Telekom states that the Industrial AI Cloud has 10,000 NVIDIA Blackwell GPUs, 0.5 exaflops and 20 petabytes of storage, and increased available German AI computing capacity by approximately 50%.

10. GSMA Intelligence, The Mobile Economy Europe 2026, June 2026. The report identifies operators as emerging participants in Europe’s sovereign-technology strategy and discusses Deutsche Telekom, Fastweb+Vodafone and Iliad/Scaleway among sovereign AI infrastructure initiatives.