Context Is Not Free: Carbon-Aware LLM Routing for Multi-Turn LLM Web Services across Geo-Distributed Data Centers

Research indicates that carbon-aware routing for large language model (LLM) web services across geo-distributed data centers faces trade-offs when handling stateful, multi-turn conversations. While routing requests to regions with lower carbon intensity or smaller models can lower emissions, moving ongoing conversations requires recomputing localized key-value (KV) context caches, which can generate more carbon emissions than the transfer saves.

This analysis matters because well-intentioned sustainability and workload-routing strategies can inadvertently increase overall carbon footprints if technical statefulness is overlooked. Systemic infrastructure efficiency requires factoring hidden computational overheads into digital decarbonization roadmaps. Organizations scaling AI services must align operational routing models with actual net-emissions impacts rather than point-in-time regional metrics.

LLM web services run across geo-distributed data centers where grid carbon intensity fluctuates over time and geography.

Forward consideration, not a verified fact.