The Iceberg of Emissions. When most AI companies talk about "Carbon Neutrality," they are talking about Scope 1 (Direct emissions from offices) and Scope 2 (Electricity for servers). This is the tip of the iceberg.
Scope 3 (Supply Chain) represents the massive, submerged chunk of the iceberg. For an AI company, this is almost entirely Hardware Manufacturing. You might not own the factory that melts the silicon, but you bought the chip that came out of it.
The Carbon Cost of Silicon
Manufacturing a modern 4nm AI accelerator at TSMC is closer to alchemy than assembly. It requires ultra-pure water, hazardous chemicals, and extreme ultraviolet (EUV) lithography machines that themselves consume megawatts of power.
Nvidia H100s don't grow on trees; they are baked in high-energy ovens. The "Embodied Carbon" (or Capital Goods) category within Scope 3 accounts for all the GHG emitted during:
Extraction: Mining the rare earth metals.
Refining: Purifying silicon ingots.
Manufacturing: The actual fab process.
Logistics: Shipping the GPU from Taiwan to a data center in Virginia.
Fact: The manufacturing phase can account for 50% to 80% of the total carbon footprint of a server if it is replaced every 3 years. We are burning more carbon to build the computer than to run it.
How to Calculate Your Share
If you don't own the data center, you are "renting" a slice of that embodied carbon. But under the Greenhouse Gas Protocol, you cannot ignore it. You are responsible for the "Services Purchased."
The standard Time-Based Allocation Method works like this:
Formula: Your Share = (Hours Rented / Total Lifetime Hours) * Total Embodied Carbon
A Practical Example Let's run the numbers for a typical training run.
Total Embodied Carbon of Server: 2,500 kg CO2eq (Conservative estimate for an 8-GPU node)
Useful Life: 4 years (35,040 hours)
Your Training Job: 100 hours
Your Usage: 1/8th of the server (1 GPU)
The Calculation: (100 / 35,040) * 2,500 = 7.13 kg CO2eq for the whole server Divided by 8 GPUs = 0.89 kg CO2eq per GPU per 100 hours.
This sounds small? Multiply it by 25,000 GPUs training continuously for 3 months. The numbers become astronomical.
Reducing Scope 3: The Lever of Longevity
How do you reduce a number that is locked in the moment the device is manufactured? You change the denominator: Time.
Extend Lifecycles: The most sustainable server is the one that already exists. Extending a server's life from 3 years to 6 years effectively halves its annual Scope 3 impact.
Use Legacy Hardware: For inference, do you really need H100s? Or will A100s or T4s suffice? Older hardware has already "paid off" much of its carbon debt.
Demand Transparency: In your RFPs (Request for Proposals), demand Product Carbon Footprint (PCF) datasheets. If a cloud provider can't tell you the embodied carbon of their instance types, they are hiding a massive liability on your balance sheet.
The Regulatory Future Under the EU CSRD, estimating Scope 3 effectively becomes mandatory. "We didn't know" is no longer a legal defense. You need to start building these allocation models into your FinOps dashboards today.
All in One Place
Atler Pilot decodes your cloud spend story by bringing monitoring, automation, and intelligent insights together for faster and better cloud operations.
