Kimaro, Nelson and Singh, Amit Kumar and Saha, Sangeet and Zhai, Xiaojun and McDonald-Maier, Klaus (2026) CREST-LLM: Carbon–Reliability–Performance Evaluation Framework for Sustainable LLM Systems. In: IEEE International Conference on Omni-Layer Intelligent Systems (COINS), 2026-09-07 - 2026-09-09, Bologna, Italy.
Kimaro, Nelson and Singh, Amit Kumar and Saha, Sangeet and Zhai, Xiaojun and McDonald-Maier, Klaus (2026) CREST-LLM: Carbon–Reliability–Performance Evaluation Framework for Sustainable LLM Systems. In: IEEE International Conference on Omni-Layer Intelligent Systems (COINS), 2026-09-07 - 2026-09-09, Bologna, Italy.
Kimaro, Nelson and Singh, Amit Kumar and Saha, Sangeet and Zhai, Xiaojun and McDonald-Maier, Klaus (2026) CREST-LLM: Carbon–Reliability–Performance Evaluation Framework for Sustainable LLM Systems. In: IEEE International Conference on Omni-Layer Intelligent Systems (COINS), 2026-09-07 - 2026-09-09, Bologna, Italy.
Abstract
Large Language Model (LLM) inference systems are increasingly deployed at scale, yet existing hardware evaluation methodologies either prioritise performance or consider sustainability dimensions in isolation, without accounting for LLM-specific inference behaviour and reliability-driven lifetime effects. This paper presents CREST-LLM, an integrated evaluation framework for LLM inference that jointly models performance, reliability, and lifecycle carbon at design time. It integrates (i) a phase-aware inference energy model, (ii) a lifecycle carbon model capturing embodied and operational emissions, and (iii) an electromigration-based ageing model to quantify long-term reliability. Through simulation-driven exploration of heterogeneous architectures, we show that latency-optimized designs can incur up to 2× higher lifetime carbon and that ageing can reduce system lifetime by over 30%. We further show that selective redundancy extends lifetime while remaining near carbon break-even, providing actionable guidance for sustainable LLM system design.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Additional Information: | Published proceedings: _not provided_ |
| Uncontrolled Keywords: | Large-Language Models, Hardware System Simulation, Carbon emissions, System-Level Reliability |
| Subjects: | Z Bibliography. Library Science. Information Resources > ZR Rights Retention |
| Divisions: | Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
| SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
| Depositing User: | Unnamed user with email elements@essex.ac.uk |
| Date Deposited: | 30 Oct 2026 09:43 |
| Last Modified: | 30 Oct 2026 09:43 |
| URI: | http://repository.essex.ac.uk/id/eprint/43507 |
Available files
Filename: CREST_LLM__Carbon_Reliability_Performance_Evaluation_Framework_for_Sustainable_LLM_Systems.pdf
Licence: Creative Commons: Attribution 4.0