{"id":230,"date":"2024-09-26T09:00:00","date_gmt":"2024-09-26T16:00:00","guid":{"rendered":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/innovation\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/"},"modified":"2026-04-11T12:10:35","modified_gmt":"2026-04-11T19:10:35","slug":"sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2","status":"publish","type":"post","link":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/","title":{"rendered":"Sustainable by design: Innovating for energy efficiency in AI, part 2"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><em>Learn more about how we\u2019re making progress towards our sustainability commitments in part 1 of this blog: <\/em><a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/12\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-1\/?msockid=10cb6adad5056c8305847878d4b66d36\"><em>Sustainable by design: Innovating for energy efficiency in AI, part 1<\/em><\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As we continue to deliver on our customer commitments to cloud and AI innovation, we remain resolute in our commitment to advancing sustainability. A critical part of achieving our company goal of becoming carbon negative by 2030 is reimagining our cloud and AI infrastructure with power and energy efficiency at the forefront.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019re pursuing our carbon negative goal through three primary pillars: carbon reduction, carbon-free electricity, and carbon removal. Within the pillar of carbon reduction, power efficiency and energy efficiency are fundamental to sustainability progress, for our company and for the industry as a whole.<\/p>\n\n\n\n<div class=\"alignwide is-style-inline wp-block-bloginabox-theme-promotional\">\n\t\n<div class=\"promotional promotional--has-media promotional--media-right\">\n\t<div class=\"promotional__wrapper\">\n\t\t<div class=\"promotional__content-wrapper\">\n\t\t\t<div class=\"promotional__content\">\n\t\t\t\t\n\n<h2 class=\"wp-block-heading\" id=\"explore-how-we-re-advancing-the-sustainability-of-ai\">Explore how we&#8217;re advancing the sustainability of AI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Explore our three areas of focus<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a data-bi-an=\"Global CTA\" data-bi-ct=\"cta link\" data-bi-id=\"cta-block\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/blogs.microsoft.com\/blog\/2024\/04\/02\/sustainable-by-design-advancing-the-sustainability-of-ai\/\">Read more<\/a><\/div>\n<\/div>\n\n\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<div class=\"promotional__media-wrapper\">\n\t\t\t\t<div class=\"promotional__media\">\n\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"760\" height=\"446\" src=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/03\/17023-01_MSFT_MicrosoftStoresCustomerStoryMiBBlog_EmbeddedImg5_r1_v2.jpg\" class=\"attachment-full size-full\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/03\/17023-01_MSFT_MicrosoftStoresCustomerStoryMiBBlog_EmbeddedImg5_r1_v2.jpg 760w, https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/03\/17023-01_MSFT_MicrosoftStoresCustomerStoryMiBBlog_EmbeddedImg5_r1_v2-300x176.jpg 300w, https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/03\/17023-01_MSFT_MicrosoftStoresCustomerStoryMiBBlog_EmbeddedImg5_r1_v2-330x194.jpg 330w\" sizes=\"auto, (max-width: 760px) 100vw, 760px\" \/>\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t<\/div>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Although the terms \u201cpower\u201d and \u201cenergy\u201d are generally used interchangeably, power efficiency has to do with managing peaks in power utilization, whereas energy efficiency has to do with reducing the overall amount of power consumed over time.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This distinction becomes important to the specifics of research and application because of the type of efficiency in play. For an example of energy efficiency, you might choose to explore <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/introducing-phi-3-redefining-whats-possible-with-slms\/\" target=\"_blank\" rel=\"noreferrer noopener\">small language models (SLMs)<\/a> with fewer parameters that can run locally on your phone, using less overall processing power. To drive power efficiency, you might look for ways to improve the utilization of available power by improving <a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/publication\/prediction-based-power-oversubscription-in-cloud-platforms\/\" target=\"_blank\" rel=\"noreferrer noopener\">predictions of workload requirements<\/a>. &nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From datacenters to servers to silicon and throughout code, algorithms, and models, driving efficiency across a hyperscale cloud and AI infrastructure system comes down to optimizing the efficiency of every part of the system and how the system works as a whole. Many advances in efficiency have come from our research teams over the years, as we seek to explore bold new ideas and contribute to the global research community. In this blog, I\u2019d like to share a few examples of how we\u2019re bringing promising efficiency research out of the lab and into commercial operations.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Screenshot-2024-09-20-145729-1024x569.webp\" alt=\"Diagram lists four examples of ways Microsoft is working to bring breakthrough efficiency research into commercial operations: 1. Innovations in chip-level power telemetry, 2. Advancing AI data floating-point formats, 3. Driving efficiency of LLM inferencing, 4. New small language model (SLM) capabilities\" class=\"wp-image-3479\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"silicon-level-power-telemetry-for-accurate-real-time-utilization-data\">Silicon-level power telemetry for accurate, real-time utilization data<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019ve made breakthroughs in delivering power telemetry down to the level of the silicon, providing a new level of precision in power management. Power telemetry on the chip uses firmware to help us understand the power profile of a workload while keeping the customer workload and data confidential. This informs the management software that provides an air traffic control service within the datacenter, allocating workloads to the most appropriate servers, processors, and storage resources to optimize efficiency.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"working-collaboratively-to-advance-industry-standards-for-ai-data-formats\">Working collaboratively to advance industry standards for AI data formats<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Inside the silicon, algorithms are working to solve problems by taking some input data, processing that data through a series of defined steps, and producing a result. <a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/10\/09\/5-key-features-and-benefits-of-large-language-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">Large language models (LLMs)<\/a> are trained using machine learning algorithms that process vast amounts of data to learn patterns, relationships, and structures in language.<\/p>\n\n\n\n<div class=\"alignleft wp-block-bloginabox-theme-kicker\" data-bi-an=\"Kicker Left\">\n\t<div class=\"kicker\">\n\t\t<h2 class=\"kicker__title\">\n\t\t\tMicrosoft copilot\t\t<\/h2>\n\t\t<p class=\"kicker__content\">\n\t\t\t\t\t\t\t<a\n\t\t\t\t\thref=\"https:\/\/copilot.microsoft.com\/\"\n\t\t\t\t\tclass=\"kicker__link\"\n\t\t\t\t\ttarget=\"_blank\" rel=\"noopener noreferrer\"\t\t\t\t>\n\t\t\t\t\t\tTry Copilot\t\t\t\t\t\t\t\u2197<\/a>\n\t\t\t\t\t<\/p>\n\t<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><em><strong>Simplified example from Microsoft Copilot<\/strong>: Imagine teaching a child to write stories. The training algorithms are like the lessons and exercises you give the child. The model architecture is the child\u2019s brain, structured to understand and create stories. Inference algorithms are the child\u2019s thought process when writing a new story, and evaluation algorithms are the grades or feedback you give to improve their writing.<sup>1<\/sup><\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One of the ways to optimize algorithms for efficiency is to narrow the precision of floating-point data formats, which are specialized numerical representations used to handle real numbers efficiently. Working with the Open Compute Project, we\u2019ve collaborated with other industry leaders to form the <a href=\"https:\/\/www.opencompute.org\/blog\/amd-arm-intel-meta-microsoft-nvidia-and-qualcomm-standardize-next-generation-narrow-precision-data-formats-for-ai\" target=\"_blank\" rel=\"noreferrer noopener\">Microscaling Formats (MX) Alliance<\/a> with the goal of creating and standardizing next-generation 6- and 4-bit data types for AI training and inferencing.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Narrower formats allow silicon to execute more efficient AI calculations per clock cycle, which accelerates model training and inference times. These models take up less space, which means they require fewer data fetches from memory, and can run with better performance and efficiency. Additionally, using fewer bits transfers less data over the interconnect, which can enhance application performance or cut network costs.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"driving-efficiency-of-llm-inferencing-through-phase-splitting\">Driving efficiency of LLM inferencing through phase-splitting<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Research also shows promise for <a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/publication\/splitwise-efficient-generative-llm-inference-using-phase-splitting\/\" target=\"_blank\" rel=\"noreferrer noopener\">novel approaches to large language model (LLM) inference<\/a>, essentially separating the two phases of LLM inference onto separate machines, each well suited to that specific phase. Given the differences in the phases\u2019 resource needs, some machines can underclock their AI accelerators or even leverage older generation accelerators. Compared to current designs, this technique can deliver 2.35 times more throughput under the same power and cost budgets.<sup>2<\/sup><\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"learn-more-and-explore-resources-for-ai-efficiency\">Learn more and explore resources for AI efficiency<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">In addition to reimagining our own operations, we\u2019re working to empower developers and data scientists to build and optimize AI models that can achieve similar outcomes while requiring fewer resources. As mentioned earlier, small language models (SLMs) can provide a more efficient alternative to large language models (LLMs) for many use cases, such as fine-tuning experimentation on a variety of tasks or even <a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/blog\/orca-math-demonstrating-the-potential-of-slms-with-model-specialization\/\" target=\"_blank\" rel=\"noreferrer noopener\">grade school math problems<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In April 2024, <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/introducing-phi-3-redefining-whats-possible-with-slms\/\" target=\"_blank\" rel=\"noreferrer noopener\">we announced Phi-3<\/a>, a family of open, highly capable, and cost-effective SLMs that outperform models of the same and larger sizes across a variety of language, reasoning, coding, and math benchmarks. This release expands the selection of high-quality models for customers, offering practical choices for composing and building generative AI applications. We then introduced <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/boost-your-ai-with-azures-new-phi-model-streamlined-rag-and-custom-generative-ai-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">new models to the Phi family<\/a>, including Phi-3.5-MoE, a Mixture of Experts model that combines 16 smaller experts into one, and Phi-35-mini. Both of these models are multi-lingual, supporting more than 20 languages.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Learn more about how we\u2019re advancing sustainability through our Sustainable by design blog series, starting with&nbsp;<a href=\"https:\/\/blogs.microsoft.com\/blog\/2024\/04\/02\/sustainable-by-design-advancing-the-sustainability-of-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">Sustainable by design: Advancing the sustainability of AI<\/a>.<\/p>\n\n\n\n<div style=\"height:49px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity divider my-3\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><sup>1<\/sup>Excerpt from prompting Copilot with: please explain how algorithms relate to LLMs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><sup>2<\/sup><a href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/publication\/splitwise-efficient-generative-llm-inference-using-phase-splitting\/\" target=\"_blank\" rel=\"noreferrer noopener\">Splitwise: Efficient generative LLM inference using phase splitting<\/a>, Microsoft Research.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this blog, I\u2019d like to share a few examples of how we\u2019re bringing promising efficiency research out of the lab and into commercial operations.<\/p>\n","protected":false},"author":11,"featured_media":848,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","ms-ems-related-posts":[],"footnotes":""},"categories":[127],"tags":[1374,1657],"content-type":[118],"industry":[],"job-function":[],"topic":[],"coauthors":[191],"class_list":["post-230","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-energy-and-resources","tag-ai","tag-sustainability","content-type-thought-leadership"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog<\/title>\n<meta name=\"description\" content=\"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog\" \/>\n<meta property=\"og:description\" content=\"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\" \/>\n<meta property=\"og:site_name\" content=\"The Microsoft Cloud Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-09-26T16:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-11T19:10:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/05\/kensci_pic2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"628\" \/>\n\t<meta property=\"og:image:height\" content=\"869\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Mark Russinovich\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/05\/kensci_pic2.png\" \/>\n<meta name=\"twitter:creator\" content=\"@MSCloud\" \/>\n<meta name=\"twitter:site\" content=\"@MSCloud\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mark Russinovich\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\"},\"author\":[{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/author\/mark-russinovich\/\",\"@type\":\"Person\",\"@name\":\"Mark Russinovich\"}],\"headline\":\"Sustainable by design: Innovating for energy efficiency in AI, part 2\",\"datePublished\":\"2024-09-26T16:00:00+00:00\",\"dateModified\":\"2026-04-11T19:10:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\"},\"wordCount\":989,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg\",\"keywords\":[\"AI\",\"Sustainability\"],\"articleSection\":[\"Energy and resources\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\",\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\",\"name\":\"Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog\",\"isPartOf\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg\",\"datePublished\":\"2024-09-26T16:00:00+00:00\",\"dateModified\":\"2026-04-11T19:10:35+00:00\",\"description\":\"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.\",\"breadcrumb\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage\",\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg\",\"contentUrl\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg\",\"width\":1260,\"height\":708,\"caption\":\"A decorative image of a person working on a computer\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Sustainable by design: Innovating for energy efficiency in AI, part 2\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#website\",\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/\",\"name\":\"The Microsoft Cloud Blog\",\"description\":\"Build the future of your business with AI\",\"publisher\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization\",\"name\":\"Microsoft Cloud Blog\",\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2023\/10\/microsoft_logo.webp\",\"contentUrl\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2023\/10\/microsoft_logo.webp\",\"width\":400,\"height\":400,\"caption\":\"Microsoft Cloud Blog\"},\"image\":{\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/MSCloud\",\"https:\/\/www.linkedin.com\/showcase\/microsoft-cloud-platform\/\",\"https:\/\/www.youtube.com\/@MicrosoftCloud\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/person\/8c1122f4276e778d2bf9e52bda7cf9d4\",\"name\":\"Kristina Corbitt\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g5e045b8d3ccd635d1af71a14365dff31\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g\",\"caption\":\"Kristina Corbitt\"},\"url\":\"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/author\/kristinacorbitt\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog","description":"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/","og_locale":"en_US","og_type":"article","og_title":"Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog","og_description":"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.","og_url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/","og_site_name":"The Microsoft Cloud Blog","article_published_time":"2024-09-26T16:00:00+00:00","article_modified_time":"2026-04-11T19:10:35+00:00","og_image":[{"width":628,"height":869,"url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/05\/kensci_pic2.png","type":"image\/png"}],"author":"Mark Russinovich","twitter_card":"summary_large_image","twitter_image":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2017\/05\/kensci_pic2.png","twitter_creator":"@MSCloud","twitter_site":"@MSCloud","twitter_misc":{"Written by":"Mark Russinovich","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#article","isPartOf":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/"},"author":[{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/author\/mark-russinovich\/","@type":"Person","@name":"Mark Russinovich"}],"headline":"Sustainable by design: Innovating for energy efficiency in AI, part 2","datePublished":"2024-09-26T16:00:00+00:00","dateModified":"2026-04-11T19:10:35+00:00","mainEntityOfPage":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/"},"wordCount":989,"commentCount":0,"publisher":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization"},"image":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage"},"thumbnailUrl":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg","keywords":["AI","Sustainability"],"articleSection":["Energy and resources"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/","url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/","name":"Sustainable by design: Innovating for energy efficiency in AI, part 2 | The Microsoft Cloud Blog","isPartOf":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage"},"image":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage"},"thumbnailUrl":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg","datePublished":"2024-09-26T16:00:00+00:00","dateModified":"2026-04-11T19:10:35+00:00","description":"Explore examples of how Microsoft is bringing promising efficiency research out of the lab and into commercial operations.","breadcrumb":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#primaryimage","url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg","contentUrl":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2024\/09\/Cloud_371038_Blog_240919.jpg","width":1260,"height":708,"caption":"A decorative image of a person working on a computer"},{"@type":"BreadcrumbList","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/2024\/09\/26\/sustainable-by-design-innovating-for-energy-efficiency-in-ai-part-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/"},{"@type":"ListItem","position":2,"name":"Sustainable by design: Innovating for energy efficiency in AI, part 2"}]},{"@type":"WebSite","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#website","url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/","name":"The Microsoft Cloud Blog","description":"Build the future of your business with AI","publisher":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#organization","name":"Microsoft Cloud Blog","url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2023\/10\/microsoft_logo.webp","contentUrl":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-content\/uploads\/2023\/10\/microsoft_logo.webp","width":400,"height":400,"caption":"Microsoft Cloud Blog"},"image":{"@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/MSCloud","https:\/\/www.linkedin.com\/showcase\/microsoft-cloud-platform\/","https:\/\/www.youtube.com\/@MicrosoftCloud"]},{"@type":"Person","@id":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/#\/schema\/person\/8c1122f4276e778d2bf9e52bda7cf9d4","name":"Kristina Corbitt","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g5e045b8d3ccd635d1af71a14365dff31","url":"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/dc592a8e7ee0e7462db18cd1a5aae84cd6a7d1374638737abc07d33e991b7bbe?s=96&d=microsoft&r=g","caption":"Kristina Corbitt"},"url":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/author\/kristinacorbitt\/"}]}},"bloginabox_animated_featured_image":null,"bloginabox_display_generated_audio":false,"_links":{"self":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/posts\/230","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/comments?post=230"}],"version-history":[{"count":1,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/posts\/230\/revisions"}],"predecessor-version":[{"id":12922,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/posts\/230\/revisions\/12922"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/media\/848"}],"wp:attachment":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/media?parent=230"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/categories?post=230"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/tags?post=230"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/content-type?post=230"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/industry?post=230"},{"taxonomy":"job-function","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/job-function?post=230"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/topic?post=230"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/microsoft-cloud\/blog\/wp-json\/wp\/v2\/coauthors?post=230"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}