{"id":320,"date":"2020-02-22T17:47:41","date_gmt":"2020-02-22T17:47:41","guid":{"rendered":"https:\/\/pensando.amylaun.com\/?p=320"},"modified":"2021-12-28T00:01:21","modified_gmt":"2021-12-28T00:01:21","slug":"the-pendulum-of-domain-specific-hardware","status":"publish","type":"post","link":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/","title":{"rendered":"The Pendulum of Domain-Specific Hardware"},"content":{"rendered":"

There is a lot of talk these days<\/a> about \u201cdomain-specific hardware.\u201d It is useful to have a historical perspective to understand this discussion because the pendulum has swung in both directions a couple of times.<\/p>\n

The concept of domain-specific hardware is not new. Back in the 1970s\u20131980s, at the time of mainframes, the primary CPUs were not fast enough to do both computing and I\/O. Coprocessors<\/a> and I\/O offloads were common. During the years 1990 to 2000, we all witnessed a rapid growth of processor performance associated with significant innovation in the processor architecture such as pipelined processor, superscalar processor, speculative execution, and virtualization extensions for speeding up hypervisors. Integrated caches played a big part in this performance boost as well, because processor speeds grew super-linearly as compared to DRAM speeds. All this evolution happened thanks to the capability to shrink the transistor size. In the 2000s, with transistor channel-length becoming sub-micron, it became challenging to continue to increase the speed of the single CPU (or more appropriately core). The SpecINT benchmark<\/a> that tracks the single-thread performance started to grow only single-digit per year. In 2018, single-thread CPU speed only grew approximately 4 percent per year.<\/p>\n

\"Book<\/p>\n

The slowdown in Moore\u2019s law<\/a>, the end of Dennard scaling<\/a>, and other technical issues related to the difficulty of further reducing the size of the transistors are causing this slowdown. We will cover them in a future post.<\/p>\n

The only effective way to utilize the growing number of transistors was by introducing multicore architectures; that is, putting multiple CPUs on the same chip<\/p>\n

In 2010 the pendulum started to swing back. With the introduction of the \u201ccloud,\u201d the cloud providers began to realize that the amount of I\/O traffic was growing extremely fast due to the explosion of East-West traffic,<\/a> storage networking, and applications that are I\/O intensive. Implementing network, storage, and security services in the server CPU was consuming too many CPU cycles \u2014 these precious CPU cycles needed to be used and billed to users, not to services.
\nThe historical period with the mindset: \u201c\u2026 we don\u2019t need specialized hardware since CPU speeds continue increasing, CPUs are general-purpose, the software is easy to write \u2026\u201d<\/em>\u00a0came to an end with a renewed interest in domain-specific hardware.<\/p>\n

Domain-specific hardware is optimized for certain types of data processing tasks, allowing it to perform those tasks way faster and more efficiently than general-purpose CPUs. Graphics processing units (GPUs)<\/a> are an example of domain-specific hardware. Created to support advanced graphics interfaces, today they are also extensively used for artificial intelligence and machine learning. The key to GPUs\u2019 success is the highly parallel structure that makes them more efficient than CPUs for algorithms that process large blocks of data in parallel and rely on extensive floating-point math computations.<\/p>\n

Intel QuickAssist Adapters<\/a> are an example of domain-specific hardware applied to the field of security. They provide crypto acceleration and compression capabilities.<\/p>\n

Another example is Google\u2019s Tensor Processing Unit,<\/a> an ASIC designed to speedup artificial intelligence operations.<\/p>\n

Domain-specific hardware is also starting to appear in the cloud servers, mainly to offload network, storage, and security services from the central server CPU. With the advent of the cloud, and with the proliferation of East-West traffic, implementing these services in software may consume a significant part of the CPU cycles.<\/p>\n

In conclusion, now the pendulum points toward domain-specific hardware that has several fields of application and can be a lower cost and lower power utilization alternative to general-purpose CPUs.<\/p>\n

A must-read on the topic is \u201cA new golden age for computer architecture \u201d by John L. Hennessy and David A. Patterson.<\/a><\/p>\n

This topic is also covered in detail in Chapter 7 of my book Building a Future-Proof Cloud Infrastructure: A Unified Architecture for Network, Security, and Storage Services<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Domain-specific hardware vs. general purpose processors<\/p>\n","protected":false},"author":21,"featured_media":324,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-320","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"acf":[],"yoast_head":"\nThe Pendulum of Domain-Specific Hardware - Pensando<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Pendulum of Domain-Specific Hardware - Pensando\" \/>\n<meta property=\"og:description\" content=\"Domain-specific hardware vs. general purpose processors\" \/>\n<meta property=\"og:url\" content=\"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/\" \/>\n<meta property=\"og:site_name\" content=\"Pensando\" \/>\n<meta property=\"article:published_time\" content=\"2020-02-22T17:47:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-12-28T00:01:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1023\" \/>\n\t<meta property=\"og:image:height\" content=\"625\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Heather Morris\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Heather Morris\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/\"},\"author\":{\"name\":\"Heather Morris\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\"},\"headline\":\"The Pendulum of Domain-Specific Hardware\",\"datePublished\":\"2020-02-22T17:47:41+00:00\",\"dateModified\":\"2021-12-28T00:01:21+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/\"},\"wordCount\":630,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/ShowCover-e1584726699913.jpeg\",\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/\",\"name\":\"The Pendulum of Domain-Specific Hardware - Pensando\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/ShowCover-e1584726699913.jpeg\",\"datePublished\":\"2020-02-22T17:47:41+00:00\",\"dateModified\":\"2021-12-28T00:01:21+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#primaryimage\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/ShowCover-e1584726699913.jpeg\",\"contentUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/ShowCover-e1584726699913.jpeg\",\"width\":1023,\"height\":625},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/the-pendulum-of-domain-specific-hardware\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Pendulum of Domain-Specific Hardware\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#website\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/\",\"name\":\"Pensando\",\"description\":\"We Democratize The Cloud\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\",\"name\":\"Heather Morris\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"caption\":\"Heather Morris\"},\"sameAs\":[\"heather\"],\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/author\\\/heather\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Pendulum of Domain-Specific Hardware - Pensando","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"The Pendulum of Domain-Specific Hardware - Pensando","og_description":"Domain-specific hardware vs. general purpose processors","og_url":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/","og_site_name":"Pensando","article_published_time":"2020-02-22T17:47:41+00:00","article_modified_time":"2021-12-28T00:01:21+00:00","og_image":[{"width":1023,"height":625,"url":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg","type":"image\/jpeg"}],"author":"Heather Morris","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Heather Morris","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#article","isPartOf":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/"},"author":{"name":"Heather Morris","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc"},"headline":"The Pendulum of Domain-Specific Hardware","datePublished":"2020-02-22T17:47:41+00:00","dateModified":"2021-12-28T00:01:21+00:00","mainEntityOfPage":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/"},"wordCount":630,"commentCount":0,"image":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#primaryimage"},"thumbnailUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg","inLanguage":"en","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/","url":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/","name":"The Pendulum of Domain-Specific Hardware - Pensando","isPartOf":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/#website"},"primaryImageOfPage":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#primaryimage"},"image":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#primaryimage"},"thumbnailUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg","datePublished":"2020-02-22T17:47:41+00:00","dateModified":"2021-12-28T00:01:21+00:00","author":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc"},"breadcrumb":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/"]}]},{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#primaryimage","url":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg","contentUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/02\/ShowCover-e1584726699913.jpeg","width":1023,"height":625},{"@type":"BreadcrumbList","@id":"https:\/\/share.mahalodigital.com\/Pensando\/the-pendulum-of-domain-specific-hardware\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/share.mahalodigital.com\/Pensando\/"},{"@type":"ListItem","position":2,"name":"The Pendulum of Domain-Specific Hardware"}]},{"@type":"WebSite","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#website","url":"https:\/\/share.mahalodigital.com\/Pensando\/","name":"Pensando","description":"We Democratize The Cloud","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/share.mahalodigital.com\/Pensando\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Person","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc","name":"Heather Morris","image":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","caption":"Heather Morris"},"sameAs":["heather"],"url":"https:\/\/share.mahalodigital.com\/Pensando\/author\/heather\/"}]}},"_links":{"self":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/320","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/comments?post=320"}],"version-history":[{"count":1,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/320\/revisions"}],"predecessor-version":[{"id":2537,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/320\/revisions\/2537"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/media\/324"}],"wp:attachment":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/media?parent=320"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/categories?post=320"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/tags?post=320"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}