{"id":1081,"date":"2020-09-20T09:16:19","date_gmt":"2020-09-20T09:16:19","guid":{"rendered":"https:\/\/pensando.io\/?p=1081"},"modified":"2021-12-27T23:57:10","modified_gmt":"2021-12-27T23:57:10","slug":"where-do-we-need-smartnics","status":"publish","type":"post","link":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/","title":{"rendered":"Where Do We Need SmartNICs?"},"content":{"rendered":"<p>This article was originally posted on Silvano Gai\u2019s blog <a href=\"https:\/\/silvanogai.github.io\/posts\/smartnic\/\">here.<\/a><\/p>\n<header class=\"texture-blue\">\n<div class=\"container\">\n<h4 class=\"post-description\">Where Do We Need SmartNICs?<\/h4>\n<h4 class=\"post-description\">Why SmartNICs are needed components of any modern cloud-based architecture<\/h4>\n<div class=\"post-date\">Published on Sep 18, 2020 by Silvano Gai<\/div>\n<\/div>\n<\/header>\n<p><main><\/p>\n<div class=\"container\">\n<div class=\"post-container\">\n<p>I am copying the title from\u00a0<a href=\"https:\/\/blog.ipspace.net\/2020\/09\/need-smart-nic.html\">a post of Ivan Pepelnjak,<\/a>\u00a0who runs\u00a0<a href=\"https:\/\/www.ipspace.net\/\">ipSpace.net<\/a>, one of the most well-respected blogs on computer networks.<\/p>\n<p>There is not much technical discussion on SmartNICs, I welcome Ivan\u2019s post, and I want to provide my perspective.<\/p>\n<p>There is no doubt in my mind that SmartNICs are needed components of any modern cloud-based architecture. The proof is in the pudding:\u00a0<strong>all cloud providers run some form of SmartNIC.<\/strong>\u00a0Some think it is so crucial that they have significant internal development efforts (e.g., AWS Nitro). The trend is toward designing Enterprise data centers using a cloud architecture and therefore to adopt many of the same solutions seen in public cloud.<\/p>\n<p>The need does not arise only from performance, mainly discussed in Ivan\u2019s post, but also from many other aspects discussed in the following.<\/p>\n<h2 id=\"performance-latency-and-jitter\">Performance, Latency and Jitter<\/h2>\n<p>I don\u2019t doubt any of the performance discussion in Ivan\u2019s post, but the question is: \u201cwhat\u2019s left of your server after it does any meaningful processing on 200 Gbps of traffic?\u201d It is not just about receiving and sending (i.e., pushing) the traffic or even switching it from port to port. It is about applying useful services to it and doing that without incurring high latency and jitter.<\/p>\n<h2 id=\"software-defined-networking\">Software Defined Networking<\/h2>\n<p>To implement a Software Defined Networking solution capable of operating in a modern\u00a0<a href=\"https:\/\/silvanogai.github.io\/posts\/clos-part1\/\">Clos environment<\/a>, a virtual switch must be feature reach, including encapsulation to support underlay and overlay networking, like VXLAN, VTEP, Geneve, etc. The performance greatly benefits from a hardware implementation.<\/p>\n<h2 id=\"visibility\">Visibility<\/h2>\n<ul>\n<li>Telemetry. Streaming telemetry measurements directly from the data plane is crucial to understand what is happening in the network.<\/li>\n<li>Tap-network. Avoiding a separate tap-network used to monitor the primary network is possible if the SmartNIC contains tap-network functionalities, resulting in considerable cost savings.<\/li>\n<\/ul>\n<h2 id=\"security\">Security<\/h2>\n<ul>\n<li>Firewall and micro-segmentation to protect (the workloads on) the server from external attacks and avoid that a compromised server can attack the network by moving laterally.<\/li>\n<li>Encryption both symmetric and asymmetric. If performed on the main server CPU, these are functions that will consume a lot of cores.<\/li>\n<li>Containment. The SmartNIC should be a separate entity from the server from a security perspective. It should have its security posture, and the security posture must not be accessible through the PCIe interface. Like in multi-factor authentication, an attacker will need to compromise the two entities to succeed.<\/li>\n<\/ul>\n<h2 id=\"virtual-block-storage\">Virtual Block Storage<\/h2>\n<p>With the advent of NVMe over fabric the SmartNIC is perfectly positioned to act as a block storage adapter.<\/p>\n<h2 id=\"scale\">Scale<\/h2>\n<p>Let\u2019s consider ACLs (Access Control Lists). It is easy to run a few of them in software, but let\u2019s try to run an ACL with 100,000 ACE (Access Control Entry). It does not scale!<\/p>\n<h2 id=\"combining-all-together\">Combining all together<\/h2>\n<p>I have never seen anybody attempting to run all these features in SW on a server, but it is possible on a SmartNIC.<\/p>\n<h2 id=\"virtualized-or-not\">Virtualized or not?<\/h2>\n<p>Nowadays, everyone wants to design an architecture that works for bare metal servers, virtual machines, and containers. A SmartNIC allows that since it is placed between the server and the network. A software solution running on the host is problematic in several of these environments. With virtual machines, do you implement the solution in the hypervisor or do you run over it? Can you modify the software of a bare-metal server running a database or an ERP application?<\/p>\n<h2 id=\"conclusions\">Conclusions<\/h2>\n<p>When considering all these factors, it is clear that it is not just about how many Gbps I can push in and out of the server. It is about what features I want to enable and what level of security do I want to achieve.<\/p>\n<p>I think there must be a good reason why all the main cloud-providers deploy SmartNICs on all of their servers.<\/p>\n<\/div>\n<\/div>\n<p><\/main><\/p>\n","protected":false},"excerpt":{"rendered":"<p>There is no doubt in my mind that SmartNICs are needed components of any modern cloud-based architecture. The proof is in the pudding:\u00a0all cloud providers run some form of SmartNIC.\u00a0Some think it is so crucial that they have significant internal development efforts (e.g., AWS Nitro). The trend is toward designing Enterprise data centers using a cloud architecture and therefore to adopt many of the same solutions seen in public cloud.<\/p>\n","protected":false},"author":21,"featured_media":867,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[3,17],"tags":[],"class_list":["post-1081","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud","category-smartnic"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Where Do We Need SmartNICs? - Pensando<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Where Do We Need SmartNICs? - Pensando\" \/>\n<meta property=\"og:description\" content=\"There is no doubt in my mind that SmartNICs are needed components of any modern cloud-based architecture. The proof is in the pudding:\u00a0all cloud providers run some form of SmartNIC.\u00a0Some think it is so crucial that they have significant internal development efforts (e.g., AWS Nitro). The trend is toward designing Enterprise data centers using a cloud architecture and therefore to adopt many of the same solutions seen in public cloud.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/\" \/>\n<meta property=\"og:site_name\" content=\"Pensando\" \/>\n<meta property=\"article:published_time\" content=\"2020-09-20T09:16:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-12-27T23:57:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1718\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Heather Morris\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Heather Morris\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/\"},\"author\":{\"name\":\"Heather Morris\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\"},\"headline\":\"Where Do We Need SmartNICs?\",\"datePublished\":\"2020-09-20T09:16:19+00:00\",\"dateModified\":\"2021-12-27T23:57:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/\"},\"wordCount\":671,\"commentCount\":2,\"image\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/shutterstock_366600368-scaled-1.jpg\",\"articleSection\":[\"Cloud\",\"SmartNIC\"],\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/\",\"name\":\"Where Do We Need SmartNICs? - Pensando\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/shutterstock_366600368-scaled-1.jpg\",\"datePublished\":\"2020-09-20T09:16:19+00:00\",\"dateModified\":\"2021-12-27T23:57:10+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#primaryimage\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/shutterstock_366600368-scaled-1.jpg\",\"contentUrl\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/shutterstock_366600368-scaled-1.jpg\",\"width\":2560,\"height\":1718},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/where-do-we-need-smartnics\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Where Do We Need SmartNICs?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#website\",\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/\",\"name\":\"Pensando\",\"description\":\"We Democratize The Cloud\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/#\\\/schema\\\/person\\\/4694712aaa17f4ab09864e0d7aefd0fc\",\"name\":\"Heather Morris\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g\",\"caption\":\"Heather Morris\"},\"sameAs\":[\"heather\"],\"url\":\"https:\\\/\\\/share.mahalodigital.com\\\/Pensando\\\/author\\\/heather\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Where Do We Need SmartNICs? - Pensando","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"Where Do We Need SmartNICs? - Pensando","og_description":"There is no doubt in my mind that SmartNICs are needed components of any modern cloud-based architecture. The proof is in the pudding:\u00a0all cloud providers run some form of SmartNIC.\u00a0Some think it is so crucial that they have significant internal development efforts (e.g., AWS Nitro). The trend is toward designing Enterprise data centers using a cloud architecture and therefore to adopt many of the same solutions seen in public cloud.","og_url":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/","og_site_name":"Pensando","article_published_time":"2020-09-20T09:16:19+00:00","article_modified_time":"2021-12-27T23:57:10+00:00","og_image":[{"width":2560,"height":1718,"url":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg","type":"image\/jpeg"}],"author":"Heather Morris","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Heather Morris","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#article","isPartOf":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/"},"author":{"name":"Heather Morris","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc"},"headline":"Where Do We Need SmartNICs?","datePublished":"2020-09-20T09:16:19+00:00","dateModified":"2021-12-27T23:57:10+00:00","mainEntityOfPage":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/"},"wordCount":671,"commentCount":2,"image":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#primaryimage"},"thumbnailUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg","articleSection":["Cloud","SmartNIC"],"inLanguage":"en","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/","url":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/","name":"Where Do We Need SmartNICs? - Pensando","isPartOf":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/#website"},"primaryImageOfPage":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#primaryimage"},"image":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#primaryimage"},"thumbnailUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg","datePublished":"2020-09-20T09:16:19+00:00","dateModified":"2021-12-27T23:57:10+00:00","author":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc"},"breadcrumb":{"@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/"]}]},{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#primaryimage","url":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg","contentUrl":"https:\/\/share.mahalodigital.com\/Pensando\/wp-content\/uploads\/2020\/05\/shutterstock_366600368-scaled-1.jpg","width":2560,"height":1718},{"@type":"BreadcrumbList","@id":"https:\/\/share.mahalodigital.com\/Pensando\/where-do-we-need-smartnics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/share.mahalodigital.com\/Pensando\/"},{"@type":"ListItem","position":2,"name":"Where Do We Need SmartNICs?"}]},{"@type":"WebSite","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#website","url":"https:\/\/share.mahalodigital.com\/Pensando\/","name":"Pensando","description":"We Democratize The Cloud","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/share.mahalodigital.com\/Pensando\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Person","@id":"https:\/\/share.mahalodigital.com\/Pensando\/#\/schema\/person\/4694712aaa17f4ab09864e0d7aefd0fc","name":"Heather Morris","image":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/db0951719e39512f630a24d5f95945aa7ea684ed102471d370bf15c7891bd2b5?s=96&d=mm&r=g","caption":"Heather Morris"},"sameAs":["heather"],"url":"https:\/\/share.mahalodigital.com\/Pensando\/author\/heather\/"}]}},"_links":{"self":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/1081","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/comments?post=1081"}],"version-history":[{"count":1,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/1081\/revisions"}],"predecessor-version":[{"id":2520,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/posts\/1081\/revisions\/2520"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/media\/867"}],"wp:attachment":[{"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/media?parent=1081"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/categories?post=1081"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/share.mahalodigital.com\/Pensando\/wp-json\/wp\/v2\/tags?post=1081"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}