I'm a Data Engineer by day at Riot Games (via X-Team ) and by night, I curate the last news/product announcements/resources about AWS Silicon (Graviton, AWS Nitro, Inferentia, and Trainium).
Share
AWS Graviton Weekly # 23: Week from February 3rd, 2023 to February 10th, 2023
Published about 1 year ago • 11 min read
You're receiving this because you subscribed here OR here
Issue # 23: February 3rd, 2023 to February 10th, 2023
Hey Reader
Welcome to Issue # 23 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from February 3rd, 2023 to February 10th, 2023.
Today, I'm getting a new picture for the background of this newsletter with my new AWS Community Builder cap.
The AWS Community Management team sent me this package two months ago, but I've not used the cap a lot; only the incredible metal cup.
That changed today when my lovely wife reminded me that I already had a cap and my AWS Graviton Weekly t-shirt as well.
👌👌👌👌👌👌
BTW: welcome to the new subscribers this week.
One of those subscribers asked me a very interesting question:
What are some of the pain points that companies are facing today when they are trying to make the move to Graviton or Arm64 architecture in general?
Love to hear more from you, Graviton community.
The resources you can't miss this week? The post about Sustainability on the Cloud, the workshop about DocumentDB, and perhaps these Tweets???
Starting today, Amazon Elastic Compute Cloud (Amazon EC2) R6gd instances are available in AWS Region Europe (London). These instances are powered by AWS Graviton2 processors, and they are built on AWS Nitro System.
The Nitro System is a collection of AWS designed hardware and software innovations that enables the delivery of efficient, flexible, and secure cloud services with isolated multi-tenancy, private networking, and fast local storage. R6gd instances provide local SSD storage and are ideal for memory-intensive workloads such as open-source databases, in-memory caches, and real time big data analytics that need access to high-speed, low latency storage.
Amazon EC2 R6gd instances offer up to 25 Gbps of network bandwidth, up to 19 Gbps of bandwidth to the Amazon Elastic Block Store (Amazon EBS), and up to 3.8 TB of NVMe-based SSD storage.
Starting today, Graviton3-based Amazon Elastic Compute Cloud (Amazon EC2) C7g instances are available in bare metal size.
C7g instances deliver up to 25% better compute performance, up to 2x higher floating-point performance, up to 2x faster cryptographic performance, and up to 3x faster CPU-based machine learning (ML) performance compared to AWS Graviton2 processors, including support for bfloat16.
C7g instances feature the latest DDR5 memory, which provides 50% more memory bandwidth compared to DDR4.
They are built on the AWS Nitro System, a collection of AWS designed hardware and software innovations that enables the delivery of efficient, flexible, and secure cloud services with isolated multi-tenancy, private networking, and fast local storage.
C7g instances are built for workloads including batch processing, ad serving, video encoding, gaming, scientific modelling, data analytics, and CPU-based artificial intelligence and machine learning (AI/ML) inference.
Starting today, Amazon EC2 High Memory instances with 12TiB (u-12tb1.112xlarge) of memory are now available in South America (Sao Paulo) region.
Customers can start using these new High Memory instances with On Demand and Savings Plan purchase options.
Amazon EC2 High Memory instances are certified by SAP for running Business Suite on HANA, SAP S/4HANA, Data Mart Solutions on HANA, Business Warehouse on HANA, and SAP BW/4HANA in production environments.
Amazon EC2 now supports replacing the root volume on a running EC2 Mac instance, enabling you to restore the root volume of an EC2 Mac instance to its initial launch state or to a specific snapshot, without requiring you to stop or terminate the instance. You can now reset the EC2 Mac instance back to a known state, while still retaining any local data, networking configurations, and IAM instance profiles. You can also leverage this capability to quickly provision fresh macOS environments on your EC2 Mac Dedicated Hosts without triggering the host scrubbing workflow.
Amazon GuardDuty is now available in the Europe (Spain) Region. You can now continuously monitor and detect security threats in this additional region to help protect your AWS accounts, workloads, and data.
Customers across many industries and geographies use Amazon GuardDuty, including more than 90% of AWS’s 2,000 largest customers. GuardDuty continuously monitors for malicious or unauthorized behavior to help protect your AWS resources, including your AWS accounts, EC2 workloads, access keys, EKS clusters, and data stored in Amazon S3 and Amazon Aurora. GuardDuty can identify unusual or unauthorized activity like crypto-currency mining, access to data stored in S3 from unusual locations, or unauthorized access to Amazon Elastic Kubernetes Service (EKS) clusters. GuardDuty Malware Protection adds file scanning for workloads utilizing Amazon Elastic Block Store (EBS) volumes to detect the presence of malware. GuardDuty continually evolves its techniques to identify indicators of compromise, such as updating machine learning (ML) models, adding new anomaly detections, and growing integrated threat intelligence to identify and prioritize potential threats.
Sustainability is an important topic in the tech industry, as well as society as a whole, and defined as the ability to continue to perform a process or function over an extended period of time without depletion of natural resources or the environment.
One of the key elements to designing a sustainable workload is software architecture. Think about how event-driven architecture can help reduce the load across multiple microservices, leveraging solutions like batching and queues. In these cases, the main traffic is absorbed at the entry-point of a cloud workload and ease inside your system. On top of architecture, think about data patterns, hardware optimizations, multi-environment strategies, and many more aspects of a software development lifecycle that can contribute to your sustainable posture in the Cloud.
The key takeaway: designing with sustainability in mind can help you build an application that is not only durable but also flexible enough to maintain the agility your business requires.
In this edition of Let’s Architect!, we share hands-on activities, case studies, and tips and tricks for making your Cloud applications more sustainable.
Azul has long been a leader in bringing Java to 64-bit Arm architectures. In the past, we led the effort to get OpenJDK working on Macintosh Atom 64-bit Arm chips and participated in the effort to bring OpenJDK to AWS Graviton 64-bit Arm chips. Now Azul provides superior performance on AWS Graviton 2 and Graviton 3.
Hi there, I am not going to waste you brains on stupid introductions, If you searched for how to install docker compose on Amazon LInux 2, I won’t add a 2000 word intro to fry your brains!
Amazon Linux 2 is nice and simple and small, but some things need extra attention to install. These commands work for both ARM64 Graviton, etc as well as regular AMD64 amazon linux 2. This also includes installing git and screen. Screen allows you to return to where you left off in disconnected ssh sessions.
AWS Graviton is the next generation of computing power that will take your application to the next level while reducing cost and increasing performance. You’ll be able to identify if you could take advantage of AWS Graviton2 or 3 or need to re-architect your application to support it.
Vectorized execution is a starred feature of Apache Doris and also the future trend of analytical database.
Thanks to AWS Graviton CPU, Doris's vectorization is better than ever. Relying on parallel processing and high-performance operators, Apache Doris can provide a sub-second level query on massive datasets. Users today began to build data storage architecture based on features of data lake. In this lecture, you will get the basic idea of how to build a data lake with Apache Doris.
Andrew Morrow talks about AWS's approach to sustainability and how it can help Media organisations achieve their sustainability goals. He talks about the innovation inside AWS, specifically about Graviton and Inferentia
Juan nos estará conversando sobre Amazon Elastic Compute Cloud (Amazon EC2) que proporciona capacidad de computación escalable. El uso de Amazon EC2 elimina la necesidad de invertir inicialmente en hardware, de manera que puede desarrollar e implementar aplicaciones en menos tiempo. Al igual que escalar hacia arriba o hacia abajo para controlar los cambios en los requisitos o los picos de popularidad, con lo que se reduce la necesidad de prever el tráfico.
This talk was very interesting to me because I didn't know that DocumentDB had already support for AWS Graviton processors, and thanks to Jason and Douglas here, I found out thatDocumentDB runs on Graviton smoothly.
I found this blog from 2022 about the topic if you are already interested in it.
Learning Objectives:
Objective 1: Receive an introduction to Amazon DocumentDB including why document databases, use cases, difference between Amazon DocumentDB and traditional databases, and the challenges with scaling traditional databases.
- Objective 2: Receive an introduction to scaling, pricing, and migration methods of Amazon DocumentDB.
- Objective 3: Stay up-to-date on new features that launched in 2022 including Elastic Clusters, Performance Insights, and fast database clothing.
Join us to learn about building a disaster recovery solution using AWS Elastic Disaster Recovery (AWS DRS). Learn how AWS DRS helps customers minimize downtime and data loss with fast, reliable recovery of on-premises and cloud-based applications using affordable storage, minimal compute, and point-in-time recovery.
The discussion will offer 100–200 level solution and the value of building a disaster recovery solution. At the end, we will play the Kahoot game, and the winners will be awarded an Uber Eats gift card.
Quote of the week
Common questions from customers moving EDA to AWS comes from the change of static to dynamic resources:
How to optimize job execution times?
This graph shows next generation Nitro and graviton chips verification (DV, Formal, Emulation, CV) tasks’ dynamic compute resources for 30 days spanning end of December and start of new year. It represents 5 of every 6 servers in our environment (1/6 are static hosts).
The big spikes are usually in weekends for running all regressions then all results are ready for debug and development beginning of the week. We can see that in the holidays (Christmas/Hanuka) and end of year - there were less on-demand spikes.
Scaling on demand means shorter queue times, instances provisioned instantly and engineering time is not wasted.
But there are best practices to follow:
- Always request more than 1 instance type for your job, in case this instance type is in short supply, you’ll still be able to run the job.
- Since frontend jobs tend to require smaller RAM
- keep the instances small/medium, and limit the number of jobs per instance to shutdown idle instances when jobs complete. Using these customers optimize their costs.
Adi Habusha(Senior Principal Engineer, AWS Graviton Processors Chief Architect at Amazon) Source: LinkedIn
Marcos Ortiz
I'm a Data Engineer by day at Riot Games (via X-Team ) and by night, I curate the last news/product announcements/resources about AWS Silicon (Graviton, AWS Nitro, Inferentia, and Trainium).
Issue # 82: April 5, 2024 to April 12, 2024 Hey Reader. Welcome to Issue # 82 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from April 5, 2024, to April 12, 2024. This week has been very quiet related to AWS Silicon because most headlines were occupied by Google Next, especially the new Arm-based CPU called Axion, which looks very interesting and promising. But one thing I noticed was that more and more times we will...
Issue # 81: March 29, 2024 to April 5, 2024 Hey Reader. Welcome to Issue # 81 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from March 29, 2024, to April 5, 2024. Things you can't miss in this issue: How Quora modernized its model serving with NVIDIA Triton and Amazon EKS Now, back to business. Tool of the week: Antimetal New website, new product; same incredible possible outcome if your company uses this tool to...
Issue # 80: March 22, 2024 to March 29, 2024 Hey Reader. Welcome to Issue # 80 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from March 22, 2024, to March 29, 2024. Before doing the normal stuff I do here every week, let me share with you an exciting product I'm building here. Some of you have always asked about having a single place with all the resources I've shared here in this newsletter since its foundation, but...
