AWS Graviton Weekly # 34


Issue # 34: April 21st, 2023 to April 28th, 2023

[Read the browser version right here]

In partnership with the Interesting Data Gigs Talent Collective

Hey Reader

Welcome to Issue # 34 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from April 21st, 2023 to April 28th, 2023.

The recommended resources for this week?

  • The upcoming in-person training from Graviton experts from AWS in San Jose, CA
  • The AWS Graviton Customers page got an fantastic upgrade
  • Read how Zomato migrated to Graviton and made a huge cut in cloud costs

Enjoy the content of this week


Brought to you by the Interesting Data Gigs Talent Collective

Are you looking for a new role in this challenging market?

You should consider joining to our Talent Collective, where your profile will be seen by companies like Rippling, Census, Luminary Platforms, Agnostic.AI, Attio, Clipboard Health, Paprika Labs, and many more.

Own your job search today.


NEWS

AWS Graviton Customers page Revamped with Search

Now, the AWS Graviton Customers page is now powered by Search, and I love it. Now, you can find even more good stuff there.

Visit the page here:

https://aws.amazon.com/ec2/graviton/customers/


AWS Lambda adds support for Java 17

AWS Lambda now supports Java 17 as both a managed runtime and a container base image. Developers creating serverless applications in Lambda with Java 17 can take advantage of new language features including Java records, sealed classes and multi-line strings. The Lambda Java 17 runtime also has numerous performance improvements, including optimizations when running Lambda functions on Graviton 2 processors. It supports AWS Lambda Snap Start (in supported Regions) for fast cold starts, and the latest versions of the popular Spring Boot 3 and Micronaut 4 application frameworks.
For more information on Lambda’s support for Java 17, see our blog post at Java 17 runtime now available in AWS Lambda.

Learn more:

https://aws.amazon.com/about-aws/whats-new/2023/04/aws-lambda-java-17/

https://aws.amazon.com/blogs/compute/java-17-runtime-now-available-on-aws-lambda



Amazon EC2 T4g instances are now available in Africa (Cape Town) region

Starting today, Amazon Compute Cloud (Amazon EC2) T4g instances are available in Africa (Cape Town) region.
These instances are powered by Arm-based AWS Graviton2 processors and deliver up to 40% better price performance over T3 instances.
The T4g instances provide a baseline level of CPU performance with the ability to burst CPU usage at any time for as long as required. Amazon EC2 T4g instances are built on the AWS Nitro System, a collection of AWS-designed hardware and software innovations that enable the delivery of efficient, flexible, and secure cloud services with isolated multi-tenancy, private networking, and fast local storage. T4g instances offer a balance of compute, memory, and network resources for a broad spectrum of general purpose workloads, such as large scale micro-services, caching servers, search engine indexing, e-commerce platforms, and virtual desktops.

Learn more:

https://aws.amazon.com/about-aws/whats-new/2023/04/amazon-ec2-t4g-instances-africa-cape-town-region/


Announcing the general availability of Amazon CodeCatalyst

Today, AWS announces the general availability of Amazon CodeCatalyst, a unified software development service that makes it easier for you to quickly build and deliver applications on AWS. CodeCatalyst provides everything you need to start planning, coding, building, testing, and deploying applications on AWS with a streamlined, integrated experience. With CodeCatalyst, you can spend more time developing application features and less time setting up project tools, creating and managing continuous integration and continuous delivery (CI/CD) pipelines, provisioning and configuring development and deployment environments, and onboarding team members to their projects.

Learn more:

https://aws.amazon.com/about-aws/whats-new/2023/04/general-availability-amazon-codecatalyst/


Amazon EC2 High Memory instances are now available in the Europe (Zurich) Region

Starting today, Amazon EC2 High Memory instances with 6TiB (u-6tb1.56xlarge, u-6tb1.112xlarge) of memory are now available in the Europe (Zurich) Region. Customers can start using these new High Memory instances with On Demand and Savings Plan purchase options.
Amazon EC2 High Memory instances are certified by SAP for running Business Suite on HANA, SAP S/4HANA, Data Mart Solutions on HANA, Business Warehouse on HANA, and SAP BW/4HANA in production environments.

Learn more:

https://aws.amazon.com/about-aws/whats-new/2023/04/amazon-ec2-high-memory-instances-zurich-region/

https://aws.amazon.com/ec2/instance-types/high-memory/

https://docs.aws.amazon.com/sap/latest/sap-hana/migrating-hana-to-hm.html


ARTICLES AND TUTORIALS


How Zomato Boosted Performance 25% and Cut Compute Cost 30% Migrating Trino and Druid Workloads to AWS Graviton, by Ashwini Kumar (Senior Specialist Solutions Architect at AWS), Ankit Shukla (Solutions Architect at AWS), Ayush Chauhan ( SDE-III at Zomato) and Rajat Taya (SDE-III at Zomato)

This post demonstrated the price/performance benefits of adopting AWS Graviton based instances for high throughput, near real-time big data analytics workloads running on Java-based, open source Apache Druid and Trino applications.
Overall, Zomato reduced the cost of its Amazon EC2 usage by 30%, while improving performance for both time-critical and ad-hoc querying by as much as 25%.
Due to better performance, Zomato was also able to right size compute footprint for these workloads on a smaller number of Amazon EC2 instances, with peak capacity of Apache Druid and Trino clusters reduced by 25% and 20% respectively.
Zomato migrated these open source software applications faster by quickly implementing customizations needed for optimum performance and compatibility with Graviton based instances.
Zomato’s mission is “better food for more people” and Graviton adoption is helping with this mission by providing a more sustainable, performant, and cost-effective compute platform on AWS. This is certainly a “food for thought” for customers looking forward to improve price-performance and sustainability for their business-critical workloads running on Open Source Software (OSS).

Learn more:

https://aws.amazon.com/blogs/opensource/how-zomato-boosted-performance-25-and-cut-compute-cost-30-migrating-trino-and-druid-workloads-to-aws-graviton/


Harnessing Deep Learning and HPC Kernels via High-Level Loop and Tensor Abstractions on CPU Architectures, by Evangelos Georganas, Dhiraj Kalamkar, Kirill Voronin, Antonio Noack, Hans Pabst, Alexander Breuer and Alexander Heinecke

A very interesting paper to read from Intel fellows

In this work we presented a framework to develop efficient, portable DL and HPC kernels for modern CPU architectures. We demonstrate the efficacy of our approach using standalone kernels and end-to-end training DL workloads that outperform state-of-theart implementations on multiple CPU platforms. As future work, we plan to integrate the standalone kernels we developed in additional end-to-end workloads (e.g. DLRM [31], block-sparse BERT inference [36]). Moreover, we plan to further apply our PARLOOPER/TPP kernel develpment framework on additional CPU architectures (e.g. with RISC-V ISA).

Learn more:

https://arxiv.org/pdf/2304.12576.pdf


Benchmarking Cadence Tools on Arm-Based Servers in the Cloud, by Vinod Khera

Arm is at the heart of the world’s most advanced digital products; over 70% of the world’s population uses Arm processor technology. The most innovative applications, from sensors to supercomputers (Fugaku) and servers to the cloud, are powered by Arm-based chips. Many companies use cloud-based infrastructure to run their workloads for improved performance, lower costs, better resource utilization, reduced time to market, and improved quality. Arm-based servers are increasingly adopted in cloud and on-premises deployments because of performance and cost benefits.
As mentioned in AWS re: Invent 2022, Graviton3 helps run VCPUs faster and can complete the same workload with 60% less energy consumption; Graviton3 can deliver 40% more performance per dollar compared to the fifth generation X86. Arm is shifting its EDA workloads to the AWS Gravition3 after they studied the Graviton family of AWS instances’ performance across various Cadence EDA workloads. This blog post highlights the cost efficiency (server) and performance improvements of the new AWS Graviton3 CPU and the C7g instance family for Arm’s EDA (Cadence) workloads.

Learn more:

https://community.cadence.com/cadence_blogs_8/b/corporate/posts/benchmarking-cadence-tools-on-arm-based-servers-in-the-cloud

https://community.arm.com/arm-community-blogs/b/high-performance-computing-blog/posts/aws-graviton3-improves-cadence-eda-tools-performance-for-arm


SLIDES, VIDEOS, and AUDIO

[VIDEO] Future-proof your Kubernetes Cluster for cost optimization, with Chris Short, Nathan Peck, Roland Barcia and Rajdeep Saha

Cost optimization is a common priority. In this session, learn about the many factors that can increase costs in your Kubernetes usage beyond compute, such as compute efficiencies at the node and pod level, scaling parameters, networking cost, multi-architecture image creation, security posture, and more.
Discover how to change your application components and migrate from x86-based instances to AWS Graviton to achieve cost efficiency at higher performance. Also, learn how to use open-source tools and AWS services to optimize these costs and make your Kubernetes cluster more resilient to economic instability.


Lessons learned working in Terraform with 1000+ engineers, with J Cole Morrison (Developer Advocate at HashiCorp) and Kien Pham (Staff Software Engineer at CodeSee)

Join HashiCorp with Kien Pham and J. Cole Morrison (@jcolemorrison) in this livestream and learn 3 key lessons in working with Terraform at scale: creating modular infrastructure as code; using multi-environment and cost optimized developer workflows; finding return on investment in DevOps. We'll also explore a live demo of refactoring 100+ resources into Terraform modules across multiple AWS accounts.

Learn more:

https://github.com/kpx-dev/terraform-example

https://www.codesee.io/


JOBS


EVENTS

Graviton Essentials - Developer Day

Wednesday, May 31 2023 | 8:30AM - 5:00PM PDT

Amazon SJC18, 2100 University Avenue, East Palo Alto, CA 94303

About the event

AWS presents the Graviton Essentials Developer Day. Graviton Essentials Developer Day is a free in-person immersion event where AWS Graviton experts deliver technically-focused Graviton-based Amazon EC2 training. This full-day event helps attendees learn best practices to accelerate migration and development of their workloads on Graviton-based instances. Attendees can expect to leave Graviton Essentials Developer Day feeling confident they will know how to achieve performance gains and cost reductions from using Graviton-based instances. Sessions will cover topics such as Introduction to Graviton, programming language and focused deep dives, testing and optimization techniques, and workload deployments. Space is limited, so sign up today.

Presenters & Hosts

AWS Graviton Specialist Solution Architects

About Graviton

AWS Graviton processors are custom Arm-based processors designed by Amazon Web Services (AWS). Graviton-based instances deliver up to 20% lower cost, up to 40% better price performance, and up to 60% less energy consumption than comparable x86-based instances. With Graviton-based instances, you can:

  1. Increase and scale your application performance to enhance your customer experience
  2. Reduce your operational cost
  3. Support running workloads sustainably in the cloud


Who should attend

  • Software Engineers
  • Cloud Architects
  • DevOps Engineers
  • Platform Engineers
  • Site Reliability Engineers (SREs)

What to expect

  • Introduction to Graviton
  • Programming language & focused deep dives
  • Testing & optimization techniques
  • Workload deployments
  • Hands-on working sessions
  • Interaction with AWS Graviton SMEs
  • Light breakfast, lunch, and happy hour

Requirements

  • Participants need to supply their own laptop and power supply
  • Some coding knowledge


No prior Graviton experience is necessary


AWS DEVELOPER INNOVATION DAY

Build without limits

Wednesday, April 26

10:00 AM – 5:00 PM PT | 1:00 PM – 8:00 PM ET

About the event

Join us virtually for our newest one-day AWS event designed to help developers and teams be productive and collaborate from discovery, to delivery, to running software and building applications.
Get a first look at exciting product updates, technical deep dives, and keynotes. Discover how the breadth and depth of AWS tools and the right practices can harness your team's ability to find success and take opportunities from ideas to impact.
Learn about the latest tools and services
Hear AWS's vision for the future of developer productivity and DevOps and learn about the latest tools and services.
Master complexity through collaboration
Discover how to work more closely across your team with code-driven demos and community-led sessions.
Discover new ways to improve your software lifecycle
Get first access to exciting service announcements that help any team build world-class applications.
Innovate with industry experts
Connect with technical experts, enthusiasts, and emerging thought leaders who can help you get started.


AWS Summit ASEAN 2023

May 4, 2023 | SINGAPORE
Sands Expo & Convention Centre at Marina Bay Sands

Improving price-performance with AWS Graviton-based instances

Moving from x86-based Amazon EC2 instances to AWS Graviton Arm-based processors can save you a lot of money, with up to 40 percent better price performance. Can you simply update your AWS CloudFormation templates from c5 to c6g and reap the savings? In this session, learn about customer-proven strategies that can help you make the move to AWS Graviton confidently while minimising uncertainty and risk. Gain insights on identifying candidate workloads, performance testing, maintaining availability and flexibility, monitoring tools and release management.

Speakers:

  • Chetan Suri, Enterprise Support Lead, AWS
  • Marc Venturini, Senior Software Engineering Manager, Build Automation, Grab

Unlocking innovation from 24x7 Operations to 9x5 Innovation

A modern enterprise demands best-in-class solutions to remain secure, operational, and deliver digital-first experiences to drive growth. Modernisation is challenging, and moving from a traditional data centre to a hybrid cloud environment is a complex exercise. In this session, hear from Red Hat and AWS on how their customers overcame these complexities to build and implement a secure, robust and scalable cloud environment to match customer demands. Discover how this lead to sustainable long term cost savings, while enabling their technology teams to architect for the future by leveraging managed app platforms.

Speakers:

  • Paul Whiten, Emerging Sales Specialist, Cloud Services, Red Hat
  • Wayne Toh, Sr. Specialist SA, EC2 Graviton, AWS


From the ARM Ecosystem


Tweet of the week

twitter profile avatar
Eric Vishria
Twitter Logo
@ericvishria
April 27th 2023
2
Retweets
15
Likes

facebooklinkedin

Marcos Ortiz

I'm a Data Engineer by day at Riot Games (via X-Team ) and by night, I curate the last news/product announcements/resources about AWS Silicon (Graviton, AWS Nitro, Inferentia, and Trainium).

Read more from Marcos Ortiz
AWS Graviton Weekly # 97: How Amazon’s New CPU Fights Cybersecurity Threats?

Issue # 97: July 19, 2024 to July 26, 2024 Hey Reader. Welcome to Issue # 97 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from July 19, 2024 to July 26, 2024. Enjoy. Recommendation of the week: CAST.AI NEWS AWS Step Functions now supports Customer Managed Keys Llama 3.1 models from Meta are now available on AWS, offering more options for building generative AI applications AWS Lambda now supports Amazon MQ for...

Issue # 96: July 11, 2024 to July 19, 2024 Hey Reader. Welcome to Issue # 96 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from July 11, 2024 to July 19, 2024. Before continuing with the regular content: #hugops for CrowdStrike for the Microsoft Windows BSOD issue today. BTW, Cristian Măgherușan-Stanciu worked on some Terraform automation tool to fix this issue on AWS. He is looking for testers. Back to business now...

Issue # 95: July 5, 2024 to July 11, 2024 Hey Reader. Welcome to Issue # 95 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from July 5, 2024 to July 11, 2024. Enjoy. Recommendation of the week: CAST.AI NEWS Amazon EC2 R8g instances powered by AWS Graviton4 now generally available AWS Neuron introduces Flash Attention kernel enabling high performance and large sequence lengths Announcing availability of AWS Outposts in...