• AI Tangle
  • Posts
  • ☕️ Nvidia Takes Center Stage

☕️ Nvidia Takes Center Stage

Nvidia seems hellbent on taking the spotlight this week in AI with its GTC 2024 conference, showing off a terrifying enterprise AI chip dubbed Blackwell, its new NIM microservice platform, and Project GR00T for humanoid robotics. Though as bright as Nvidia is, there's more happening elsewhere, with xAI and Elon Musk making Grok open source and Apple looking into powering its iPhones with Google's AI tech. Join us at AI Tangle as we untangle this week's happenings in the world of AI.

​​​​​​THE BIG AI STORY​​

On Monday at GTC 2024 in San Jose, California, the leather-jacket-loving CEO of Nvidia, Jensen Huang, showed off at the conference's keynote its brand-new platform nicknamed Blackwell - And Nvidia isn't playing around. Emphasizing how the core of the processor at the heart of Blackwell was "pushing the limits of physics how big a chip could be," Huang was holding $10 billion in his hand in the form of a Blackwell prototype, and it wouldn't be long until the rest of the world got it for cheaper.

How special is it?

The Blackwell B200 GPU boasts a whopping 8 TB/s of memory bandwidth, 192 GB of HBM3E memory, and 208 billion transistors, more than double compared to its predecessor, the Hopper H100, with 80 billion transistors. What's more impressive, though, is the GB200 Grace Blackwell Superchip, which Nvidia describes as a game-changing innovation in AI computing, combining 2 Blackwell B200s and a Grace CPU with unparalleled energy efficiency, purpose-built for handling AI workloads.

​​​​​​COLLABORATING WITH RYSE​​​

Via RYSE

Invest in the next AI innovation to make smart homes even smarter

️Big Tech acquired startups in the smart doorbell and thermostat categories for billions. If you missed out on these spectacular early investments in the Smart Home space, here’s your chance to grab ahold of the next one.

RYSE is the tech firm that’s poised to dominate the Smart Shades market (growing at an astonishing 55% annually), and their public $1.50/share offering is opening for a limited time.

  • With over $8M in sales to date, they’ve just hit a critical milestone - Best Buy has stocked their product in over 100 physical stores!

  • Thanks to AI, sensors, and weather data, their tech can yield huge savings on energy - up to 24% on heating and 74% on lighting costs!

Their exclusive deal with Best Buy resembles that which led to Ring and Nest’s billion-dollar acquisitions at the hands of Amazon and Google, respectively.

Early investors have seen their shares grow by over 20 times, and you can still become a shareholder before their name becomes known nationwide.

6 QUICK HITS

xAI open sources Grok amidst Elon Musk's lawsuit with OpenAI

After promising to ​make Grok open source just a week prior​ amidst its lawsuit with OpenAI, Elon Musk and xAI have done just that, with Grok becoming the world's largest open-source model, ​now available on GitHub​ for researchers and developers to build on the model and even use it for commercial, as indicated by its Apache 2.0 license. An ​xAI blog post​ specifies that the version of Grok being open-sourced is Grok-1, a Mixture-of-Experts model with 314 billion parameters and a last pre-training checkpoint of October 2023.

Once again, at the company's GTC 2024 conference, Nvidia announced NIM, a new software platform designed to make deploying custom and pre-trained AI models into production environments smoother and standardized. NIM already supports a long list of models from a variety of companies: Google, Hugging Face, Meta, Microsoft, Mistral AI, Stability AI, and, of course, itself, with the company already in talks with Microsoft, Amazon, and Google to bring the NIM microservices to Azure AI, SageMaker and Kubernetes Engine, respectively.

Qualcomm, an American semiconductor and software company and bigshot in the mobile market, just launched the Snapdragon 8S Gen 3 chipset, one to bridge the gap between flagship features and affordable smartphones. The Snapdragon 8S Gen 3 comes with on-device support for AI to take mid-range phones to greater heights, with many names such as Redmi, Xiaomi, Honor, and iQOO all saying that they would have new devices built on Qualcomm's brand new platform "in the coming months."

Apple, the tech giant that's slowly been ramping up development in AI, is ​reportedly in talks with Google​ to get Gemini to power some of the iPhone's features, much to the surprise of many, eyeing a Google AI license to introduce AI features in its upcoming iOS updates later this year. Despite finally accelerating development in the AI field, Apple is behind other competitors such as Microsoft, Google, and OpenAI, and outsourcing AI tech for its iPhone could hint that the company hasn't been all too successful with its endeavors just yet.

The poster child of AI chips, Nvidia, has recently shown interest in robotics with the announcement of Project GR00T, a new platform that will serve as "a general-purpose foundation model for humanoid robots," along with almost every humanoid robot maker on board except Tesla. The showcase also featured two more key programs: Isaac Manipulator and Isaac Perceptor, with the company writing that "Isaac Manipulator offers state-of-the-art dexterity and modular AI capabilities for robotic arms, with a robust collection of foundation models and GPU accelerated libraries."

Generative AI healthcare startup Hippocratic AI recently announced a successful round of Series A funding, bagging $53 million at a valuation of $500 million, with venture firms such as General Catalyst and Premji Invest leading at the front. The startup also announced a partnership with Nvidia with plans to leverage the AI giant's hardware to make super-low-latency conversational interactions between its AI agents and patients to improve engagement and make for a more authentic experience.

4 AI TOOLS

Magnific - Achieve new heights in resolution and detail with Magnific, an AI-based image editor capable of high-res upscaling, enhancing, and style transfers.

Airtrain - Airtrain is the no-code compute platform for large language models, allowing you to scale beyond proprietary AI and fine-tune open-source models on your data.

Slite - Experience the magic of turning any document into the most reader-friendly text with Slite, an AI-powered document formatting tool to help you go from written to read.

Canvas AI - Canvas AI is an AI tool that generates customized strategic canvases, such as business models and customer interviews based on existing data, making it easy for users to co-create and visualize strategic insights.

AI READ & WATCH

AI & The Crypto Blockchain (9-min read)

Take a deep dive into how AI could be used in blockchain technology, combining the hottest trend in tech with the promising future of secure cryptocurrency.

Grok Unleashed (10-min watch)

The cat's out of the bag as Elon Musk and xAI make Grok open source as promised. Now, Wes Roth, an American YouTube channel focused on emerging AI & tech news, takes a good look at what Grok is made of.