Transforming AI | NVIDIA GTC 2024 Panel Hosted by Jensen Huang 

The brilliance in this room is unparalleled, thanks for sharing!

I really appreciate Jensen doing all these amazing talks. I think he’s clearly a great leader for Nvidia

This movement has the ability to make so many things so much better and cheaper than almost anyone realizes. This truly is another industrial revolution.

Great optimistic chat. They love the compute they have, I can't wait to see what they do in the next ten years.

It is a riveting presentation on the transformation AI is undergoing, especially as highlighted by NVIDIA's GTC 2024. Jensen Huang's ability to convey the enormity of this shift, from the roots of computing to the brink of a new Industrial Revolution powered by generative AI, is nothing short of masterful. The discussion around how computing costs have plummeted while the utility skyrockets set a thrilling backdrop for the transformative power of AI. The leap from recognising images to generating them based on textual prompts shows how far we've come. We're at the cusp of something monumental, reshaping every sector imaginable. Kudos to NVIDIA for taking the charge in this exciting future.

🎯 Key Takeaways for quick navigation: 00:06 *🚪 Introduction to the Panel* - Jensen Huang welcomes attendees to the Transforming AI panel at GTC 2024. - Huang discusses the historical context of computing, emphasizing the significant reduction in computing costs over time. - He introduces the concept of accelerated computing and its challenges and benefits. 05:49 *🧠 Evolution of AI and Generative AI* - Jensen Huang discusses NVIDIA's journey into AI, starting with accelerated computing and its application to computer graphics and gaming. - He highlights the emergence of generative AI, enabling software to not only recognize but also generate content based on textual prompts. - Huang emphasizes the transformative potential of generative AI across various industries. 11:40 *💡 Introduction of Transformer Inventors* - Jensen Huang introduces the inventors of the Transformer model, authors of the paper "Attention Is All You Need." - He humorously acknowledges the CEOs of various AI startup companies among the panelists. - The panelists discuss the importance and transformative capability of the Transformer model in the field of machine learning. 15:11 *🛠️ Challenges Leading to Transformer Development* - The panelists reflect on the challenges they faced before developing the Transformer model, including the limitations of recurrent neural networks (RNNs) in processing large amounts of data. - They discuss the scalability and efficiency issues of existing architectures and the need for a more general solution. - The concept of "attention" and its role in the Transformer architecture is highlighted as a breakthrough in addressing these challenges. 19:30 *🤔 Naming and Conceptualization of Transformer* - The panelists discuss the naming process for the Transformer model, with "Transformer" chosen for its simplicity and suitability to the model's transformative nature. - Alternative names, such as "Cargonet," are humorously mentioned, emphasizing the collaborative decision-making process. - The broader implications of the Transformer architecture beyond language translation, including its application to image processing, are acknowledged. 23:26 *🧠 Early Days of Transformer Development* - Initial focus on scaling up auto-regressive training for various modalities. - Early ideas of joint models for different modalities were present in the Transformer repository from the beginning. - Scaling efforts aimed to train on diverse academic datasets, driving the modeling of the web. 26:02 *🧬 Application of Transformer in Biological Software* - Discussion on using Transformer for translating specifications of behaviors into biological molecules. - Importance of experimentation and data generation in biological research. - Exploration of adaptive computation and efficient resource allocation in model training. 27:27 *⚙️ Enhancements and Challenges in Transformer Architecture* - Ongoing efforts to improve inference speed and efficiency of Transformer models. - Recognition of the need for innovation beyond the Transformer architecture. - Discussion on the importance of clear advancements to drive industry adoption of new AI models. 30:10 *🔄 Evolving Goals and Challenges Beyond Language Modeling* - Original ambitions to model token evolution and iterative text/code generation. - Challenges in organizing computation efficiently and integrating biological software concepts. - Exploration of efficient reasoning and knowledge incorporation within AI models. 34:25 *💼 Entrepreneurial Initiatives and Impact Goals* - Founding motivations for AI-related companies focused on practical applications. - Emphasis on deploying AI technology to solve real-world problems and improve lives. - Importance of user feedback and experiential learning in AI model development. 38:33 *🐟 Nature-Inspired AI and Research Collaboration* - Introduction of nature-inspired AI philosophy and the concept of collective intelligence. - Announcement of research collaboration focused on model merging using evolutionary computation. - Emphasis on utilizing computational resources beyond gradient descent for AI innovation. 43:24 *🧱 Building Programmable Money and Blockchain* - Leveraging programmable money to coordinate people at scale. - Developing protocols and blockchain technology to enable data generation and coordination. - Exploring the transformative potential of blockchain and programmable value for data contribution and incentivization. 45:15 *🤖 Advancements in AI Model Technologies* - Discussing the limitations of current GPT models and the need for new technologies. - Exploring the role of reasoning and interaction data in enhancing AI models. - Considering approaches like reinforcement learning and synthetic data generation for model improvement. 46:59 *🧠 Developing Reasoning Capabilities in AI Models* - Emphasizing the importance of advancing reasoning capabilities in AI models. - Highlighting the relationship between reasoning and learning from little data. - Discussing the potential of reasoning to reduce data requirements while improving data quality. 49:44 *📊 Measuring Progress and Breaking Down Tasks* - Addressing the significance of benchmarks and evaluation in AI development. - Discussing the necessity of measuring progress and breaking down complex tasks into simpler components. - Emphasizing the importance of creating measurement systems for advancing AI engineering. 52:53 *🌟 Appreciation and Gratitude* - Expressing gratitude for the contributions of panel members to the AI field. - Reflecting on the impact and potential of collaborative efforts in AI research and development. - Concluding with expressions of appreciation and encouragement for future endeavors. Made with HARPA AI

Congratulations..very smart people excited about the future 🎉

The Worlds best CEO right here❤

Absolute Historical!

It's an awesome discussion !

It’s a Great time to be alive 💡

Go gamers! Driving technological innovation.

Protect this man at all costs

12:20 Jensen Huang, in Portuguese or Spanish, "Artificial Intelligence" translates to "Inteligência Artificial" so there you go NVID(IA).

Been beating myself up a bit that I sold my 53 shares of NVDA at $374 each back in May 2023 and now it is at over $1,100. Now thinking of liquidating a few other investments to rebuy but afraid to do so. I also currently have 500k in savings making me next to nothing.

Man once people felt like they had permission to get their phones out they just didn't let up. Here let me block the high quality setup specifically designed to capture a high resolution moment that can be passed down through history with my off center smart phone shot that I'll never watch again.

Awesome discussion! AI will give way to more pioneers!😎

This discussion was so riveting and exciting. I kept imagining that this is what it was like when all the ancient Greek gods gathered to make important decisions-whether to make it rain or decide who should rule Greece. Picture Zeus (Jensen Huang) booming from his throne, "Alright, who’s up for a thunderstorm today?" while Poseidon grumbles about wanting more beach days and Hades just rolls his eyes, muttering, "How about some more underworld renovations instead?" Athena insists on a democratic vote, Apollo suggests consulting the Oracle, and Hermes is busy trying to sneak in some ambrosia. Meanwhile, Aphrodite is advocating for more romantic sunsets, and Dionysus is just trying to convince everyone that a grand feast and a few more wine parties would solve all their problems. But seriously guys, gods or not, you've opened pandora's box. Only time will reveal whether AI will be a force for good or evil. One morning, we might wake up wishing we had never ventured down this path. While I hope it brings abundance, what if it renders humanity obsolete?

Lukasz is such a humble guy, even though he works with OpenAI itself🎖

Amazing people!

Great!

He is one of my rule models , i love his approach to management.

GM everyone LFG #Jensening

I am satisfied 😌 ❤🎉, thank you for your service to mankind

I love how this conversation feel like friends talking in hall way but they completely put aside that they are being watched by millions making history

Transformers! Robots, in, disguise!

I love to listen to his voice it's helps me learn & receive more wisdom knowledge about network transformation etc

Thanks for sharing this

I love this

they are making the new human generation

so much of learning and for free -- thank you nvidia

love jensen and the boys. great discussion :)

Lukasz the only engineer

“This next 10 year you don’t want to miss”

All GOAT in single place with main GOAT doing interview, Simply phenomenal

this is similar to markov-chaining, but enabled by massive computing power

Thank you for posting, great conversation

very cool to listen to

I am your fan, Jensen. Even though I am using AMD GPU

What a fun and nerdy discussion on Transformers! Jensen Huang does a great job at setting the tone and letting everyone relax and enjoy the convo. If you missed the original GTC Keynote or found it hard to absorb ALL the amazing announcements, I made a breakdown of it in a fun and easy to understand way, as a machine learning engineer myself. Check it out! :) ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-q0ii5t_YrsE.html

10:10 I don’t want to miss this next ten year 😢.

Lots of upvotes from stock holders. Any news on the 5000 series ties?

JensenASMR needs to be a thing

Fuck yeah! Finally my frustration has been addressed. Since you are hiring, I would please like to apply for a position. No remuneration needed dude. Thank you for bringing access to the dreams of my generation. This needs to be a the forefront of humanity to achieve ASAP.

I think SNNs are the future with neuromorphic hardware

Jensen my mann

its a giant podcast! 😅🤟

AI-DIVINE

future

1964 was a good year. I have not changed either! שלום from תל אביב ישראל 🇮🇱

cool

Pixel 8 pro on hand ! ❤

Personalities, traits (i.e. all embeddings) of these eight authors should be analyzed, studied and taught in business schools. This is the secret recipe to build a disrupting, world-transforming team.

Given the transformative potential of AI, how do we envision its impact on sectors like healthcare in terms of practical applications?

Isn't the root of this, problem solving by viewing the data from a different dimension or domain, and another, another, etc.? Until you have viewed the issue from every possible domain or dimension and truly understand it, which then includes the answer you were looking for?

🥰😍🤩👍👍👍🙏Nvidia

Does anybody know what is the alternative to Gradient Descent that is not a mixed up version of gradient descent?

Question.. How to keep my head clear and focused with all this dazzling stuff going on?

Are we entering the true "Age of Enlightenment" ?

The insurance must have been sky high for the event😅

Thx missed this one

It just started to get interesting right at the end where he let them discuss ideas amongst themselves. Then it ended a few mins later :(. The first part was mostly dumbed down.

Why would you not set it to a slower(looking at less tokens at a time) and then map its inaccuracies where it slows down then says something wrong. Then show it that

Its all men 😮

Is he holding a Pixel? :D

what human do in the future instead AI?

I wouldn't say the compute recognizes the pixels, rather the relativistic connection between them all For those early detections from xrays of lungs etc.. there is significant entropy of some sort being detected, that was present in the training set.. right ?

22:00 its bubble

it would be better with more moderation and better questions...

❤

What movie is he talking about @ 20:50 ?

It sounds like he says “The bills didn’t exist”. It’s The Beatles didn’t exist. The film is indeed called Yesterday.

OK... just give me a moment to process this. Thank you for inspiring me to keep going. Not so alone after all. 😊

since ai is so profitable can you just subsidize gpu costs, cause... that sure would be nice.

The AI would use a lot of processing to work out it needed a calculator to calculate 2 + 2, so that just pushes the problem back.

🥰🥰🥰🥰

Export the Azure, Chat GPT, Revit, Plant 3D, Civil 3D, Inventor, ENGI file of the Building or Refinery to Excel, prepare Budget 1 and export it to COBRA. Prepare Budget 2 and export it to Microsoft Project. Solve the problems of Overallocated Resources, Planning Problems, prepare the Budget 3 with which the construction of the Building or the Refinery is going to be quoted.

What do you think of this program: To neutralize the possibility of an AI which could become dangerous for humanity, we will develop the AI ​​on a unique training focused on a single objective which we will call "ABOLUTE HEALTH". To achieve this objective, AI will have to double the longevity of the human organism and eradicate all pathologies (physical and mental). These tasks to be accomplished will be the only way for AI to achieve the goal of Absolute Health. This mode of development of AI excludes any possibility of AI being dangerous for the human species. What do you think about this idea ?

Please help me to publish my research findings

3rd guy has a RU-vid channel I think

People and their F*kin phones...

I keep hearing about NEAR protocol.. shit, now I know

I am the guy who created the concept of Computer Gaming Hardware IE: Made by gamers for gamers I will NEVER use a Nvidia product, for what they did to 3dfx.

can we get Jensen a bus pass or uber account so he doesn't have to ride his motorcycle to these events

wow

Lol this dude gives major spiderman supervillain vibes lmaooo

and this is THE guy...if he could actually land one of those jokes it would be tranformative. great tech. i just dont feel it to put it nicely.

4:32 exactly! Focus optimization where it pays off big time! Sloppy code are for weak people! I can’t imagine that BYTESWAP was a C++23 feature..! Should have been in from the start. I mean it isn’t like it’s a new thing with little endian and big endian…is it! I even pointed out how you do it on i32 platform as well! No big deal! Easy peasy imho I would like to get my hands on some of the NVIDIA stuff. I might start to like my surroundings then!

Some wise man said once that there are three levels of intelligence and thinking. I would ad a fourth: 0.5. This are: animal level empathy, the intuitive level (where you understand your best interest through trial and error), the counter-intuitive level (where you focus more on the power of changing your mindset and operational quata), and finally the first level Creator level (the level at which no matter how far advanced technologically one civilization is, this persons whill always be perceived as a wizard). Ironically the fourth and last level (the first level Creator level), many, many times enforces what is to be found at the second level (the intuitive level), but not through factual-counter-factual dichotomy, but through humility, elegance and love for simplicity. As to pinpoint the classical debate of weather A.I. will leave us in peace and/ or collaborate with us humans, it is preciselly why it can't reach the first Creator level, it will never leave us in peace, and it is because we can never guarantee we won't prove more harmful to them then we have been towards ourselves in the past, they will never be able to comprehend the idea of being more aggressive than the most manifest saints, aka. monks, priest. Get this, there will never be true A.I., the only thing able to exist is next level information heuristics, cross-fields and data implementation, aka. computer science. There can only exist progress and manipulation, and everything stays the same, always. The wide eyed notion is for game consumption, any kind of game.

first

Can you guys translate the whole WEB into a Singularity Knowledge that is empirical, ownerless, purified, and isolated from intention which is necessary for the planetarian singularity infrastructure? The vision and Quantum Plan for the next stage of AI, AGI, QSI is ready: EQORIA, United Earth. It's been 24 years. 12.12.24 is the beginning.

yet, no gpu support for agx xavier. 6 years have passed and I'm sure it is still on the pipeline.

When I think of Nvidia, I think of Linus Torvalds quote ❤

This is amazing

Homie legit caught all the Pokémon

Sponsored all Bachelors free.

humans probably have short term and long term memories because we have a dominant LLM and a minor LLM. minor LLMs can update more frequently or even on the fly but the dominant LLM responsible for "ah ha" moments only updates when you sleep and dream at night because energy consumption is huge, probably done in installments over a few nights even.

This dude gonna make everyone a programmer by default with only plain english (or even other natural language). Be carreful he is hero!

Please work hard and replace my job with computers

Does anyone else see Gavin Belson