Andrej Karpathy and Software 2.0 | Chris Lattner and Lex Fridman 

Next Guest Andrej Karpathy :)

The idea with the feedback loop of the assertions into the model made my day!

Fantastic indepth conversation! Thank you

when you are going to sit with Geoffrey Hinton , Fei-Fei Li , Andrej Karpathy and Christopher Manning

I wish I could have friends as smart as these guys and chat about questions like these. Oh well, at least I have the privelege of listening to them.

very interesting!!!!

This guy Chris is extremely intelligent. I absolutely love the way he cuts to the core of a challenge and articulates it so succinctly. I could listen to him speak all day. The NLP demos today using GPT3 to generate code are definitely fill in the blanks type solutions and don't impress me. They use predefined scaffolding using pattern matching against a corpus of code snippets. When the scaffolding itself is machine generated that will be a quantum leap. Assertions are the requirements and having them expressed in natural language is great, but language is full of ambiguity. The ability for AI to identify and resolve any ambiguities by asking follow up questions would be an amazing accomplishment.

I really enjoyed the snippets out of this interview. I've always thought of programming as expressing ideas very precisely, generally once you can describe a solution without ambiguity you are half way finished programming it. And programming languages help you do this by constraining the things you can and cannot say. With GPT3 the question is as what point of complexity does a problem get more difficult to express unambiguously and concisely in natural language than in a programming language? For example, instead of the red button, think of a simple arithmetic calculator app. I don't use html very much but I would think you could do that in ~30 lines without any ui or math libraries. Even with GPT100 and perfect natural language processing, could you describe that layout and functionality, again without special functions/libraries being available, as concisely?

8:14 When I watched this the first time I never thought we could just chat with it.

The caption is totally off.

From “go tos” -> “if then else”

Code reuse....lol, yeah welcome to my world. Much easier than reinventing the wheel!

Could you have a discussion about Spacex and Tesla AI. How do they compare in solving landing rockets and driving cars? The complication seem different, but both are solving 4D problems or are.they?

Hey Lex, why don't you bring Andrej Karpathy to your pod? That would be a worthy-to-watch interview.

Haha. For a long time I’ve also thought that humans pattern match and the logical reasoning side is simply to reverse justify the decision to ourselves. It’s quite a cool trick that we think our decisions were based on logic though.

wonder how much they knew about co-pilot during this conversation

One stream of multiple queries takes you to algorithmic objects on streams and can run the function inside itself and all can be self edited also it can finish with a complex array output. I call it the dynaveo function Multi tied bitwise multi bit piecewise functionality as instructions on a chip could help the neural net AI test upto polynomial time compute space efficiently. Only some military AI has verified what I'm saying so far no people as far as I know have. It is technically an abstraction function for Software 2.0 to get it's MIT's into. I'm hoping a lot of people are very wrong and with the right functionality AI can take us to a mathematician's Christmas/solstice every day. One task I would try Software 2.0 on would be in trying to find fast algorithms to accurately generate faster any of the hard to generate integer sequences on the OEIS.

Next Guest: Edward Snowden 👈

It seems like this guy hasn't seen the GPT-3 demos at all.

Perhaps Chris knows too much of existing programming paradigms, that he find impossible to step out of what he and many of his colleagues have developed in the last half century. GPT could very well be the beginning of a revolution.

Is nobody interested in the demo that Lex has mentioned? Can you share any of those demos where you type in this kind of commands what you want in html and the program gives you source code? For me this idea is mind-boggling and I can not really believe that technology like this was presented anywhere

It seems the argument against 2.0 comes from a place of fear, rather than rational, which I can understand. Sure, the simple stuff could be programmed in 1.0, however, the 2.0 and GTP-x will make 1.0 obsolete at some point, just a matter of time im(uneducated)o.

So you interview all the "Trevor Milton"s guys who think they are smarter than Elon hahaha !

I usually can't stand Lex Fridman's interviews, but my love for Chris outweighs my dislike for Lex. Excellent communicator and very knowledgeable.