Exact Instructions Challenge - THIS is why my kids hate me. | Josh Darnit

As a ML researcher and a degree holding physicist, I'm really hesitant to use the words "understanding" and "describing" (much less hesitant) around these models. I don't find the language helpful and think it's mostly hateful tbh. The reason we use math in physics is because of its specificity. The same reason coding is so hard [0,1]. I think people aren't giving themselves enough credit here for how much they (you) understand about things. It is the nuances that really matter. There's so much detail here and we often forget how important they are because it is just normal to us. It's like forgetting about the ground you walk upon. I think something everyone should read about is Asimov's "Relativity of Wrong"[2]. This is what we want to see in these systems if we want to start claiming they understand things. We want to see them to deduction and abduction. To be able to refine concepts and ideas. To be able to discover things that are more than just a combination of things they've ingested. What's really difficult here is that we train these things on all human knowledge and just reciting back that knowledge doesn't demonstrate intelligence. It's very unlikely that they losslessly compress that knowledge into these model sizes, but without very deep investigation into that data and probing at this knowledge it is very hard to understand what it knows and what it memorizes. Really, this is a very poor way to go about trying to make intelligence[3], or at least making intellig

Reminds me of the "Exact Instructions Challenge" videos where kids write instructions for some everyday task - like making a PB&J sandwich - and parents, hilariously, follow the instructions verbatim. ▶ this video

Sounds like it could devolve similarly to what's being done here: ▶ this video I sometimes try with my children. Having one on my shoulder and pulling either the left or the right ear to tell me where to go. The way home from kindergarten can then take a while, depending on how attentive they are. Of course, parent stumbling into hedges makes for a good laugh, so that may also sometimes be intentional.

Whenever I read/hear about project/software requirements that need to be followed exactly, I think about the funny “exact instructions” video :-) ▶ this video

Obligatory PB & Jelly Exact Instructions Challenge video: ▶ this video The answer is: it runs on dad, poorly :)

"Monkey Paw Development" was a new one for me :) Thank you! Great analogy. Reminds me of this :D ▶ this video

1. Tell them what to do but do not tell them how to do it. (Just give a few pointers otherwise they'll be lost.) 2. Give them a playground to fail - Offload any non-business critical tasks and let them make mistakes. No one I know ever learnt programming without making any mistakes. Immediately tell them about best practices and how to avoid such mistakes in future. 3. Show them the impact of their work - There's nothing more motivating than seeing the impact of one's work. 4. Build curiosity - Answer as many questions as you can answer. Admit when you don't know any answers and start looking it up on the web right in front of them. People pick habits by looking at their superiors. If it's absolute beginning to programming, this video is a great way to show how difficult it is to teach a machine to do something and how clear instructions can help get things done: ▶ this video

I've seen this video a while ago, where a father does this with his kids: ▶ this video Lots of frustration about the stupid robot and I guess your school kids weren't much different.

Have you seen the exact instruction challenge on youtube? I thought it was a great segue into technical thinking for young kids. ▶ this video