Manage episode 268855098 series 2772590
The results from machine learning have been getting better and better and the results seen so far from OpenAI's GPT-3 model look stunningly good. But unlike GPT-2 (which was publicly released under a free license), so far GPT-3 is accessible via API-only. What's the reasoning and possible impact of that decision? For that matter, what kind of impacts could machine learning advancements make on FOSS, programming in general, art production, and civic society?
- Auto-generation of legalese and auto-web-design GPT-3 demos
- GPT-3's API and FAQ page
- Tensorflow and PyTorch
- (Artificial) neural networks and machine learning
- Google's Deepmind and Agent57 (be sure to watch the Agent57 videos, they're's impressive)
- Mozilla's Common Voice project
- Bayesian spam filters; see also Paul Graham's highly influential a plan for spam writeup
- Markov chains (we miss you, X11R5...)
- The Postmodernist Essay Generator
- Neural networks' difficulties in explaining "why they did that" and an overview of attempts to make things better: An Overview of Interpretability of Machine Learning
- Chris had a conversation with Gerald Sussman about AI that was related to the above and influential on them. "If an AI driven car drives off the side of the road, I want to know why it did that. I could take the software developer to court, but I would much rather take the AI to court."
- The Propagator Model (by Alexey Radul and Gerald Jay Sussman, largely): Revised Report on the Propagator Model. See also: We Really Don't Know How to Compute!
- Three Panel Soul's Recursion comic (cut from this episode, but we also originally mentioned their Techics comic which is definitely relevant though)
- Surrealism, Abstract Expressionism, Impressionism, and the Realism movement (Obviously there's also a lot more to say about these art movements than just lumping them as a reaction to photography but... only so much time on an episode.)
- AI Dungeon 2 (nonfree, though you can play it in your browser)
- Episode of Ludology about procedural narrative generation
- Implicit Bias and the Teaching of Writing
Machine learning's tendency to inherit biases
- Rise of the racist robots -- how AI is learning all our worst impulses
- Machine bias (and its use in deciding court cases)
- Google's Vision AI producing racist results
- When It Comes to Gorillas, Google Photos Remains Blind (Content warning: this is due to an extremely harmful form of synthesized racism from the biases in the datasets Google has used)
- Predictive policing algorithms are racist. They need to be dismantled.
- Discovering Reinforcement Learning Algorithms and the subdiscipline of Learning to Learn
- Hayo Miazaki's criticism of an AI demonstration not considering its impact