The first thing that comes to my mind when thinking of how machine learning can support and expand our creative practices is its ability to be personalized and adapted. Using pre-existing trained models are developing your own enable us to create different projects unique to our styles, needs, and/or goals. Machine learning models can automate repetitive tasks, for example, its ability to improve companies’ operational efficiency due to predictive analysts. Machine learning tools can also be utilized by people who don’t have advanced knowledge in coding or ML in general. Creative tools that use ML can allow artist, designers, etc to produce projects without the daunting technicality of it.
Rebecca Fiebrink emphasizes that “people aren’t just changing data sets to fix mistakes,” which I thought was an interesting point. The idea that we are in conversation with the technology we use. Not only can ML make our tasks more efficient, but it can also help us generate more ideas by showing us what works, what fails, and what else is possible the more we experiment with it.
The Neural Doodle example was amazing, and while I see many benefits of using ML, especially in how inclusive it can be, certain types of art can start to feel repetitive if artists don’t find ways to make it their own. More people can become creative with ML so yay!!
Goal: Create a new project that uses either poseNet or handPose to make a baking game. Users can move around baking ingredients on the screen using hand gestures, detected through the camera.
Not sure if I can do this but was going to ask in office hours: Users can pick up and move baking ingredients by pinching their fingers together, then dropping them by releasing the pinch. Attach an ingredient image to the user's hand when a pinch is detected, and allow movement across the screen until the pinch is released. Drop the object when the pinch is released. Optionally, enable stacking or combining ingredients to simulate baking.
Other features: Load in hand drawn images of different ingredients, and the goal is to add all the appropriate ingredients into a bowl to bake a cake or something. All ingredients that are not baking ingredients will make the bowl turn into a trashcan?
Extra if I can even make this work: Add sound to make more immersive!
https://editor.p5js.org/icm/sketches/BkRHbimhm
https://editor.p5js.org/pattvira/sketches/f3nZuIPZi
Maybe include a “mix” button and that detects whether or not a cake or trashcan appears…