REQ: Kadenze Machine Learning for Musicians and Artists (Goldsmith University, 20 Courses in Exclusive Premium Access)
Have you ever wanted to build a new musical instrument that responded to your gestures by making sound? Or create live visuals to accompany a dancer? Or create an interactive art installation that reacts to the movements or actions of an audience? If so, take this course!
In this course, students will learn fundamental machine learning techniques that can be used to make sense of human gesture, musical audio, and other real-time data. The focus will be on learning about algorithms, software tools, and best practices that can be immediately employed in creating new real-time systems in the arts.
Specific topics of discussion include:
• What is machine learning?
• Common types of machine learning for making sense of human actions and sensor data, with a focus on classification, regression, and segmentation
• The “machine learning pipeline”: understanding how signals, features, algorithms, and models fit together, and how to select and configure each part of this pipeline to get good analysis results
• Off-the-shelf tools for machine learning (e.g., Wekinator, Weka, GestureFollower)
• Feature extraction and analysis techniques that are well-suited for music, dance, gaming, and visual art, especially for human motion analysis and audio analysis
• How to connect your machine learning tools to common digital arts tools such as Max/MSP, PD, ChucK, Processing, Unity 3D, SuperCollider, OpenFrameworks
• Introduction to cheap & easy sensing technologies that can be used as inputs to machine learning systems (e.g., Kinect, computer vision, hardware sensors, gaming controllers)
Session 1: Introduction (March 2, 2021)
- Connecting inputs and outputs using Open Sound Control (Premium Exclusive)
Session 2: Classification, Part I (March 9, 2021)
Session 3: Regression (March 16, 2021)
- Training as optimization: Linear and polynomial regression (Premium Exclusive)
Session 4: Classification, Part II; Design Considerations (March 23, 2021)
- Evaluating classifiers (Premium Exclusive)
- Using a probability distribution over classes (Premium Exclusive)
- Using more than one classifier at once (Premium Exclusive)
Session 5: Sensors And Features: Generating Useful Inputs For Machine Learning (March 30, 2021)
- Audio-driven instrument building; using average and standard deviation (Premium Exclusive)
- Video features (Premium Exclusive)
- Features: How fast to send them? (Premium Exclusive)
Session 6: Working With Time (April 6, 2021)
- Dynamic Time Warping for music and speech analysis (Premium Exclusive)
- Dynamic Time Warping in Wekinator: Practical tips (Premium Exclusive)
Session 7: Developing A Machine Learning Practice; Wrap-Up (April 13, 2021)
- The instrument: Advanced techniques (Premium Exclusive)
- The Instrument: Evolution (Premium Exclusive)
- Performance with Bird (Premium Exclusive)
- Guest lecture - Conclusion (Premium Exclusive)
In this course, students will learn fundamental machine learning techniques that can be used to make sense of human gesture, musical audio, and other real-time data. The focus will be on learning about algorithms, software tools, and best practices that can be immediately employed in creating new real-time systems in the arts.
Specific topics of discussion include:
• What is machine learning?
• Common types of machine learning for making sense of human actions and sensor data, with a focus on classification, regression, and segmentation
• The “machine learning pipeline”: understanding how signals, features, algorithms, and models fit together, and how to select and configure each part of this pipeline to get good analysis results
• Off-the-shelf tools for machine learning (e.g., Wekinator, Weka, GestureFollower)
• Feature extraction and analysis techniques that are well-suited for music, dance, gaming, and visual art, especially for human motion analysis and audio analysis
• How to connect your machine learning tools to common digital arts tools such as Max/MSP, PD, ChucK, Processing, Unity 3D, SuperCollider, OpenFrameworks
• Introduction to cheap & easy sensing technologies that can be used as inputs to machine learning systems (e.g., Kinect, computer vision, hardware sensors, gaming controllers)
Session 1: Introduction (March 2, 2021)
- Connecting inputs and outputs using Open Sound Control (Premium Exclusive)
Session 2: Classification, Part I (March 9, 2021)
Session 3: Regression (March 16, 2021)
- Training as optimization: Linear and polynomial regression (Premium Exclusive)
Session 4: Classification, Part II; Design Considerations (March 23, 2021)
- Evaluating classifiers (Premium Exclusive)
- Using a probability distribution over classes (Premium Exclusive)
- Using more than one classifier at once (Premium Exclusive)
Session 5: Sensors And Features: Generating Useful Inputs For Machine Learning (March 30, 2021)
- Audio-driven instrument building; using average and standard deviation (Premium Exclusive)
- Video features (Premium Exclusive)
- Features: How fast to send them? (Premium Exclusive)
Session 6: Working With Time (April 6, 2021)
- Dynamic Time Warping for music and speech analysis (Premium Exclusive)
- Dynamic Time Warping in Wekinator: Practical tips (Premium Exclusive)
Session 7: Developing A Machine Learning Practice; Wrap-Up (April 13, 2021)
- The instrument: Advanced techniques (Premium Exclusive)
- The Instrument: Evolution (Premium Exclusive)
- Performance with Bird (Premium Exclusive)
- Guest lecture - Conclusion (Premium Exclusive)