“Live” Visuals / Lesson 1 / Input To Output
Lesson Overview
In this lesson we will explore the three most basic parts of our VJ toolkit – inputs, filters and outputs.
The inputs, or sources, are the materials that contain the content of our work, whether they be pre-rendered files, live feeds or real-time computer generated visuals.
This imagery is then processed by “filters” also commonly known as effects or FX, which modify the stream of pictures to change the aesthetics and overall feeling associated with them.
Finally the result is sent to a place where it can be viewed, output to a screen, projector, a movie file on a hard drive or streamed to the Internet.
One of the most powerful aspects of working with “live” video is the ability to experiment with the addition of live-camera feeds into your project. Consider how the live presence of your face/body influences the meaning of your imagery. You are now part of the subject matter, so consider your relationship to the pre-existing forms.
Lecture Videos
- Introduction to live visuals: History and basic concepts
(Input to Output Lecture Video)
- Introduction to making live visuals: Using VDMX
(Input to Output Demonstration Video)
Lecture Notes
(Input to Output Lecture Slides)
Reference Links
Artists / Videos:
Setup Guides:
- Recommended video codecs for VDMX
- Converting media files to HAP
- Video codec usage comparisons and benchmarks
- Guide to Projectors for Interactive Installations
- Guide to Cameras for Interactive Installations
Further Reading:
Downloads
Sample Media:
- Sample Media files: Movie files for this lesson.
- VDMX Sample Media files: More free sample movies.
Utility Apps:
- The AVF Batch Exporter: Batch converter.
- Project Milk Syphon: Free audio visualizer tool.
Related Tutorials and Case Studies
- Video Fundamentals: Media Types
- Using the Simple Player template
- Video Input Basics
- Recording movies in VDMX
- Recording movies from cameras in VDMX
- Fullscreen output
- Recording movies for upload
- Using an iOS Device as a Live Camera Source in VDMX
- Creating video feedback loops in VDMX
- Using Lumen and VDMX together with Syphon with guest Wiley Wiggins
- DMX Controlled Shobaleader One Face Masks
Homework
Assignments
- Record 5 clips using a live web-cam with different sets of FX applied.
- Connect to an external display (such as a projector, TV or monitor) using an HDMI, DVI, VGA or similar connection.
Review Questions and Further Discussion
- What are visuals?
A historical context:
- Light projections
- Theater
- Film
- Video
- What is video? What is a video signal?
- How is video different from film?
- Analog (eg NTSC, PAL) vs Digital
- How is video transmitted and stored?
- Types of cables (RCA, BNC, HDMI)
- Physical media (VHS, DVD, BluRay, film)
- Digital files (.mov, .mkv, .avi)
- What is a media codec?
- How do image / video codecs work?
- What image / video codecs are commonly used today?
- What is video videoinstrumentalism?
- Inputs / Sources:
- Pre-rendered files
- Interactive generators
- Live feeds
- FX and Composition:
- Adding filters between input and output
- Adding layers
- Adjusting layer opacity and blend modes
- Outputs:
- Fullscreen output
- Recording movies
- Capture to h.264 for uploads to YouTube, Vimeo
- Capture to PhotoJPEG / HAP for live remixing
- Capture to ProRes for usage in NLE (Final Cut, Avid, Resolve, etc) or archival purposes
- Perspective correction
- Using projectors / displays
- System Settings: Displays
- Color calibration