Video Object Tracking
In this project, you will build a basic object tracking system that detects moving objects in a video by identifying changes between consecutive frames. This involves extracting frames from a video, analyzing pixel differences to detect movement, and visualizing these changes with color overlays. Finally, the modified frames will be recombined into a video. This project introduces you to foundational concepts in computer vision and video processing, with a focus on detecting and highlighting moving objects.
Implementation Guidelines
- Running the Program:
- You may use FFmpeg to split the input video into individual frames (images), by using the
Process Builderand save the frames in a format that preserves image quality (e.g., PNG). - For each frame (starting from the second frame), calculate the pixel-by-pixel difference with the previous frame.
- Identify pixels that have changed significantly (e.g., based on a threshold for intensity difference).
- For pixels that changed, apply a color overlay with transparency (alpha) to highlight areas of movement.
- Each section of changed pixels (contiguous moving areas) should be colored uniquely.
- Track and color each moving section consistently across frames if possible.
- After processing all frames combine them back into a video format.
- You may use FFmpeg to split the input video into individual frames (images), by using the
Testing
- Experiment with different change threshold values to observe how sensitivity affects detection.
- Test the program on videos with varying frame rates and resolutions.
- Record the processing time for splitting, analyzing, and reassembling the video.