This lecture overviews Video Captioning that has many applications in video description, search and retrieval. It covers the following topics in detail: Video captioning definitions and datasets. Evaluation Metrics (SVO, BLEU, ROUGE, CIDER, METEOR, F-SCORE). Video Captioning Methods: Template-based Captioning, Joint Embedding, Encoder-Decoder Mechanisms (Attention Mechanism, Hierarchical Neural Encoder, Paragraph Description, Dense Captioning, Video Captioning by Adversarial… Continue reading Video Captioning
Archives: Resources
Resource description
Video Summarization
This lecture overviews Video Summarization that has many applications in video description, search, retrieval and browsing. It covers the following topics in detail: Video Summarization Models: a) Static video summary (storyboard), Video Captioning, Key framing extraction, b) Dynamic video summarization (skimming). Video Summarization Techniques (Video Summarization with Global and Local Features, Scene identification with global features, Keyframe… Continue reading Video Summarization
Video Streaming
This lecture overviews Video Streaming that has many applications in videoconferencing, social media and TV webcasting. It covers the following topics in detail: Video File Transfer and Progressive Video Download. Media Streaming Technology: Constant Bit Rate (CBR) encoding, Multiple Bit Rate encoding Variable Bit Rate (VBR) encoding, Average Bit Rate (ABR) encoding. Media Publishing and… Continue reading Video Streaming
Transform Video Compression
This lecture overviews Transform Video Compression that has many applications in digital TV broadcasting, videoconferencing, video streaming and social media. It covers the following topics in detail: Spatiotemporal signal redundancy in video compression. Intraframe video coding (I-frames). Interframe video coding (P-, B-frames). Transform Video Coding (Block-based video coding, Discrete Cosine Transform, DCT Coefficient Quantization, Zig-zag… Continue reading Transform Video Compression
Multiview Object Detection and Tracking
This lecture overviews Multiview Object Detection and Tracking that has many applications in video analysis and autonomous systems. It covers the following topics in detail: Multiview Human and Object Detection, Multiview Object tracking.
2D Object Detection and Tracking
This lecture overviews 2D Object Detection and Tracking that has many applications in autonomous car/drone vision (person, pedestrian, car tracking) and visual surveillance. It covers the following topics in detail: Object Detection and Forward Tracking. Object Forward-Backward Tracking.