Librería Portfolio

Reviews the new High Efficiency Video Coding (HEVC) standard and advancements in adaptive streaming technologies for use in broadband networks and the Internet

This book describes next-generation video coding and streaming technologies with a comparative assessment of the strengths and weaknesses. Specific emphasis is placed on the H.265/HEVC video coding standard and adaptive bit rate video streaming. In addition to evaluating the impact of different types of video content and powerful feature sets on HEVC coding efficiency, the text provides an in-depth study on the practical performance of popular adaptive streaming platforms and useful tips for streaming optimization. Readers will learn of new over-the-top (OTT) online TV advancements, the direction of the broadband telecommunications industry, and the latest developments that will help keep implementation costs down and maximize return on infrastructure investment.


Reviews the emerging High Efficiency Video Coding (HEVC) standard and compares its coding performance with the MPEG-4 Advanced Video Coding (AVC) and MPEG-2 standards
Provides invaluable insights into the intra and inter coding efficiencies of HEVC, such as the impact of hierarchical block partitioning and new prediction modes
Evaluates the performance of the Apple and Microsoft adaptive streaming platforms and presents innovative techniques related to aggregate stream bandwidth prediction, duplicate chunk
Includes end-of-chapter homework problems and access to instructor slides

Next-Generation Video Coding and Streaming is written for students, researchers, and industry professionals working in the field of video communications.

Benny Bing has worked in academia for over 20 years. He has published over 80 research papers and 12 books, and has 6 video patents licensed to industry. He has served as a technical editor for several IEEE journals and an IEEE Communications Society Distinguished lecturer. He also received the National Association of Broadcasters (NAB) Technology Innovation Award for demonstrations of advanced media technologies.



Table of Contents

Preface xvii

1 Digital Video Delivery 1

1.1 Broadband TV Landscape 2

1.1.1 Internet TV Providers 2

1.1.2 Netflix 3

1.1.3 Hulu 3

1.1.4 Amazon 3

1.1.5 YouTube 3

1.1.6 ESPN3 4

1.1.7 HBO 4

1.1.8 CBS 4

1.1.9 Sony 4

1.1.10 Retail Giants 4

1.2 Internet TV Delivery Platforms 5

1.2.1 Cloud TV 5

1.2.2 Content Delivery Network 6

1.2.3 Free CDN 6

1.2.4 Video Transcoding 7

1.3 Second Screen Device Adoption 7

1.3.1 Mobile Video 8

1.3.2 Mobile Versus Traditional TV 8

1.3.3 Over-the-Air Digital TV 8

1.3.4 Non-Real-Time TV Delivery 9

1.3.5 NRT Use Cases 9

1.3.6 Cable Wi-Fi Alliance 9

1.4 Screen and Video Resolution 10

1.4.1 Aspect Ratios 11

1.4.2 Video Resolution 11

1.4.3 Visual Quality 13

1.4.4 Matching Video Content to Screen Size 13

1.5 Stereoscopic 3D TV 14

1.5.1 Autostereoscopic 3D 14

1.5.2 Anaglyph 3D 14

1.6 Video Coding Standards 15

1.6.1 Exploiting Video Content Redundancies 15

1.6.2 High-Quality Versus High-Resolution Videos 16

1.6.3 Factors Affecting Coded Video Bit Rates 16

1.6.4 Factors Affecting Coded Frame Sizes 17

1.7 Video Streaming Protocols 18

1.7.1 Video Streaming over HTTP 19

1.7.2 Adaptive Bit Rate Streaming 19

1.7.3 Benefits and Drawbacks of Adaptive Streaming 20

1.7.4 HTTP Progressive Download 20

1.7.5 HTML5 20

1.8 TV Interfaces and Navigation 21

1.8.1 Streaming Adapters 21

1.8.2 Streaming Boxes 21

1.8.3 Media-Activated TV Navigation 22

1.8.4 Smartphone and Tablet TV Navigation 22

1.8.5 Digital Living Network Alliance 22

1.8.6 Discovery and Launch 23

1.8.7 UltraViolet 23

References 24

Homework Problems 24

2 Video Coding Fundamentals 29

2.1 Sampling Formats of Raw Videos 29

2.1.1 Color Subsampling 30

2.1.2 YUV Versus RGB Color Space 31

2.1.3 Bit Rate and Storage Requirements 31

2.2 Impact of Video Compression 32

2.2.1 Rate-Distortion Optimization 32

2.2.2 Partitions in a Video Frame 33

2.2.3 Video Coding Standards 34

2.2.4 Profiles and Levels 34

2.3 General Video Codec Operations 34

2.3.1 Transform Coding 35

2.3.2 Quantization 35

2.3.3 Deblocking Filter 37

2.4 Transform Coding 38

2.4.1 Orthonormal Transforms 38

2.4.2 Discrete Cosine Transform 40

2.4.3 Discrete Sine Transform 44

2.4.4 Asymmetric DST 44

2.4.5 Comparison of KLT, ADST, and DCT 44

2.4.6 Hybrid Transforms 46

2.4.7 Wavelet Transform 46

2.4.8 Impact of Transform Size 46

2.4.9 Impact of Parallel Coding 47

2.5 Entropy Coding 47

2.5.1 Variable Length Codes 47

2.5.2 Golomb Codes 48

2.5.3 Arithmetic Coding Overview 48

2.5.4 Nonadaptive Arithmetic Coding 49

2.5.5 Steps in Nonadaptive Arithmetic Coding 49

2.5.6 Context-Based Adaptive Arithmetic Coding 50

2.5.7 Code Synchronization 50

2.6 MPEG (H.26x) Standards 51

2.6.1 MPEG Frames 51

2.6.2 I Frames 51

2.6.3 P Frames 52

2.6.4 B Frames 52

2.6.5 Intracoded P and B Frames 52

2.7 Group of Pictures 53

2.7.1 GOP Length 53

2.7.2 Closed GOP 53

2.7.3 Error Resiliency in a Closed GOP 54

2.7.4 Decoding Sequence 55

2.7.5 Open GOP 55

2.7.6 Variable GOP Length 56

2.7.7 Random Access of MPEG Frames 56

2.8 Motion Estimation and Compensation 57

2.8.1 Motion Estimation 57

2.8.2 Motion Search in P Frames 58

2.8.3 Motion Search in B Frames 58

2.8.4 Fractional (Subsample) Motion Search 59

2.8.5 Motion Compensation 60

2.8.6 Computational Complexity 61

2.8.7 Motion Search Algorithms 63

2.8.8 Accelerating Motion Search 65

2.8.9 Impact of Video Resolution 66

2.9 Non-MPEG Video Coding 66

2.9.1 Motion JPEG 66

2.9.2 Dirac 67

2.9.3 WebM Project 67

2.10 Constant and Variable Bit-Rate Videos 67

2.10.1 CBR Encoding 68

2.10.2 VBR Encoding 68

2.10.3 Assessing Bit Rate Variability 69

2.10.4 Scene Change Detection 70

2.10.5 Adaptive Scene Change Detection 71

2.10.6 I Frame Size Prediction 72

2.11 Advanced Audio Coding 72

2.11.1 Low and High Bit Rate AAC 74

2.11.2 High-Efficiency and Low-Complexity AAC 74

2.11.3 MPEG Surround 74

2.12 Video Containers 74

2.12.1 MPEG-4 75

2.12.2 MP4 Access Units 75

2.12.3 Binary Format for Scenes 75

2.12.4 MP4 Overheads 76

2.12.5 MPEG-2 TS 76

2.12.6 MPEG-2 TS Structure 76

2.12.7 MPEG-2 TS Audio and Video PESs 77

2.12.8 MPEG-2 TS IP/Ethernet Encapsulation 77

2.13 CLOSED CAPTIONS 77

References 78

Homework Problems 78

3 H.264/AVC Standard 83

3.1 Overview of H.264 83

3.1.1 Fundamental H.264 Benefits 84

3.1.2 H.264 Applications 84

3.2 H.264 Syntax and Semantics 84

3.2.1 Profiles and Levels 85

3.2.2 Baseline, Extended, Main Profiles 85

3.2.3 High Profiles 85

3.3 H.264 Encoder 89

3.3.1 H.264 Slice Types 89

3.3.2 H.264 Intraprediction 90

3.3.3