RTP : audio and video for the internet

This book provides the knowledge needed to build VoIP and videoconferencing systems that sound and look good. It discusses implementation techniques and evaluates the network problems typically encountered when implementing RTP. After introducing redaers to RTP, its function, and its relationship to other protocols, the author explains more complex topics such as lip synch, error concealment and correction, quality of service and security. Throughout the book, it details implementation techniques and potential pitfalls that readers can apply and anticipate in their own systems.

Preface. Acknowledgements. Part 1: INTRODUCTION TO NETWORKED MULTIMEDIA.. 1. An Introduction To RTP. A Brief History of Audio/Video Networking. Early Packet Voice and Video Experiments. Audio and Video on the Internet. ITU Standards. Audio/Video Streaming. A Snapshot of RTP. Related Standards. Overview of an RTP Implementation. Behavior of an RTP Sender. Behavior of an RTP Receiver. Summary. 2. Voice And Video Communication Over Packet Networks. TCP/IP and the OSI Reference Model. Performance Characteristics of an IP Network. Measuring IP Network Performance. Average Packet Loss. Packet Loss Patterns. Packet Duplication. Packet Corruption. Network Transit Time. Acceptable Packet Sizes. Effects of Multicast. Effects of Network Technologies. Conclusions about Measured Characteristics. Effects of Transport Protocols. UDP/IP. TCP/IP. Requirements for Audio/Video Transport in Packet Networks. Benefits of Packet-Based Audio/Video. Summary. Part 2: MEDIA TRANSPORT USING RTP.. 3. The Real-Time Transport Protocol. Fundamental Design Philosophies of RTP. Application-Level Framing. The End-to-End Principle. Achieving Flexibility. Standard Elements of RTP. The RTP Specification. RTP Profiles. RTP Payload Formats. Optional Elements. Related Standards. Call Setup and Control. Session Description. Quality of Service. Future Standards Development. Summary. 4. RTP Data Transfer Protocol. RTP Sessions. The RTP Data Transfer Packet. Header Elements. Header Extensions. Payload Headers. Payload Data. Packet Validation. Translators and Mixers. Translators. Mixers. Summary. 5. RTP Control Protocol. Components of RTCP. Transport of RTCP Packets. RTCP Packet Formats. RTCP RR: Receiver Reports. RTCP SR: Sender Reports. RTCP SDES: Source Description. RTCP BYE: Membership Control. RTCP APP: Application-Defined RTCP Packets. Packing Issues. Security and Privacy. Packet Validation. Participant Database. Timing Rules. Reporting Interval. Basic Transmission Rules. Forward Reconsideration. Reverse Reconsideration. BYE Reconsideration. Comments on Reconsideration. Common Implementation Problems. Summary. 6. Media Capture, Playout, And Timing. Behavior of a Sender. Media Capture and Compression. Audio Capture and Compression. Video Capture and Compression. Use of Prerecorded Content. Generating RTP Packets. Timestamps and the RTP Timing Model. Fragmentation. Payload Format-Specific Headers. Behavior of a Receiver. Packet Reception. Receiving Data Packets. Receiving Control Packets. The Playout Buffer. Basic Operation. Playout Time Calculation. Adapting the Playout Point. Playout Adaptation for Audio with Silence Suppression. Playout Adaptation for Audio without Silence Suppression. Playout Adaptation for Video. Decoding, Mixing, and Playout. Decoding. Audio Mixing. Audio Playout. Video Playout. Summary. 7. Lip Synchronization. Sender Behavior. Receiver Behavior. Synchronization Accuracy. Summary. Part 3: ROBUSTNESS.. 8. Error Concealment. Techniques for Audio Loss Concealment. Measuring Audio Quality. Silence Substitution. Noise Substitution. Repetition. Other Techniques for Repairing Speech Signals. Techniques for Video Loss Concealment. Motion-Compensated Repetition. Other Techniques for Repairing Video. Packet Loss. Dependency Reduction. Interleaving. Summary. 9. Error Correction. Forward Error Correction. Parity FEC. Unequal Error Protection. Reed-Solomon Codes. Audio Redundancy Coding. Channel Coding. Partial Checksum. Reference Picture Selection. Retransmission. RTCP as a Framework for Retransmission. Applicability. Implementation Considerations. At a Receiver. At the Sender. Summary. 10. Congestion Control. The Need for Congestion Control. Congestion Control on the Internet. Implications for Multimedia. Congestion Control for Multimedia. TCP-Like Rate Control. TCP-Friendly Rate Control. Layered Coding. Summary. Part 4: ADVANCED TOPICS.. 11. Header Compression. Introductory Concepts. Patterns, Robustness, and Local Implementation. Standards. Compressed RTP. Operation of CRTP: Initialization and Context. Operation of CRTP: Compression and Decompression. Effects of Packet Loss. Robust Header Compression. Operation of ROHC: States and Modes. Compression Efficiency. Considerations for RTP Applications. Summary. 12. Multiplexing And Tunneling. The Mot