Sei sulla pagina 1di 50

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

INTRODUCING WIRELESS ORGANIC DIGITAL AUDIO: A MULTICHANNEL STREAMING AUDIO NETWORK BASED ON THE IEEE 802.11 STANDARDS

SEPPO NIKKIL1
1

ANT Advanced Network Technologies Oy, Helsinki, Finland

sin@ant.fi

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Table of Contents
1. History Present, and Future of Sound Recording and Reproduction 1868 - 2011 2. Wireless Digital Audio Transmission Foundation and Techniques

3. Goals for Next Generation Wireless High Definition Multichannel Audio


4. Our Novel Approach to Wireless Streaming High Definition Multichannel Audio 5. Prototype System Implementation 6. Software Techniques for Streaming Multichannel Audio Transmission

7. Recent and Future Developments


8. Conclusions 9. Patents Biographical Note

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Milestones in Sound Recording and Reproduction Technology, Past and Present

Milestone 1
Thomas Alva Edison Phonograph Recorded sound 1868

Milestone 2
Emile Berliner Gramophone and disc record 1894

Milestone 3
Ted Wallerstein & William Savory Microgroove Long Playing vinyl record Hi-Fi Stereo Sound Electronic Amplification June 21, 1948

Milestone 4
Norio Ohga, Kees Schouhamer Immink Optical Compact Disc (CD) Digital Stereo (2 x 16 bit, 44.1 kS/s) October 1, 1982

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Milestones in Sound Recording and Reproduction Technology, Now

Milestone 5
Shuji Nakamura, Sylwester Porowski Blu-ray Disk Multichannel High Definition Audio April 2003, official release in June 2006.

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Dominant Sound Recording and Reproduction Technology Timeline

Blu-Ray

Compact Disk (CD) LP Microgroove Record

Gamophone Phonograph

1860

1880

1900

1920

1940

1960

1980

2000

2020

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Milestones in Sound Recording and Reproduction Technology

7.1 Pure Audio Blu-ray Disc, Lindberg Lyd (2L), Norway 2010

Morten Lindberg
Hybrid SACD + Pure Audio Blu-ray Two-disc-box at the price of one ordinary Blu-ray 7.1 SURROUND + 5.1 SURROUND + STEREO produced in DXD (Digital eXtreme Definition 352kHz/24bit) 2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Milestones in Sound Recording and Reproduction Technology The worlds first music only Blu-ray disc is made in Norway
Blu-ray Exclusive High Definition Music video only for menu guide. - 2.0 LPCM 24BIT/192 kHz - 5.1 LPCM 24BIT/192 kHz - 5.1 DTS HD Master Audio 24BIT/192 kHz - 5.1 Dolby True HD 24BIT/192 kHz - 5.1 Dolby Digital 48kHz Sony's PlayStation3 is fully compatible with this disc Pure Audio Blu-ray format

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Comparison of Compact Disk (CD) and Blu-ray Organic Audio Surround Sound (BROSS)
BROSS performance > 4000 x CD
R, sample Rate 192 [kS/s]

96 48

1 8 CD 16 24 32
2011-11-19

C, number of Channels
BROSS BROS

A, sample Accuracy, [Bits]


Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

3. Goals for Next Generation Wireless High Definition Multichannel Audio


Eight Fully Independent Digital Audio Channels Up to 24-bit Sample Size Up to 192 kHz Sampling Rate 24-bit Analog Electronics to prevent quality degradation in analog domain Playable with available consumer equipment Playing time of several hours Reliable and Robust Recording Medium Reliable and Robust Wireless Transmission Reasonable Cost Ease of Handling Lowest System Delay Low Jitter Good Interchannel Synchronization Compatibility with Existing Audio Sources and Loudspeakers

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

T D H 0 0 0 0 1% ,0 0 0 0

A w b D to na dR q ire D n m sv . A d S m leS e llo a le is rtio n e u d y a ic s u io a p iz

S [d ] /N B 20 0 10 9

0 0 0 0 0% ,0 0 0 1

10 8 10 7

0 0 0 1 0% ,0 0 0 0

10 6 10 5

0 0 0 0 0% ,0 0 1 0

10 4 10 3

0 0 1 0 0% ,0 0 0 0

10 2 10 1

0 0 0 0 0% ,0 1 0 0

10 0 9 0

0 1 0 0 0% ,0 0 0 0 1 6

1 7

1 8

1 9

2 0

2 1

2 2 2 3 2 4 2 5 2 6 A d S m leS e[B ] u io a p iz its

2 7

2 8

2 9

3 0

3 1

8 0 3 2

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

10

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

P f r ac C p i o oV y o- o e ui O r toaAp i r eo n o asn f e Lw i A o p a n mfe r m e mr r Ns d e i l l s i


C m C r c r tc:> + 1 V up Vt g en< n/ q( z G > 1 M o o h at i i s = / 8 S l oae v 4 V r H, B = 0 H m n a es py l , st ) W z Ap a e r a t p af r kz1 V s p ao w 2 oma l a m s r yi l o1 H 0 r oe t n ih kh l d l r t e e c , m ri t o 2 B ,S = 3 d ( ih b qatzto ni en ue) 14 B ihuqai ao ni e 4 is / 18 B t 1 i u i a n o i c d , 4 d w ot u zt n o t N w t n i s l d t n i s Pcs r l t 21 bde r @K r e a a 00 ug a i e e t y 1U

#Te y p

M u c rr a f t e nau

en / TD P f S p V t G v S N H e. u l r py o u B WPc FM FP Ap o s re o i o m sNe t [ Vq( z [ B [d] [ B [ /V [ r s [ h n/ r H] d] - B d] + ] V ] M] st ) m z [] $ t p t p t p t p m. t p t p y. y. y. y. a x y. y. et s . 0 819 , 8 5 1 5 , 118 1 5 , 118 2 4 , 719 2 5 , 510 0 5 , 918 1 5 , 117 2 4 , 918 0 510 , 8 6 3 4 , 519 0 6 , 910 16 4 16 3 16 3 10 3 10 3 10 2 10 2 14 1 9 6 9 3 9 3 16 4 16 3 16 3 10 3 10 3 10 2 10 2 14 1 9 6 9 3 9 3 1 8 2 0 1 8 1 8 1 8 1 8 1 8 1 8 2 0 2 2 2 2 1, 1 10 2 0 1 3 1 , 0 1, 9 8 3 7 0 15 , 7 1, 9 4 2 5 8 45 , 3 1, 2 5 2 0 5 1, 0 2 0 1, 2 5 2 0 5 20 , 0 1, 3 1 1 0 0 44 , 7 1, 6 1 1 4 0 1, 0 0 0 1, 0 2 1 5 0 53 , 4 1, 3 5 2 0 0 1, 0 4 0 1, 4 1 4 1 0 08 , 6 1, 0 7 3 4 0 20 , 9 1, 8 3 1, 6 0 9 , 4 1, 4 9 1, 3 0 5 , 7 3 , 2 4 , 1 0 , 4 1 , 0 0 , 5 1, 8 1 1, 4 8 1, 4 8 1, 2 9 1, 2 9 9 , 7 9 , 7 7 , 7 1 , 9 1 , 0 1 , 0 1 1 1 4 1 1 1 1 1 1 1 T e 4 i p f r ac r 2- t eo n u b r m e 2- i p f r ac 3 t eo n b r m e 2- i p f r ac 3 t eo n b r m e Q d ei e u d c a v V yo ni e e l wo r s

1 L E 90 M 99 4 2 O 11 P 61 A 3 O 21 P1 A 4 L E 70 M 94 4 5 L E 70 M 91 4 6A9 D7 7 7 A 57 D9 8 8A4 D5 7 9 L12 T 8 0 1 E 3A 0N 54 5 1 T1 1L1 5 1

Ni n S i odc r aoa e cnu o t l m t T a I su et e sn r m s x t n T a I su et e sn r m s x t n Ni n S i odc r aoa e cnu o t l m t Ni n S i odc r aoa e cnu o t l m t A l g ei e n o D cs a v A l g ei e n o D cs a v A l g ei e n o D cs a v L er eho g i aT nl y n c o My a n L er eho g i aT nl y n c o

Lw tni e oe o s s Re n ol er c n f e e y V yo ni e e l wo r s

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

11

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Requirements set to Analog Electronics by Different Resolutions


T D H 0 0 0 0 1% ,0 0 0 0

A w b D to na dR q ire D n m sv . A d S m leS e llo a le is rtio n e u d y a ic s u io a p iz

S [d ] /N B 20 0 10 9

0 0 0 0 0% ,0 0 0 1

10 8 10 7

0 0 0 1 0% ,0 0 0 0

10 6 10 5

LME49990
0 0 0 0 0% ,0 0 1 0 10 4

0 0 1 0 0% ,0 0 0 0

OPA1611, OPA211 AD797

10 3 10 2 10 1 10 0 9 0 8 0 3 2

0 0 0 0 0% ,0 1 0 0

LM1028

NE5534A
0 1 0 0 0% ,0 0 0 0 1 6 1 7 1 8 1 9 2 0 2 1 2 2 2 3 2 4 2 5 2 6 A d S m leS e[B ] u io a p iz its 2 7 2 8 2 9 3 0 3 1

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

12

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

R o T m e aueT e ml N is inR s t r o m e pr t r hr a o e e isos


Ad Bn u io a d N is V lt g [ V o e oaen]

A d B n T em l N is V lta e[n ] u io a d h r a o e o g V N is V lta eD n ity[n /s r H) o e o g es V qt( z]


N is a d o e n N nL e r y o - in a it L it f r 2 - it im o 4b A a gWr n lo ok @ o t =1 Vm Vu 0 r s

V lt g N is D n it oae o e esy [ V qt H ) n /s r ( z]

1 00 0 0 ,0

10 0 ,0

10 0 0 ,0

1 ,0 0

10 0 ,0
L E9 9 M4 9 0

1 ,0 1 ,0 0

1 ,0 1 1 0 10 0 R s t n e[ h ] e isa c o m 10 0 0

0 ,1 1 00 0 0

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

13

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

2. Wireless Digital Audio Transmission Foundation and Techniques

Current Wireless Loudspeaker System Topologies IEEE 802.11 Communication Fundamentals IEEE 802.11 Addressing Alternatives

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

14

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

WLAN Audio Configurations, point-to-point and multipoint systems

Point-to-point

Supportive multipoint

Full multipoint

Broadcast

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

15

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

IEEE 802.11 Communication Services, Coordination Functions, and Channel Access

Contention-Free Communication Services Point Coordination Function (PCF) MAC Sublayer

QoS Communication Services Hybrid Coordination Function (HCF) Enhanced Distributed Controlled Channel Channel Access Access

Contention Communication Services

Distributed Coordination Function (DCF)

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

16

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

IEEE 802.11 MAC Addressing, Individual, Group (Multicast), and Broadcast Addresses

Individual Address (0xxx...) MAC Sublayer Unicast Address (0xxx...) Station

Group Address (1xxx...) Multicast Address (1x...0...) Group Broadcast Address (1111...1) All

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

17

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Our Novel Approach to

Wireless
Streaming High Definition Multi-Cannel Audio

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

18

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Six Questions on Wireless Multichannel Streaming Audio


Why eight (8) channels? To support all existing common commercial formats, including surround 7.1

Why contention-free communication? It only guarantees the isochronous transfer.


Why 24 bit samples? To support over 130 dB dynamics and S/N.

Why not 32 bit samples? Because it is beyond the best human ear! And cannot be reasonably done with room temperature electronics
Why IEEE 802.11? Chips are readily available and affordable. A growing $5 billion market. Why multicast? It gives high efficiency, automatic synchronization, low system delay, and complete on-the-fly configuration flexibility.

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

19

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Isochronous, Contention-Free Audio Transmission Sequence


Foreshortened Contention-Free Period, Isochronous Audio data Traffic

WLAN data

Audio Block #1 Beacon Frame NAV condition set

...

Audio Block #12

WLAN data CF-End Frame (synchronization)

NAV condition reset Contention Period

Target Beacon Transmission Time CFMaxDuration

Contention-Free Repetition Interval 3 x 1024 s = 3072 s, three IEEE 802.11 Time Units (TU), may be foreshortened, as shown

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

20

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Transmitter Operation Buffer Recycling Algorithm


0 Time [ms] Audio In 1 2 3

Buffer Use
WLAN Out

Beacon

CF-End

NAV Receiver In Audio Out Contention mode


2011-11-19

Foreshortening Reserve

Contention Free mode

Contention mode 21

Copyright 2011 ANT Advanced Network Technologies Oy

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Flow Control and Jitter Smoothing Algorithm


Dominant Block Size is 49
Index Samples Samples Samples Samples Samples Samples Samples Samples Samples Samples Samples Samples in Buff 1 in Buff 2 in Buff 3 in Buff 4 in Buff 5 in Buff 6 in Buff 7 in Buff 8 in Buff 9 in Buff 10 in Buff 11 in Buff 12

Exception! 60th (#59) Buff 1 has50 Sample Records instead of 51

0 1 2 3 4 5 6 7 8 9 10 11 58 59 60 121 122 123 124

51 51 50 51 51 51 51 51 50 51 51 51 51 50 51 51 50 51 51

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49

Inner Repeating Sequence of 6 x 12

Outer Repeating Sequence of 125 x 12

Number of 8 x 32 Bit Sample Records in Consecutive Data Blocks

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

22

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Jitter Smoothing Results, 125 Packet Cycle


125 Sample Cycle, CF Repetition Interval = 3 TU Jitter [# of Samples] 1,2 Behind 1,0 0,8 0,6 0,4 0,2 0,0 -0,2 -0,4 -0,6 -0,8 Ahead -1,0 0 25 50 75 100 Index of Sample Packet 12-tuple

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

23

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

5. Prototype System Design and Implementation

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

24

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Laboratory Sound Sources, Remote Control, and Transmitter Installations

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

25

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Laboratory Prototype Installation, Transmitter and Receivers

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

26

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Receiver Station Microcontroller Board and D/A Converter Board Connection

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

27

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

BeagleBoard Microcontroller Board based on the TI OMAP3530 ARM Cortex A-8

Beagleboard Expansion Connector Pad Pattern 2 x 14 pads in the 0.1 raster

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

28

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

ANT WiDiAuNet WAM-6 D/A Converter Board based on the TI (BB) PCM1792A

Beagleboard Expansion Pin Connector 2 x 14 pads in the 0.1 raster BeagleBoard and BB-DAC board are connected back-to-back with 4 spacers

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

29

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

6. Software Techniques for Streaming Multichannel Audio


We believe in Open Source and Community Development and we chose the ARM architecture (ARM Cortex A8 with MMU and DSP) running the Linux Kernel and Open Source device drivers as the starting point of our development work. We also decided to only design and build our own hardware when proper commercial product was not available. The real-time requirements of isochronous transfer can properly only be met by implementing a deterministic Medium Access Control (MAC) Protocol with IEEE 802.11 this can be done using the Contention-Free mode. WLAN drivers had to, of course, be upgraded to support it. Because our design is targeted to future fully embedded implementation Special Wireless Audio Algorithms to optimize the audio performance with the least hardware resources and memory footprint is our goal. The use of MPU, DSP, and several DMA channels is an attractive possibility.

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

30

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Transmitter Buffer Recycling Algorithm


1

START

7
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

31

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC)


Summary: Two modes of operation, 16-bit mode and 24-bit mode Specific Check Code generation and encoding for each mode Balancing in transmission Reception Good frames Balancing removal in reception Mode analysis in reception Decoding based on the determined mode Reception Bad frames Error indication from the WLAN driver on the flame level Mode analysis with errors on the sample level For good 16-bit or 24-bit mode result take the corresponding decoding For mode violation take the Cubic Predictive Estimation Make the Adaptive Slew Rate Limitation Error Logging and Indication
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

32

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC)


Audio Sample Encoding, Generation of FEC Byte for Transmission

Encoding:

1. Mode Selection If the sample value is < 215-1 (0x7FFF) and > -215 (0x8000) 16-bit encoding mode is used; else 24-bit encoding mode is used. 2. Alternative 16-bit and 24-bit Encodings: ?
b23:b16 b15:b8 b7:b0

Encoding:

Original 24-bit Audio Sample:

16-bit Encoding:

b15:b8

b15:b8

b7:b0

b7:b0

24-bit Encoding:

b23:b16

b23:b16

b15:b8

b7:b0

Bitwise inversion
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

33

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC), cont.

Encoding:

3. Balancing, encoded 32-bit word is XOR-ed with mask 0xAAAAAAAA. This makes the average amounts of 0 and 1 bits to approach equal and also hides the audio data from outsiders. 4. The 32-bit Data Word is now ready for transmission.

Encoding:

FEC Byte Analysis and 16-bit Mode Decoding in Reception

Decoding:

1. Balancing removal; received Data Word is X-ORed with 0xAAAAAAAA

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

34

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC), cont.


Decoding; 2. 16-bit, 24-bit, or error concealment mode selection D:
d31:d24 d23:d16 d15:d8 d7:d0

Exclusive-OR
x7:x0

If [x7:x0] == 0x00 take 16-bit Decoding (3), else if [x7:x0] == 0xFF take 24-bit Decoding (4), else do Cubic Predictive Estimation (CPE). Decoding: 3. 16-bit Decoding short E, F, G; int D; E = (short)D >> 8 & 0x00FF; F = ~(short)D & 0xFF; if (E ^ F == 0x00) return 0X00FFFFFF & (int)((short) (D >> 8 & 0xFFFF)); else use CPE.

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

35

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC), cont.


FEC Byte Analysis and 24-bit Mode Decoding in Reception

Decoding:
Decoding;

1. Balancing removal; received Data Word is X-ORed with 0xAAAAAAAA


2. 16-bit, 24-bit, or error concealment mode selection D:
d31:d24 d23:d16 d15:d8 d7:d0

Exclusive-OR
x7:x0

Decoding:

If [x7:x0] == 0x00 take 16-bit Decoding (3), else if [x7:x0] == 0xFF take 24-bit Decoding (4), else do Cubic Predictive Estimation (CPE). 4. 24-bit Decoding return (D & 0x00FFFFFF);

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

36

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment (iFEC), cont.


Cubic Predictive Estimation (CPE) and Adaptive Slew Rate Limitation (ASRL) Used only when Frame Error condition is active

Frame_Error Condition

Frame Error Detector Sample Stream

Received Data

Cubic Predictive Estimator

Adaptive Slew Rate Limiter

Sample Level, Audio Specific Error Concealment

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

37

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment Algorithm (iFEC)

Cubic Predictive Estimation (CPE)


Starting point: Third order polynomial curve fitting: z(w) = aw3 + bw2 + cw + d, has two turning points Relation to Markov process (and chain): Fourth order discrete time, finite discrete state non-time-homogenous Markov process. Relation to Klmn filters: Generalized Klmn filter with four measurement memory.

Relation to Dempster-Shafer theory: DS-system with Audio Specific Belief function estimation.
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

38

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment Algorithm (iFEC)

Cubic Predictive Estimation (CPE)


= CA-1ZT , calculation of the next cubic extrapolation estimate

0 A= 1 8 27

0 1 4 9

0 1 2 3

1 1 , cubic estimation matrix, 1 1

C = [ 64 16 4 1], cubic coefficients vector, Z = [w0 w1 w2 w3], history vector; example [1000, 1500, 3000, 4000 ]. -1/6 1/2 -1/2 1/6 A-1 = 1 -5/2 2 -1/2 -11/6 3 -3/2 1/3 1 0 0 0 CA-1 = [ -1 4 -6 4 ]

= CA-1ZT = -w0 + 4w1 - 6w2 + 4w3; example 3000

One two's complementation, three integer multiplications, and three integer additions
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

39

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Fast, Audio Specific Forward Error Concealment Algorithm (iFEC)


Cubic Predictive Estimation (CPE) and Adaptive Slew Rate Limitation Extrapolated sample point z'(4) (green)
Sample value z(w[i]])

4500 4000 3500 3000 2500 2000 1500 1000 500 0 0 1 2


Sample Index w[i]

Adaptive Slew Rate Limitation


Limitation is ONLY USED when FRAME_ERROR occurs. If the extrapolated value differs from the fourth sample point more than twice as much than the largest difference among the four extrapolation samples, limit the extrapolation to twice the largest difference (to the extrapolation direction).
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

40

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Long-term Flow Balancing and Clock Drift Compensation


CF-End End-of-Frame Interrupt CF Audio Trigger Timer Expire Interrupt

Arm the CF Audio Trigger Timer Low Limit ?

Buffer tests

High Limit ?

Reprogram MPU PLLs for underspeed clocking

Return

Reprogram MPU PLLs for overspeed clocking

Return

Return Return

Return

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

41

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Transmitter Load Sharing between Microcontroller, DSP, and DMAs


Transmitter Software Set-Up Input Streaming Output Streaming

DMAs

MPU

Initialization
Linux Kernel

Control

Termination

System Management and Audio Controls

DSP

FAS-FEC Generator

Phase #1
2011-11-19

Phase #2

Phase #3

Copyright 2011 ANT Advanced Network Technologies Oy

42

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Receiver Load Sharing between Microcontroller, DSP, and DMAs


Receiver Software Set-Up Stationary Stage Input Streaming Output Streaming

DMAs

MPU

Initialization
Linux Kernel

Control

Termination

System Management and Audio Controls

DSP

FAS-FEC fix Channel Filter Phase #1 Phase #2 Phase #3

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

43

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Transmitter Unit, Audio Data Memory Buffer Space Utilization


Buffer Usage [Bytes] 7 000 3TU point 6 000 5 000 4 000 3 000 2 000 1 000 0 0 1 000 2 000 3 000 Time [s] 4 000 5 000 6 000

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

44

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Recent and Near Future Developments


1. Freezing of Linux WLAN drivers, beacon optimization 2. Freezing of DAC Linux drivers (including switch bank and RGB LED) 3. 10 W / 25 W Class D Amplifier Module (DAM), done not tested 4. Class D amplifier based active loudspeaker prototype, under construction 5. Battery power to the Class D active speaker, under construction 6. New generation operational amplifiers utilization 7. HDMI Adapter Module (for audio) (HAM), HW done not tested 8. DisplayPort Interface Module (DIM) 9. Receiver station integration, one cubic inch, 10 design 10. Wireless Microphone Adapter Module (MAM), HW done - not tested 11. Fully Wireless Active Speaker with Inductive Charger (WAS) 12. HomePlug AV+ network implementation 13. Ultra low-noise LDO regulators addition to WAM analog power rails

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

45

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

New Wireless Adapter Module and D-Class Amplifier Module


WAM-7 takes advantage of the new LME49990 to produce true 24-bit analog performance

DAM interfaces directly to the 10 Vrms output of WAM-7 and can be programmed to deliver 10 W or 25 W to the 4 load by the selection of source voltage (12 V or 24 V DC) and the feedback resistor
Copyright 2011 ANT Advanced Network Technologies Oy

2011-11-19

46

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Steps to Fully Wireless Active Loudspeakers

Integrated Power & Signal 1. Passive Loudspeaker

Mains Power Wired Signal 2. Active Loudspeaker (Analog or Digital)

Mains Power Radio Signal

Battery Power Radio Signal 4. Battery Powered Wireless Loudspeaker

Wireless Power Radio Signal

3. Wireless Signal Loudspeaker

5. Fully Wireless Loudspeaker

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

47

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Conclusions
1. 2. 3. 4. 5. 6. 5 GHz IEEE 802.11an with Contention-Free Mode is the right way for wireless audio Lowest data rate having enough capacity should be used to maximize sensitivity and range Multicast Group Addressing offers significant benefits and saves bandwidth Audio specific fast Forward Error Correction is essential for successful implementations 24-bit audio work is a real challenge for the analog electronics Modern DC/DC conversion technology and the rapid progress in battery chemistry make the battery powered, wireless active speakers an exiting near future opportunity 7. Wireless power transmission is currently under intensive development and would be the ideal partner for wireless digital audio transmission in multichannel audio systems 8. Effective Predictive Forward Error Consealment is very important 9. Low-cost, low-power processor is a key component for commercial implementations 10. More organic music material is very welcome 11. 50 GB and 100 GB Blu-Ray disks can improve the usefulness of the technology considerably

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

48

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Patents and Trademarks


(WO/2007/125175) METHOD AND SYSTEM FOR WIRELESS REAL-TIME TRANSMISSION OF MULTICHANNEL AUDIO OR VIDEO DATA

FINNISH NATIONAL PATENT FI 118914 B, 2008-04-03

FINNISH NATIONAL PATENT FI 119013, 2008-04-13

FINNISH NATIONAL PATENT FI 119014, 2008-04-13

WODA
2011-11-19 Copyright 2011 ANT Advanced Network Technologies Oy

49

AES 44TH CONFERENCE Audio Networking, San Diego, CA, USA November 18-20,2011

Biographical Note
Seppo Ilmari Nikkil, M.Sc.EE, born 1949, graduated from Helsinki University of Technology mastering in Digital Electronics and Computer Science in 1975. In early 1970's he was pioneering the use of microprocessors in industrial control and in 1980 he lead a group that employed the emerging local area networking technology with microprocessors to design and implement an integrated process and production automation system now being used worldwide. In 1975 Mr. Nikkil cofounded Genelec Oy, a Finnish audio technology company specializing in active monitor loudspeakers. Since 1988 he has worked as the CEO for ANT Advanced Network Technologies Oy and since 2003 especially with the wireless distribution and collection of realtime, streaming multichannel high definition audio. Mr. Nikkil is AES member number 83990 and the author of nearly one hundred scientific or technical papers or reports.

2011-11-19

Copyright 2011 ANT Advanced Network Technologies Oy

50

Potrebbero piacerti anche