DIRECTIONAL ASR: A NEW PARADIGM FOR E2E MULTI-SPEAKER SPEECH RECOGNITION WITH SOURCE LOCALIZATION

Authors: Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Yong Xu, Shi-Xiong Zhang, and Dong Yu

Audio Demos


Method Sample 1 Sample 2 Sample 3
Input Mixture (Ch-1)
Ground Truth (Dry)

REF1: realized capital gains increased forty two percent to nine hundred nine million dollars from six hundred forty point nine million dollars

Ref Location 1: 307 degrees


REF1: he said such products would be marketed by other companies with experience in that business

Ref Location 1: 124 degrees


REF1: coniston partners of new york said it has a six point eight percent stake in gillette and may seek to acquire the company or gain seats on its board .period

Ref Location 1: 324 degrees

REF2: but even before the stock market's crash ,comma fed chairman greenspan saw no signs of high inflation .period

Ref Location 2: 245 degrees


REF2: the diversified utility provides gas and electric services in pennsylvania .period

Ref Location 2: 151 degrees

REF2: those identified as beneficial owners hold at least ten percent of a company's equity securities

Ref Location 2: 77 degrees

Oracle Binary Mask

HYP1: realized capital gains increased forty two percent to nine hundred nine million dollars from six hundred forty point nine million dollars


HYP1: he said such products would be marketed by other companies with experience in that business

HYP1: coniston partners of new york said it has a six point eight percent stake in gillette and may seek to acquire the company or gain seats on its board .period


HYP2: but even before the stock market's crash ,comma said chairman greenspan saw no signs of high inflation .period


HYP2: the diversified utility provides gas and electric services and pennsylvania .period

HYP2: those identified as beneficial owners hold at least ten percent of a company's equity securities

Oracle DOA Mask

HYP1: realized capital gains increased forty two percent to nine hundred nine million dollars from six hundred forty point nine million dollars


HYP1: he said such products would be marketed by other companies with experience in that business

HYP1: coniston partners of new york said it has a six point eight percent stake in july and may seek to acquire the company or gain seats on its board .period


HYP2: but even before the stock market's crash ,comma said chairman greenspan saw no signs of high inflation .period


HYP2: the diversified utility provides gas and electric services in pennsylvania .period

HYP2: those identified as beneficial owners hold at least ten percent of the company's equity securities

MIMO-Speech

HYP1: realized capital gains increased forty two percent to nine hundred nine million dollars from six hundred forty point nine million dollars


HYP1: they  said such products would be marketed to other companies with experience in that business

HYP1: coniston partners of new york said it has a six point eight percent stake in july and may seek to acquire the company or gain seats on its board .period


HYP2: but even before the stock market's crash ,comma said chairman greenspan stalled no signs of high inflation .period


HYP2: in the new york office martin white states and electric services in the northeast and the u. s. .period

HYP2: those identified as beneficial owners hold at least ten percent of the company's equity securities

D-ASR

HYP1: realized capital gains increased forty two percent to nine hundred nine million dollars from six hundred forty point nine million dollars

Predicted Location 1: 307 degrees

HYP1: he said such products would be marketed by other companies with experience in that business

Predicted Location 1: 123 degrees

HYP1: coniston partners of new york said it has a six point eight percent stake in gillette and may seek to acquire the company or gained seats on its board .period

Predicted Location 1: 325 degrees


HYP2: but even before the stock market's crash ,comma said chairman greenspan slowed no signs of high inflation .period

Predicted Location 2: 247 degrees


HYP2: the democrat survived utility provides gas and electric services and pennsylvania .period

Predicted Location 2: 149 degrees

HYP2: those identified as beneficial owners hold at least ten percent of a company's equity securities

Predicted Location 2: 80 degrees