Amir Ivry

I'm an incoming postdoc researcher in CMU LTI with Prof. Shinji Watanabe. My research develops mathematical models, protocols, and methods to align the evaluation of AI-based spoken dialogue and speech systems with the ultimate compass: human perception. Rebuilding this "broken compass", I aim to accelerate progress in speech-driven AI by enabling reliable, perceptually-grounded evaluation across the full spectrum of voice interactions: human-to-human (assistive and conferencing technologies), human-to-machine (robotics and embodied agents), and machine-to-machine (autonomous voice communication between agents).

From 2015–2025, I was an industry research scientist - most recently as Principal Researcher and Head of Data for Microsoft Teams. I completed a direct-track PhD at the Technion (2018–2023) on efficient personalization in speech systems, where I was very fortunate to be advised by Prof. Israel Cohen and Dr. Baruch Berdugo.

Selected Publications

MAPSS: Manifold-based Assessment of Perceptual Source Separation

Amir Ivry, Samuele Cornell, Shinji Watanabe

Arxiv (submitted to ICLR) · 2025

🤗
NOTSOFAR-1 challenge: New datasets, baseline, and tasks for distant meeting transcription

Alon Vinnikov, Amir Ivry, Aviv Hurvitz, Igor Abramovski, Sharon Koubi, Ilya Gurvich, others

interspeech · 2024
A user-centric approach for deep residual-echo suppression in double-talk

Amir Ivry, Israel Cohen, Baruch Berdugo

IEEE/ACM Transactions on Audio, Speech, and Language Processing · 2024
Deep learning interviews: hundreds of fully solved job interview questions from a wide range of key topics in AI

Shlomo Kashani, Amir Ivry

arXiv preprint arXiv:2201.00650 · 2021
Voice activity detection for transient noisy environment based on diffusion nets

Amir Ivry, Baruch Berdugo, Israel Cohen

IEEE Journal of Selected Topics in Signal Processing · 2019

News

2025-09-11 📄 Our paper "MAPSS: Manifold-based Assessment of Perceptual Source Separation" is now available on Arxiv with code and HF space!
2025-07-01 👋 Welcome Omer Holtzman to the team!
2025-04-06 📄 Our paper "E-URES 2.0: Efficient User-Centric Residual-Echo Suppression with a Lightweight Neural Network" has been accepted to ICASSP!
2025-02-01 👋 Welcome Gil Weissman to the team!
2025-01-08 📄 Our paper "Summary of the NOTSOFAR-1 challenge: Highlights and learnings" has been accepted to Computer Speech & Language Journal!
2024-10-01 👋 Welcome Yair Amar to the team!
2024-10-01 💼 I have been appointed as a Visiting Researcher in the Electrical and Computer Engineering Faculty in the Technion
2024-09-09 📄 Our paper "E-URES: Efficient user-centric residual-echo suppression framework with a data-driven approach to reducing computational costs" has been accepted to IWAENC!
2024-07-01 🏅 We won Microsoft’s Global Hackathon!
2024-06-20 🏅 I was elevated to IEEE Senior Member status!
2024-03-10 🏅 I was appointed as AI Chapter Chairman in Israel!
2024-03-06 📄 Our paper "A user-centric approach for deep residual-echo suppression in double-talk" has been accepted to IEEE/ACM Transactions on Audio, Speech, and Language Processing!
2024-02-05 🏅 We officially released the NOTSOFAR-1 Challenge!
2024-01-16 📄 Our paper "NOTSOFAR-1 challenge: New datasets, baseline, and tasks for distant meeting transcription" has been accepted to Interspeech!
2023-12-14 🎓 I officialy have a PhD in Electrical and Computer Engineering from the Technion!
2023-10-22 📄 Our paper "Deep adaptation control for stereophonic acoustic echo cancellation" has been accepted to WASPAA!
2022-09-18 📄 Our paper "Objective Metrics to Evaluate Residual-Echo Suppression During Double-Talk in the Stereophonic Case" has been accepted to INTERSPEECH!
2022-06-15 💼 I have been promoted to a Principal Level and will serve as a Research Scientist in Microsoft!
2022-05-23 📄 Our paper "Off-the-shelf deep integration for residual-echo suppression" has been accepted to ICASSP!
2022-05-23 📄 Our paper "Deep adaptation control for acoustic echo cancellation" has been accepted to ICASSP!
2022-02-02 🏅 I was named to the Forbes 30 Under 30 list in Science & Technology!
2021-12-30 📄 Our book "Deep learning interviews: hundreds of fully solved job interview questions from a wide range of key topics in AI" is now available on arXiv!
2021-11-12 🏅 I received the Outstanding Research in Data Science Award from the Israel Council for Higher Education!
2021-10-17 📄 Our paper "Objective metrics to evaluate residual-echo suppression during double-talk" has been accepted to WASPAA!
2021-09-19 💼 I joined Microsoft as an Applied Research Intern!
2021-09-01 🏅 I was selected to present at the Interspeech Doctoral Consortium for excellent PhD proposals!
2021-08-30 📄 Our paper "Nonlinear acoustic echo cancellation with deep learning" has been accepted to Interspeech!
2021-08-15 🏅 I was awarded the International Speech Communication Association (ISCA) Grant!
2021-06-06 📄 Our paper "Deep residual echo suppression with a tunable tradeoff between signal distortion and echo suppression" has been accepted to ICASSP!
2021-06-01 🎤 I gave lecture on "Voice Activity Detection for Transient Noisy Environment Based on Diffusion Nets" in MIT CSAIL!
2021-05-31 📄 Our paper "Multiclass permanent magnets superstructure for indoor localization using artificial intelligence" has been published in IEEE Transactions on Magnetics!
2021-05-15 🎤 I gave lecture on "Real-Time Residual Echo Suppression with Deep Learning" in the 1st Technion-Hanyang research workshop, Israel!
2021-05-01 🎤 I gave lecture on "Audio Intelligence" in Alibaba Deep Learning Meetup, Israel!
2021-01-01 📄 Our paper "Smartphone based indoor localization using permanent magnets and artificial intelligence for pattern recognition" has been published in AIP Advances!
2020-09-15 🎤 I gave lecture on "Real-Time Residual Echo Suppression with Deep Learning" in the 4th Israeli Speech Recognition Conference, Israel!
2020-06-15 🏅 I received the Jacobs Award for excellence in research for the second consecutive year!
2020-06-01 🎤 I gave lecture on "Audio Intelligence" in the AI & Data Israeli Community Conference, Israel!
2020-05-04 📄 Our paper "Evaluation of deep-learning-based voice activity detectors and room impulse response models in reverberant environments" has been accepted to ICASSP!
2020-01-01 🎓 I will re-serve as a Teaching Assistent in the Graduate Course "Array Signal Processing and Analysis", led by Prof. Israel Cohen!
2019-08-19 📄 Our paper "Machine-Learning Detection Algorithms for Large Barkhausen Jumps in Cluttered Environment" has been published in IEEE Magnetics Letters!
2019-07-07 📄 Our paper "Low power in situ AI calibration of a three-axial magnetic sensor" has been published in IEEE Transactions on Magnetics!
2019-06-15 🏅 I received the Jacobs Award for excellence in research!
2019-06-01 🎤 I gave lecture on "Fraud Detection with Deep Learning" in the Annual Conference for Open-Source Code in the Defense Sector, Israel!
2019-05-01 🎤 I gave lecture on "Fraud Detection with Deep Learning" in Google for Start-ups, Israel!
2019-04-04 📄 Our paper "Voice activity detection for transient noisy environment based on diffusion nets" has been published in IEEE Journal of Selected Topics in Signal Processing!
2019-01-01 🎓 I will serve as a Teaching Assistent in the Graduate Course "Array Signal Processing and Analysis", led by Prof. Israel Cohen!
2018-12-09 📄 Our paper "Investigation and modeling of large Barkhausen jumps dynamics in low-power fluxgate magnetometers" has been published in IEEE Sensors Journal!
2016-11-16 📄 Our paper "Enhancement of BCI classifiers through domain adaptation" has been accepted to ICSEE!