TEAM

PhDs, professors and researchers

From the world's top universities in audio-visual human research.

  • Stanford
  • Yonsei
  • HKUST
  • University of Waterloo
▚ THE TEAM ▞

We exist to break every barrier to understanding.

Imagine a world where everything we watch plays seamlessly in every language. English speakers get the best of Korea, China, and everywhere else. Everyone else gets English content without subtitles.

Many of us on the team learned English from television. Our CEO, Andrew, arrived in Canada as a kid without the language: the only Chinese kid in his class, unable to join in, until the shows he watched every night taught him the words. The language barrier has been a sore spot for us ever since.

An Zhu Liu
An Zhu Liu
Jibin Song
Jibin Song
Mingi Kwon
Mingi Kwon
Google Scholar ↗
Jaeseok Jeong
Jaeseok Jeong
Google Scholar ↗
Prof. Xu Zheng
Prof. Xu Zheng
Taehwan Lee
Taehwan Lee
Tonghyun Lee
Tonghyun Lee
Michael Chan
Michael Chan
Prof. Youngjung Uh
Prof. Youngjung Uh
Google Scholar ↗
▚ RESEARCH ▞

We're building multimodal translation: not just voice and lips -- the scene, the sound, the human.

Joint audio-visual generation

The voice and the face generated by one model, so identity can never split: the field we started with JAM-Flow.

Real-time human animation

The most realistic real-time humans today: SoulX-LiveAct generates a person at 20 frames per second, stable for an hour.

Fast video generation

Distillation, guidance, and sampling: the research that makes diffusion models fast enough for real time.

Editing inside diffusion models

Editing inside frozen diffusion models, from finding h-space to controlling style and removing on-screen text.

Multimodal perception

Reading the scene before editing it: who is talking, from visual and audio together, in any environment.

Since 2021, over 10,000 citations and 100+ papers at ICLR, NeurIPS, CVPR, ECCV, and more.