AI Software Engineer

About this role

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for Zoom Corporation. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice.


AI Software Engineer


What you can expect


The AI Infra team at Zoom is dedicated to building a world-class inference infrastructure that powers all of Zoom's AI services. Our mission is to deliver high efficiency, scalability, and cost optimization across a wide range of AI applications, including large language models (LLM), vision-language models (VLM), automatic speech recognition (ASR), and machine translation. We focus on creating a seamless collaboration between small and large models, ensuring cost-effective, privacy-preserving, and high-quality AI services for our customers.


About The Team
As an AI Software Engineer on Zoom's AI Infra team, you will design, optimize, and scale the runtimes and services that power our AI models. Your work will directly improve efficiency, reduce latency, and lower costs across Zoom's AI stack, ensuring reliable, high-performance AI experiences for millions of users.


Responsibilities

• Develop and optimize AI runtimes for LLMs, ASR, and MT systems with a focus on performance and cost efficiency.
• Apply GPU-level optimization techniques including CUDA , kernel fusion, and memory throughput improvements.
• Implement inference optimizations such as TorchCompile, graph optimization, KV cache, and continuous batching.
• Build scalable, highly available infrastructure services to support enterprise-grade AI workloads.
• Optimize models for edge devices (laptops , PCs and mobile devices ) a...