Machine Learning Engineer - Inference
Key Skills for This Role
Full Job Posting
The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company.
We also drive substantial impact on core businesses of the company.
Currently, we are looking for Machine Learning Engineer - Inference to join our team to support and advance that mission.
Responsibilities: - Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models. - Responsible for building monitoring/managing tools to oversee the reliability and scalability of online inference servers - Responsible for triaging system inefficiency and bottlenecks and improving system performance - Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions - Responsible for collaboration with product teams and providing general solutions to meet their requirements
Minimum Qualifications: - At least 3 years of experience in developing and deploying large-scale systems. - Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt). - Strong background in one of the following fields: Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU/RDMA) or ML for Systems.
About ByteDance
Global technology company specializing in AI-powered content platforms.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at ByteDance
GenAI Account Executive - Innovative Technical Sales (Third-party Associate)
Riyadh, KSA
ByteDance seeks an experienced B2B seller to grow BytePlus technology solutions across MENA. The role owns pipeline development, consultative selling, deal closure, forecasting, and customer adoption. A bachelor's degree
GenAI Solution Architect - BytePlus - Turkey Market (Turkish Speaking)
Dubai, UAE
ByteDance is seeking a customer-facing GenAI Solution Architect to shape and deliver multimodal AIGC solutions for customers in the Turkish market. The role requires 5+ years in solutions architecture or similar work, pr
Data Center Facilities Manager - Riyadh
Riyadh, KSA
ByteDance seeks a Data Center Facilities Manager to plan, operate, and maintain CoLocation data center infrastructure in Riyadh. The role owns change management for high-risk maintenance, supervises fit-out construction,
Sales Development Representative - South Asia Market
Dubai, UAE
ByteDance is seeking a Sales Development Representative to build qualified pipeline for its business technology products in the South Asia market. The role develops and grades leads, holds prospect conversations, and wor
Account Executive - Innovative Technical Sales, BytePlus (GenAI & SaaS)
Dubai, UAE
ByteDance is seeking an experienced B2B sales professional to grow BytePlus across MENA and win customers for its GenAI and SaaS solutions. The role includes prospecting, pipeline development, customer growth, and managi
Head of Cybersecurity, Byteplus - Riyadh
Riyadh, KSA
ByteDance is seeking an executive cybersecurity leader to oversee governance, risk, compliance, security operations, and resilience for its cloud services. Candidates need a relevant bachelor's degree, 5+ years of cybers
GenAI Solutions Architect - BytePlus - Chinese Speaker (Third-Party Associate)
Riyadh, KSA
BytePlus is seeking a Chinese-speaking solutions architect to support enterprise customers and regional sales teams with cloud and AI solutions. The role spans pre-sales, solution design, project implementation, and acco
Physical Security Systems & Technology Project Intern (PSST) - 2027 Start
San Jose, USA
GenAI Account Executive - Innovative Technical Sales (Third-party Associate)
Riyadh, KSA
GenAI Solution Architect - BytePlus - Turkey Market (Turkish Speaking)
Dubai, UAE
Data Center Facilities Manager - Riyadh
Riyadh, KSA
Sales Development Representative - South Asia Market
Dubai, UAE
Account Executive - Innovative Technical Sales, BytePlus (GenAI & SaaS)
Dubai, UAE
Head of Cybersecurity, Byteplus - Riyadh
Riyadh, KSA
GenAI Solutions Architect - BytePlus - Chinese Speaker (Third-Party Associate)
Riyadh, KSA
Physical Security Systems & Technology Project Intern (PSST) - 2027 Start
San Jose, USA