Applied Scientist, Artificial General Intelligence, Frontier AI
Role Overview
Join Amazon's Artificial General Intelligence team as an Applied Scientist supporting Amazon Nova models and LLM and multimodal data quality.
Build technology and quality systems that improve training and evaluation data for LLM products and services.
Key Skills for This Role
Full Job Posting
Role Overview
Join Amazon's Artificial General Intelligence team as an Applied Scientist supporting Amazon Nova models and LLM and multimodal data quality.
Build technology and quality systems that improve training and evaluation data for LLM products and services.
Key Responsibilities
- Lead quality strategies and auditing frameworks for data collection workflows.
- Design SOPs, quality metrics, and sampling methodologies.
- Perform manual audits and meta-audits and coach auditors.
- Develop LLM-as-a-Judge systems, judge architectures, evaluation rubrics, and automated assessment models.
- Configure data collection workflows and provide quality feedback to stakeholders.
- Conduct root-cause analysis and research methods to optimize data quality.
- Work with engineers, domain experts, and vendor teams to operationalize quality systems.
Basic Qualifications
- Master's degree in computer science, mathematics, statistics, machine learning, or an equivalent quantitative field.
- Programming experience in Java, C++, Python, or a related language.
- Experience with SQL and an RDBMS such as Oracle, or a data warehouse.
Preferred Qualifications
- Experience implementing algorithms using toolkits and self-developed code.
- Publications at top-tier peer-reviewed conferences or journals.
Compensation
- Base salary range is USD 136,000 to USD 184,000 annually.
- Compensation package includes sign-on payments and restricted stock units.
- Benefits include health coverage, 401(k) matching, paid time off, and parental leave.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Amazon Science
Applied Scientist, Amazon Canada Technology, Amazon Canada
Vancouver, CAN
Amazon is seeking an Applied Scientist to build and improve machine learning systems for Canadian shopping search and product ranking. Candidates need at least three years of business-application model-building experienc
Data Scientist, ADE Analytics
Vancouver, CAN
Amazon is seeking a data scientist to analyze complex data, develop statistical methods, and generate product insights for Alexa Daily Essentials. The role also builds scalable data pipelines and translates findings into
Applied Scientist, Alexa Connections
Vancouver, CAN
Amazon is seeking an applied scientist to research, build, and deploy language intelligence for Alexa Connections. The work centers on LLM-powered communication features, production NLP, model evaluation, and privacy-con
Applied Scientist II, Alexa Daily Essentials Science and Analytics
Vancouver, CAN
Amazon is seeking an applied scientist to design and ship agentic AI systems and build rigorous evaluation science for Alexa products. Candidates need machine-learning experience, a PhD or a relevant master's degree with
Applied Scientist II, Worldwide Returns & Recommerce - Science
Hyderabad, IND
Amazon’s Worldwide Returns and ReCommerce team is seeking an Applied Scientist II to develop machine learning models and algorithms for returns, reuse, and customer experience problems. The role uses Python, SQL, Jupyter
Sr. Applied Scientist, Alexa Smart Home
Vancouver, CAN
Amazon Science is seeking a Senior Applied Scientist to set the scientific direction for Alexa Smart Home workstreams and turn research problems into production systems serving millions of homes. The role requires machin
Applied Scientist, Amazon Canada Technology, Amazon Canada
Vancouver, CAN
Data Scientist, ADE Analytics
Vancouver, CAN
Applied Scientist, Alexa Connections
Vancouver, CAN
Applied Scientist II, Alexa Daily Essentials Science and Analytics
Vancouver, CAN
Applied Scientist II, Worldwide Returns & Recommerce - Science
Hyderabad, IND
Sr. Applied Scientist, Alexa Smart Home
Vancouver, CAN