Specialist - Data Engineering
Role Overview
Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Full Job Posting
Role description Job role : Spark and scala developer
Job Summary
Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job Description
Design develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
Mandatory Skills :** Apache Spark, Scala
Good to Have Skills : Hadoop Spark SparkSQL - Scala
Benefits
Compensation range: $79,851.00 to $113,900.00 per year
About Ltm
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises.
We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise.
Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, new productivity paradigms, and new roads to value.
Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it.
Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship.
Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment.
Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same.
Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at LTM Limited
Associate Principal - Cloud Engineering
Calgary, CAN
LTM is seeking an experienced Associate Principal to lead CISDevOps architecture strategy and tooling implementation. The role includes designing scalable DevOps solutions, integrating practices across teams, and mentori
Senior Software Engineer
Mississauga, CAN
LTM seeks an experienced Full Stack Developer to build cloud-native applications using Python and Angular, with backend, frontend, API, and containerized deployment responsibilities. Candidates need 5–8 years of experien
Senior Manager - Program & Project Management
Vancouver, CAN
LTM seeks a Senior Technical Program Manager to lead AI/ML initiatives from strategy through production, coordinating technical teams and managing delivery risks and governance. The role requires five years of program or
QA Automation
Mississauga, CAN
LTM is seeking an experienced QA Automation Engineer to build and maintain automation for complex, multitier applications. The role requires 8 years of functional testing experience, Playwright, Selenium, TypeScript, and
Salesforce Technical Architect
Toronto, CAN
LTM is seeking an experienced Salesforce Technical Architect to lead enterprise solution architecture and technical delivery. The role requires deep Salesforce platform expertise, integration and security design experien
Principal - Architecture
Toronto, CAN
The employer is seeking an experienced Salesforce Technical Architect to lead architecture and technical delivery for enterprise Salesforce implementations. The role requires deep Salesforce platform expertise, integrati
Senior Data Engineer
Mississauga, CAN
Role description Job : Senior Data Engineer location : Mississauga,canada Mandatory Certification in Databricks Certified Associate Developer for Apache Spark Data Pipeline Development Maintenance Design build and mainta
Associate Principal - Cloud Engineering
Calgary, CAN
Senior Software Engineer
Mississauga, CAN
Senior Manager - Program & Project Management
Vancouver, CAN
QA Automation
Mississauga, CAN
Salesforce Technical Architect
Toronto, CAN
Principal - Architecture
Toronto, CAN
Senior Data Engineer
Mississauga, CAN