Lead Data Engineer - MSS
Key Skills for This Role
Full Job Posting
Must Have Technical And Functional Skills
Data Bricks , EBT ,Airflow , Asset Management exp
8–15 Years
Role Overview
We are looking for a highly skilled Lead Data Engineer with strong hands-on experience in Databricks, dbt, and Python, and a proven track record of leading and executing data platform migration and modernization programs.
The ideal candidate will have experience migrating legacy data warehouses, ETL platforms, and cloud/on-prem data ecosystems to a modern Databricks Lakehouse architecture using dbt-based transformation frameworks.
This is a hands-on leadership role requiring deep technical expertise, solution design capabilities, and the ability to mentor engineering teams while driving enterprise-scale data modernization initiatives.
Data Engineering & Development
- Design, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python.
- Develop and optimize ELT/ETL processes for large-scale data ingestion and transformation.
- Implement robust data quality, monitoring, and reconciliation frameworks.
- Build reusable data engineering components and frameworks.
Data Platform Migration & Modernization
- Lead migration of legacy data platforms, data warehouses, and ETL ecosystems to Databricks Lakehouse.
- Transform existing ETL workloads to modern ELT patterns using dbt.
- Analyze source environments and define migration approaches, roadmap, and execution strategy.
- Drive code conversion, performance optimization, and workload modernization efforts.
Databricks Engineering
Develop solutions leveraging:
• Databricks Lakehouse Platform
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Structured Streaming
• Medallion Architecture (Bronze, Silver, Gold)
Optimize Spark jobs and Databricks workloads for performance and cost efficiency.
dbt Development
- Build and maintain dbt models, macros, tests, and documentation.
- Implement incremental processing and reusable transformation frameworks.
- Establish data lineage, testing, and CI/CD best practices.
- Work closely with business and analytics teams to build trusted datasets.
Leadership & Collaboration
- Lead a team of data engineers and developers.
- Perform code reviews and enforce engineering standards.
- Collaborate with archit ects, product owners, business analysts, and stakeholders.
- Mentor junior engineers and drive adoption of best practices.
Salary
Range- $110,000-$140,000 a year
About Tata Consultancy Services
Global leader in IT services, consulting, and business solutions.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Tata Consultancy Services
Business Analyst
Calgary, CAN
Tata Consultancy Services is seeking a business analyst to elicit and document business requirements, model processes, and translate needs for technical teams. The role also involves stakeholder workshops, business cases
Senior Software Engineer – AI & Cloud Applications (GCP)
Dhahran, KSA
TCS seeks a hands-on Senior Software Engineer to lead development and enhancement of enterprise software and AI-powered applications across front, middle, and back office. You will build GCP cloud-native applications, ow
Product Manager
Mississauga, CAN
TCS is seeking an experienced Product Manager to define and deliver banking technology solutions. You will own product strategy and lifecycle, align stakeholders and engineering teams, and drive adoption and operational
ETRM Business Analyst / Test Coordinator
Calgary, CAN
TCS is seeking an ETRM Business Analyst / Test Coordinator to support platform upgrades and enhancements across business and technology teams. The role coordinates requirements validation, testing, business readiness, an
UI / UX Designer
Toronto, CAN
TCS seeks a senior product designer to lead end-to-end digital product and AI-enabled experience design. The role spans research, strategy, prototyping, design systems, accessibility, implementation partnership, and ment
UX Designer
Toronto, CAN
TCS seeks a UX designer to lead product design work and create user-centered digital experiences, including AI-driven experiences. The role requires research, prototyping, analytics, design systems, accessibility, and co
Business Analyst – Data Lakehouse Program
Jeddah, KSA
TCS is seeking an experienced Business Analyst for a banking and financial services data lakehouse program. The role requires 8+ years of business analysis experience, strong data warehousing and governance knowledge, an
Microsoft CRM Architect
, UAE
TCS is seeking a Microsoft CRM Architect to lead the design and delivery of scalable, secure CRM implementations. The role requires expertise in CRM solution design, configuration, customization, integrations, and data m
Business Analyst
Calgary, CAN
Senior Software Engineer – AI & Cloud Applications (GCP)
Dhahran, KSA
Product Manager
Mississauga, CAN
ETRM Business Analyst / Test Coordinator
Calgary, CAN
UI / UX Designer
Toronto, CAN
UX Designer
Toronto, CAN
Business Analyst – Data Lakehouse Program
Jeddah, KSA
Microsoft CRM Architect
, UAE