Data Engineer - Python & Snowflake
Key Skills for This Role
Full Job Posting
Responsibilities
- Design, develop, and maintain robust data pipelines and ETL/ELT workflows.
- Develop Python-based solutions for data ingestion, transformation, validation, and processing.
- Build and optimize data solutions using Snowflake.
- Write complex and performance-optimized SQL queries.
- Develop data pipelines to integrate data from databases, APIs, files, and other enterprise data sources.
- Perform data transformations and implement business rules according to functional requirements.
- Design and maintain data models suitable for analytical and reporting requirements.
- Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.
- Optimize Snowflake queries, data structures, and workloads for performance and scalability.
- Implement appropriate data-quality checks, reconciliation, logging, monitoring, and error handling.
- Work closely with Data Architects, Business Analysts, Data Scientists, and application teams.
- Participate in code reviews, testing, deployment, and production support.
- Follow engineering standards for secure and reliable handling of enterprise data.
Requirements
- Must have
- At least 8 years of experience working within data engineering area, preferably within banking industry. Strong hands-on experience with Python for data engineering and automation. Strong experience with Snowflake data warehouse. Advanced knowledge of SQL, including joins, CTEs, window functions, stored procedures, and query optimization. Good understanding of ETL/ELT architecture and data pipeline development. Experience with data ingestion and transformation of large datasets. Good understanding of data warehousing concepts, dimensional modelling, and data marts. Experience with REST APIs and structured/semi-structured formats such as JSON, CSV, and Parquet. Experience with Git and CI/CD practices. Strong debugging and production troubleshooting skills.
Full Job Posting
Project description We are looking for an experienced Data Engineer with strong hands-on expertise in Python, Snowflake, SQL, and data engineering technologies. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions supporting enterprise data and analytics platforms. Responsibilities
- Design, develop, and maintain robust data pipelines and ETL/ELT workflows. Develop Python-based solutions for data ingestion, transformation, validation, and processing. Build and optimize data solutions using Snowflake. Write complex and performance-optimized SQL queries. Develop data pipelines to integrate data from databases, APIs, files, and other enterprise data sources. Perform data transformations and implement business rules according to functional requirements. Design and maintain data models suitable for analytical and reporting requirements. Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks. Optimize Snowflake queries, data structures, and workloads for performance and scalability. Implement appropriate data-quality checks, reconciliation, logging, monitoring, and error handling. Work closely with Data Architects, Business Analysts, Data Scientists, and application teams. Participate in code reviews, testing, deployment, and production support. Follow engineering standards for secure and reliable handling of enterprise data. SKILLS Must have
- At least 8 years of experience working within data engineering area, preferably within banking industry. Strong hands-on experience with Python for data engineering and automation. Strong experience with Snowflake data warehouse. Advanced knowledge of SQL, including joins, CTEs, window functions, stored procedures, and query optimization. Good understanding of ETL/ELT architecture and data pipeline development. Experience with data ingestion and transformation of large datasets. Good understanding of data warehousing concepts, dimensional modelling, and data marts. Experience with REST APIs and structured/semi-structured formats such as JSON, CSV, and Parquet. Experience with Git and CI/CD practices. Strong debugging and production troubleshooting skills. Nice to have N/A
About Luxoft
Global IT services and consulting company
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Luxoft
Treasury Business Analyst - Dubai, United Arab Emirates
, UAE
Luxoft is seeking a senior Treasury Business Analyst to upgrade treasury applications and support Treasury and Capital Markets initiatives. The role requires 6–10 years of business analysis experience, at least four year
Senior Software Development Engineer in Test (SDET)
Chennai, IND
Senior Forward Deployment Engineer
Jersey City, USA
Senior Forward Deployment Engineer
London, GBR
Treasury Business Analyst - Dubai, United Arab Emirates
, UAE
React Developer - Tech Lead
Chennai, IND
Support Engineer (IAM + AWS + Python)
Bengaluru, IND
Python Developer - Tech Lead
Chennai, IND
Python Developer - Tech Lead
Bengaluru, IND
Senior Software Development Engineer in Test (SDET)
Chennai, IND
