Engineer Sr., Software
Role Overview
The Software Engineer Team Member is part of the Marketing Technology Team; under general direction, they will design, develop, and implement systems to ensure customer requirements are met in a timely and cost-effective manner.
The role is responsible for enterprise Marketing Technology.
Key development responsibilities include the development of internal systems, management & integration of third-party software systems, and systems support.
Key Skills for This Role
Full Job Posting
Experience Required: 5 to 10 years Experience Desired: Experience working in Data Engineering + retail supply chain environment Education Desired: Bachelors Degree Job Responsibilities
Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake.·
Develop ingestion frameworks to bring data from databases, APIs, files, and third-party marketing platforms into the Lakehouse.·
Build and maintain curated data models using the medallion (bronze/silver/gold) architecture for analytics, reporting, and marketing use cases.·
Implement data governance, security, and access control using Unity Catalog.·
Build data quality checks, validation, and monitoring to ensure the accuracy, completeness, and reliability of data.·
Orchestrate and schedule pipelines using Databricks Workflows/Jobs and Azure Data Factory where applicable.·
Optimize Spark jobs, cluster configurations, and Delta tables (partitioning, Z-ordering, file compaction) for performance and cost.· Support the migration and modernization of legacy Oracle-based ETL and PL/SQL processes to Databricks.·
Collaborate with data analysts, data scientists, business stakeholders, and application teams to deliver data solutions.·
Troubleshoot and resolve pipeline failures, data issues, and performance bottlenecks.
Qualifications
- Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake.·
- Develop ingestion frameworks to bring data from databases, APIs, files, and third-party marketing platforms into the Lakehouse.·
- Build and maintain curated data models using the medallion (bronze/silver/gold) architecture for analytics, reporting, and marketing use cases.·
- Implement data governance, security, and access control using Unity Catalog.·
- Build data quality checks, validation, and monitoring to ensure the accuracy, completeness, and reliability of data.·
- Orchestrate and schedule pipelines using Databricks Workflows/Jobs and Azure Data Factory where applicable.·
- Optimize Spark jobs, cluster configurations, and Delta tables (partitioning, Z-ordering, file compaction) for performance and cost.· Support the migration and modernization of legacy Oracle-based ETL and PL/SQL processes to Databricks.·
- Collaborate with data analysts, data scientists, business stakeholders, and application teams to deliver data solutions.·
- Troubleshoot and resolve pipeline failures, data issues, and performance bottlenecks.
Preferred Qualifications
- Required: 5 to 10 years Experience Desired: Experience working in Data Engineering + retail supply chain environment Education Desired: Bachelors Degree Job Responsibilities
About Giant Eagle
Regional supermarket chain operating stores and retail pharmacies.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Giant Eagle
Business Analyst
, IND
Analyst Associate, Quality Assurance
, IND
Medina Giant Eagle Team Member
Madinah, KSA
Associate Manager, Merchandising Data Operations
, IND
Dairy Lead
Madinah, KSA
Baker
Madinah, KSA
Giant Eagle and Market District Opportunities
Pittsburgh, USA
Engineer, Software
, IND