Lead AWS Data Engineer (PPM)

Key Responsibilities:

• Own the technical build of PPM ingestion, transformation and curated data products.
• Define source mappings, event schemas, data-quality controls, time alignment and replay/recovery handling.
• Deliver forecast-ready and optimization-ready datasets across the medallion layers.
• Coordinate interfaces with forecasting models, the optimization engine, dashboards and APIs.
• Lead code reviews, performance tuning, reconciliation, deployment and engineering standards for the PPM pod.
• Technical skills required:
• Confluent Kafka, connectors, Schema Registry, Flink and event-driven pipeline design
• AWS Glue, Lambda, Step Functions, S3 Bronze/Silver/Gold layers and Aurora PostgreSQL
• Python, SQL, data modelling, data-quality frameworks, reconciliation and orchestration
• Batch and near-real-time integration from SCADA, OSI PI, ABT/MDM, SAP, GIS, SLDC/RLDC, IEX and weather feeds
• Power portfolio concepts including demand, generation, renewable availability, contracts, schedules, market bids, actuals and deviation