Lead Software Engineer - Data Platform

Role Overview

Job Responsibilities

• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches.
• Designs, builds, and maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink.
• Drives team adoption of enterprise-authorized AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including AI-assisted development and automation capabilities.
• Designs, builds, and manages enterprise applications at scale to ensure robust and fault-tolerant data processing and ingestion.
• Leads the design and evolution of event-driven microservices workflows using Kafka for inter-service communication and reliable asynchronous processing.
• Implements data modeling strategies (fact and dimensional, wide tables) to support analytics, reporting, and downstream consumption.
• Partners with analytics teams, product managers, and business stakeholders to translate requirements into production-grade solutions.
• Sets and upholds engineering standards for the team's Spring Boot services including API design, error handling, security, logging, performance tuning, and versioning.
• Ensures production readiness through observability, alerting, incident response runbooks, and proactive problem management.
• Develops secure high-quality production code and reviews and debugs code written by others.
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability.

Required Qualifications, Capabilities, and Skills

• Formal training or certification on software engineering concepts and 5+ years of applied experience.
• Hands-on practical experience delivering system design, application development, testing, and operational stability.
• Demonstrated professional experience focused on software engineering or data platform development.
• Demonstrated experience leading effective use of approved AI-assisted software development tools with ability to set team expectations for validating AI outputs.
• Strong understanding of responsible AI use in engineering workflows including data sensitivity, secure handling of inputs/outputs, and adherence to resiliency and security expectations.
• Advanced in one or more programming languages such as Python, Java, and SQL.
• Hands-on experience with distributed data processing frameworks such as Apache Spark and Flink.
• Solid understanding of data modeling techniques (star schema, snowflake) and query optimization.
• Experience designing and operating data pipelines on Databricks using orchestration tools such as Apache Airflow.
• Proficiency with cloud data services (AWS S3, Glue, Redshift, Athena, EMR, Lake Formation, or equivalent).
• Experience engineering production-grade data platforms on Kubernetes with open catalog integration (e.g., Apache Iceberg, Unity Catalog, OpenMetadata).

Preferred Qualifications, Capabilities, and Skills

• Experience with Agentic AI, LLMs, RAG architectures, vector databases, and embedding-based retrieval systems.
• Hands-on familiarity with Internal Developer Portals such as Backstage including service catalog management, software templating, and plugin development.
• Experience with data mesh or data product architectures.
• Proficiency with Infrastructure as Code (Terraform) and containerized deployments (Docker, Kubernetes).
• Experience with data observability, quality, and metadata management tools.
• Experience with semantic layers, metrics stores, or BI platforms (Tableau, dbt Metrics).

Compensation and Benefits

• Competitive total rewards package including base salary determined based on role, experience, skill set, and location.
• Eligible roles may receive commission-based pay and/or discretionary incentive compensation.
• Benefits include comprehensive health care coverage, on-site health and wellness centers, retirement savings plan, backup childcare, tuition reimbursement, mental health support, and financial coaching.

About JPMorganChase

Equal Opportunity

• JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans.
• Reasonable accommodations available for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.