SENIOR CONSULTANT

About Atos Group

Key responsibilities

• Inventory and baseline current Lambda functions, Dagster pipelines, dbt models, MySQL ODS flows and Kafka feeds, document lineage, schedules, SLAs and failure paths.
• Design and build Glue‐based ingestion, transformation, and cataloguing patterns (Glue jobs, Glue Catalog, Crawlers) with Lambda/Step Functions/Event Bridge orchestration.
• Implement S3 Bronze landing with lifecycle/archive policies, Redshift Silver conformance and Gold canonical data products (Customer, Loan, Collections, Risk).
• Build automated data‐quality gates, reconciliation checks, and source‐to‐report lineage; support the enterprise data dictionary and certification of business‐critical reports
• Implement IAM, AWS‐native encryption, Secrets Manager and Gold‐layer RBAC/least‐privilege access.
• Establish Dev/Test environments, Git‐based CI/CD, schema version control (Liquibase) and controlled release promotion; monitoring and recovery via CloudWatch.
• Migrate and reconcile workloads wave by wave against baselines; decommission ODS dependencies and replace reverse flows with governed interfaces.
• Optimise Redshift performance and cost (WLM, sort/Dist keys, materialised views).
• Mentor engineers, own technical quality assurance of deliverables, and work with Data Owners/Champions and Atos architects in an Agile setup.

Mandatory skills

• 10+ years in data engineering, 5+ Experience in AWS data platforms.
• Amazon Redshift (deep): data modelling, performance tuning, WLM, RBAC, external schemas/Spectrum.
• AWS Glue (jobs, Glue Catalog, Crawlers) and hands‐on medallion (Bronze/Silver/Gold) implementation on S3 + Redshift.
• AWS Lambda, Step Functions, S3, IAM, CloudWatch, Secrets Manager.
• Advanced SQL, dimensional/canonical data modelling, ETL/ELT frameworks.
• Python (primary) — PySpark for Glue jobs.
• MySQL (operational data store) and CDC/batch extraction patterns.
• DBT— must be able to read, reverse‐engineer, and migrate existing dbt models.
• Data‐quality frameworks, reconciliation, and lineage/metadata practices.
• Git, CI/CD pipelines, database schema version control (Liquibase or equivalent), Dev/Test/Prod promotion.
• Leadership, mentoring, stakeholder management; ability to work independently in Agile.

Nice to have

• Dagster orchestration — for AS‐IS discovery and migration.
• Kafka / event‐driven streaming ingestion.
• Apache Iceberg on S3, Apache Spark/EMR
• Tableau, Metabase serving‐layer knowledge.
• Infrastructure as Code (Terraform/CloudFormation).
• Data‐governance tooling (Glue Data Quality, Data Zone, Lake Formation).
• UK financial‐services experience: IFRS 9, BCBS 239, FCA/PRA reporting, UK GDPR.
• Preparing governed datasets for AI/ML use cases.
• Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.
• Atos is a recognized leader in its industry across Environment, Social and Governance (ESG) criteria. Find out more on our CSR commitment.
• Choose your future. Choose Atos.