{bc}
oracle

Enterprise Data Architect – Customer Data Platform (Azure Databricks Lakehouse)

Southern Company Services
Birmingham, USA
Full-time
Senior · 8+ years experience
Onsite
Discovered 2 weeks ago
azuredatabricksdelta-lakekafkaqliksap

Full Job Posting

About the role

You will lead the design, governance, and evolution of the Lakehouse, working at the intersection of enterprise architecture, data engineering, and utility business operations. You will define how CIS data is replicated, secured, and consumed across the enterprise, supporting both batch and near-real-time needs, and you will partner with enterprise architects, application teams, cybersecurity, vendors, and business stakeholders to turn business priorities into scalable solutions.

What you will do

  • Own the end-to-end architecture and strategic direction of the Lakehouse, from ingestion through consumption, including medallion design patterns and Delta Lake implementation.
  • Architect near-real-time and batch replication of CIS data, and lead decisions on Change Data Capture (CDC), streaming, and integration technologies to meet defined service level objectives.
  • Guide data engineers who are defining logical and physical data models and the standards that support operational reporting, business intelligence, advanced analytics, data products, and regulatory needs.
  • Establish standards for data quality, lineage, cataloging, observability, and metadata management using Unity Catalog and enterprise metadata tools.
  • Design and govern the integration patterns that downstream operational, analytical, and regulatory applications use to consume customer, billing, metering, and premise data.
  • Partner with cybersecurity, privacy, and compliance teams on access control, encryption, masking, and regulatory controls, and design for high availability, disaster recovery, and operational resilience.
  • Work with data engineers, and data science and analytics teams to create architectural patterns for machine learning, generative AI, and advanced analytics that stay within governance and security standards.
  • Provide technical governance for vendor, consulting, and system integration partners, building collaborative relationships grounded in shared accountability.
  • Lead and mentor data engineering teams through architecture reviews and design guidance, and maintain reference architectures, architecture decision records, and multi-year roadmaps.
  • Optimize platform capacity and cost across Databricks and Azure, support major incident investigations and root cause analysis, and evaluate emerging technologies that improve the platform.
  • What Success looks like
  • A trusted, governed, and highly available CIS data ecosystem.
  • A scalable Lakehouse architecture that supports enterprise reporting, analytics, and operational workloads.
  • Consistent data standards, quality controls, and architectural governance across data domains.
  • Reusable architecture patterns that reduce integration complexity.
  • Clear roadmaps that align technology investment with business priorities, with platform performance and cost kept in check.
  • What you bring (required)
  • Experience: Bachelor’s degree in computer science, Information Systems, or a related discipline, and at least 8 years of progressive experience in data architecture, data engineering, or analytics platform engineering, including at least 3 years in a senior architecture or technical leadership role.
  • Platform: You have led the architecture of a production, enterprise-scale Azure Databricks Lakehouse, with hands-on depth in Delta Lake, Unity Catalog, and Azure Data Lake Storage Gen2.
  • Data movement: You have designed and delivered CDC and replication from a transactional source system into a lakehouse or warehouse, supporting batch and near-real-time loads (for example, with Qlik Replicate, HVR, Fivetran, Debezium, GoldenGate, or equivalent tools).
  • Modeling and governance: You are strong in data modeling (dimensional, Data Vault, or canonical models) and in governing data quality, metadata, lineage, and security controls such as role-based access, classification, and masking.
  • Standards leadership: You have established architecture standards, run architecture reviews, and driven adoption of engineering practices across multiple delivery teams.
  • Communication: You communicate and influence effectively with executives, engineers, vendors, and business stakeholders, and you can balance business priorities, risk, and cost in your decisions.
  • What sets you apart (preferred)
  • Experience with a utility CIS such as Oracle Customer to Meter (C2M), Oracle CC&B, SAP IS-U, or Cayenta. Experience with comparable high-volume customer or billing platforms in telecom, financial services, healthcare, or retail also translates well.
  • Knowledge of utility processes such as billing, collections, meter-to-cash, revenue assurance, rates, and regulatory reporting, and familiarity with NERC CIP and state public utility commission requirements.
  • Experience with Apache Spark, Delta Live Tables, Structured Streaming, Databricks Workflows, Event Hubs, or Kafka.
  • Experience with platform resiliency, FinOps, and capacity planning on Azure and Databricks.
  • Experience with Agile, SAFe, and product-oriented delivery models.
  • Master’s degree, or Azure, Databricks, or architecture certifications.
  • What we value
  • Business value mindset. You deliver business outcomes, not just technical solutions.
  • Ownership and accountability. You take personal responsibility for commitments and follow through without needing close oversight.
  • Collaborative leadership. You build trust across business and technology teams and influence constructively at every level.
  • Constructive courage. You challenge assumptions and raise concerns early, with diplomacy and candor, even when it is unpopular.
  • Stewardship and integrity. You act as a trusted steward of enterprise data, holding to high standards of security, compliance, and integrity.
  • First 12 months
  • Close the highest-risk gaps in data quality, latency, lineage, and access control.
  • Stand up a working architecture-review practice so new pipelines and data products follow the standard.
  • Baseline platform reliability and cost and use that baseline in capacity and design decisions.
  • Craft a written roadmap that ties the next platform investments to customer and revenue priorities.
  • This job description does not, nor is it intended to represent an exhaustive listing of all duties, tasks or responsibilities for the position listed. Based upon individual experience and team workload, responsibilities are assigned in varying degrees.

Qualifications

  • Bachelor’s degree in computer science, Information Systems, or a related discipline, and at least 8 years of progressive experience in data architecture, data engineering, or analytics platform engineering, including at least 3 years in a senior architecture or technical leadership role.
  • Platform: You have led the architecture of a production, enterprise-scale Azure Databricks Lakehouse, with hands-on depth in Delta Lake, Unity Catalog, and Azure Data Lake Storage Gen2.
  • Data movement: You have designed and delivered CDC and replication from a transactional source system into a lakehouse or warehouse, supporting batch and near-real-time loads (for example, with Qlik Replicate, HVR, Fivetran, Debezium, GoldenGate, or equivalent tools).
  • Modeling and governance: You are strong in data modeling (dimensional, Data Vault, or canonical models) and in governing data quality, metadata, lineage, and security controls such as role-based access, classification, and masking.
  • Standards leadership: You have established architecture standards, run architecture reviews, and driven adoption of engineering practices across multiple delivery teams.
  • Communication: You communicate and influence effectively with executives, engineers, vendors, and business stakeholders, and you can balance business priorities, risk, and cost in your decisions.
  • Experience with a utility CIS such as Oracle Customer to Meter (C2M), Oracle CC&B, SAP IS-U, or Cayenta. Experience with comparable high-volume customer or billing platforms in telecom, financial services, healthcare, or retail also translates well.
  • Knowledge of utility processes such as billing, collections, meter-to-cash, revenue assurance, rates, and regulatory reporting, and familiarity with NERC CIP and state public utility commission requirements.
  • Experience with Apache Spark, Delta Live Tables, Structured Streaming, Databricks Workflows, Event Hubs, or Kafka.
  • Experience with platform resiliency, FinOps, and capacity planning on Azure and Databricks.
  • Experience with Agile, SAFe, and product-oriented delivery models.
  • Master’s degree, or Azure, Databricks, or architecture certifications.
  • What we value
  • Business value mindset. You deliver business outcomes, not just technical solutions.
  • Ownership and accountability. You take personal responsibility for commitments and follow through without needing close oversight.
  • Collaborative leadership. You build trust across business and technology teams and influence constructively at every level.
  • Constructive courage. You challenge assumptions and raise concerns early, with diplomacy and candor, even when it is unpopular.
  • Stewardship and integrity. You act as a trusted steward of enterprise data, holding to high standards of security, compliance, and integrity.
  • First 12 months
  • Close the highest-risk gaps in data quality, latency, lineage, and access control.
  • Stand up a working architecture-review practice so new pipelines and data products follow the standard.
  • Baseline platform reliability and cost and use that baseline in capacity and design decisions.
  • Craft a written roadmap that ties the next platform investments to customer and revenue priorities.
  • This job description does not, nor is it intended to represent an exhaustive listing of all duties, tasks or responsibilities for the position listed. Based upon individual experience and team workload, responsibilities are assigned in varying degrees.

Preferred Qualifications

  • What sets you apart (preferred)

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Southern Company Services