Senior Principal Architect, EDT Data Architecture Strategy & Standards

What you will do:

• Architecture Strategy, Standards & Best Practices:
• Define and own the enterprise data & analytics reference architecture and multi-year roadmap across the Azure Lakehouse estate, while staying directly engaged in solution design, prototyping, and technical validation across ADLS, Databricks, Delta Lake, Unity Catalog, Power BI, Databricks Genie, and Copilot-based AI experiences.
• Build and maintain working reference implementations and reusable blueprints for lakehouse zoning, Delta table design, ingestion and orchestration, semantic models, and Unity Catalog security patterns; validate each standard through executable code, deployment scripts, and representative data workloads.
• Design Authority & Decision Intervention:
• Co-chair the architecture review board with formal approval rights at defined design gates; review solution artifacts in detail, challenge design assumptions, document Architecture Decision Records, and personally validate high-risk decisions through targeted prototypes or code reviews.
• Step into critical initiatives when architectural drift or technical blockers emerge, working side by side with engineers in design sessions, notebooks, repositories, and pull requests to troubleshoot issues, refactor solutions, and steer delivery toward the approved pattern.
• Engineering & Technical Leadership:
• Personally design and build end-to-end batch and streaming solutions, including CDC ingestion, Auto Loader, Databricks Workflows/DLT, ADF orchestration, and PySpark/SQL medallion transformations, using realistic enterprise data and production-grade engineering practices.
• Review production code and pipeline design at the pull-request level, reproduce performance issues, tune Spark jobs and compute configurations, assess DBU efficiency, and pair with engineers to implement and verify improvements.
• Create and exercise engineering lifecycle standards for data quality, automated testing, CI/CD, observability, lineage, and recovery; run PoCs, architecture spikes, and hands-on solution health assessments before standards are adopted broadly.
• Serve as the senior technical counterpart to Microsoft and Databricks by testing preview capabilities in sandbox environments, documenting findings, and converting vendor direction into practical reference patterns, guardrails, and implementation recommendations.
• What you need:
• Bachelor’s or master’s degree from an accredited university in the areas of Computer science, Engineering, Information Systems, Business, or equivalent field of study required.
• 10+ years of progressive experience in data engineering, data architecture, and analytics across large, global enterprises, including recent hands-on delivery on Azure/Databricks Lakehouse platforms.
• Demonstrated design and build depth: Ability to walk through data platforms and pipelines they have personally architected and implemented — not solely governance, advisory, or oversight experience.
• Expert-level command of the core stack: Azure, ADLS, Databricks (Spark, Delta Lake, Unity Catalog, Workflows/DLT), modern data engineering practices, and Power BI, with good knowledge of Databricks Genie and Microsoft Copilot.
• Proven experience defining and operationalizing enterprise architecture standards, reference architectures, and design authority or architecture review processes.
• Track record of influencing and redirecting technical decisions across engineering teams through credibility and expertise, including intervening in in-flight designs and driving remediation.
• Strong grounding in data security, privacy, and regulated-environment requirements (e.g., GxP, HIPAA, PII/PHI handling) and how they translate into architectural controls.
• Excellent communication skills, with the ability to operate credibly in both executive forums and deep technical design sessions.