Data Solution Architect

Role summary

Architecture and delivery

• Establish a Bronze/Silver/Gold Medallion model and Lambda architecture for batch and streaming.
• Combine Informatica, Spark, and Hive batch processing with Kafka, Hudi, Kudu, HBase, and Phoenix streaming.
• Provide a unified serving layer using Impala, Phoenix, and REST.
• Architect a rules engine for business validations and transformations.
• Design governance using Ranger, Atlas, Knox, KMS, and SDX for security, lineage, quality, and compliance.

Required qualifications

• 10+ years in data architecture/engineering, including 3–5+ years architecting Cloudera CDH/CDP in production.
• Proven delivery of on-premises lakehouses using Medallion and Lambda architectures; sound data engineering standards knowledge.
• Good understanding of Informatica DEI framework/pattern design and pushdown to Spark/Hive.
• Practical exposure to Iceberg, Hudi, Kudu, HBase with Phoenix, Hive 3, and Impala, including workload fit, partitioning, compaction, and statistics.
• Strong SQL expertise, including windowing, partitioning, MERGE/UPSERT, cost-based tuning, and Impala/Phoenix performance tuning.
• Knowledge of Kerberos, TLS, AD/LDAP, Ranger policies, Atlas lineage/glossary, and SDX concepts.
• Experience designing metadata-driven rules engines and data-quality frameworks for batch and streaming.
• Solid Linux fundamentals, Git/CI/CD, documentation, and stakeholder communication.

Preferred qualifications

• Kafka patterns (exactly-once, schema registry, compaction) and CDC from RDBMS.
• Familiarity with Ozone, KMS/Key Trustee, and air-gapped deployments.
• SRE practices including SLOs, error budgets, RCA, and chaos/drill exercises.
• Cloudera CDP, Informatica, or security certifications such as CISSP/CCSP; certifications are a plus.
• Regulatory experience in PII/PCI/SOX/GDPR environments.