Data Solution Architect

Role summary

Architecture and delivery

• Establish a Bronze/Silver/Gold Medallion model and implement Lambda architecture.
• Blend batch processing with Informatica, Spark, and Hive and streaming with Kafka, Hudi, Kudu, HBase, and Phoenix.
• Build a unified serving layer with Impala, Phoenix, and REST.
• Architect a rules engine for business validations and transformations.
• Design governance for security, lineage, quality, and compliance using Ranger, Atlas, Knox, KMS, and SDX.

Required qualifications

• 10+ years in data architecture/engineering and 3–5+ years architecting Cloudera CDH/CDP in production.
• Proven delivery of on-premises lakehouse implementations with Medallion and Lambda architectures.
• Knowledge of data engineering standards and best practices; Informatica DEI framework and Spark/Hive pushdown.
• Practical experience with Iceberg, Hudi, Kudu, HBase/Phoenix, Hive 3, and Impala, including workload fit, partitioning, compaction, and statistics.
• Strong SQL, including windowing, partitioning, MERGE/UPSERT, cost-based tuning, and Impala/Phoenix performance tuning.
• Experience with Kerberos, TLS, AD/LDAP, Ranger policies, Atlas lineage/glossary, and SDX concepts.
• Experience designing metadata-driven rules engines and data-quality frameworks for batch and streaming.
• Solid Linux fundamentals, Git/CI/CD, documentation, and stakeholder communication.

Preferred qualifications

• Kafka patterns such as exactly-once processing, schema registry, compaction, and CDC from RDBMS are preferred.
• Familiarity with Ozone, KMS/Key Trustee, air-gapped deployments, and SRE practices is preferred.
• Cloudera CDP, Informatica, or security certifications such as CISSP/CCSP are a plus.
• Regulatory experience in PII, PCI, SOX, or GDPR environments is preferred.