Data Platform Engineer

Role overview

Education and experience

• Bachelor’s degree in Computer Science or a related field.
• 3–5 years of relevant experience in data platforms, data infrastructure, big data platforms, or a similar technical role.
• Practical enterprise or on-premises data platform implementation and administration experience is preferred.

Required platform skills

• Strong hands-on data platform administration, including installation, configuration, maintenance, and troubleshooting.
• Hands-on MinIO with Apache Iceberg experience in a Data Lake or Data Lakehouse environment.
• Hands-on experience with Starburst or Dremio.
• Experience deploying and supporting on-premises data platforms and managing Development, QA, and Production environments.
• Experience integrating platforms with IAM/PAM and enterprise security components; working knowledge of Git/version control.
• Good understanding of Data Lake and Data Lakehouse architecture.

Additional skills

• Good-to-have skills include Apache Spark, Informatica, Docker, Kubernetes, CI/CD, Terraform or Ansible, SQL, monitoring and observability tools, high availability and disaster recovery concepts, and backup and recovery experience.

Responsibilities

• Install, configure, and administer data platform components across Development, QA, and Production.
• Deploy and support MinIO with Apache Iceberg and Starburst or Dremio on VMware-based on-premises infrastructure.
• Integrate platform components with Git, IAM/PAM, and enterprise security systems; configure access, connectivity, and certificates.
• Monitor performance, availability, capacity, and health; troubleshoot platform, infrastructure, configuration, integration, and connectivity issues.
• Support upgrades, patching, backup and recovery, and routine operational maintenance; ensure security and operational requirements are met.
• Collaborate with Data, Infrastructure, Security, and DevOps teams; maintain technical documentation, deployment procedures, and operational runbooks.

Engagement

• Engagement duration is stated as 3–5 months.