Principal Data Engineer

Location and Work Arrangement

• This is a hybrid remote and in-office role.

About Medidata

Team and Technical Context

Role Responsibilities

• Lead the strategic vision and hands-on execution of an object-centric data fabric for clinical and healthcare datasets.
• Architect an Apache Iceberg data lake strategy with interoperability across Snowflake and heterogeneous compute engines.
• Develop multi-stream ingestion pipelines and use AI-assisted schema inference and ontology alignment.
• Build real-time ingestion pipelines and backend services using Kafka, AWS, Snowflake, Java, or Scala.
• Drive technical strategy for CDC, clustering, migration, aggregation, query optimization, and performance improvement.
• Integrate AI reasoning layers to detect telemetry anomalies and map safety signals to trial datasets.
• Lead TDD and BDD, automated validation, compliance artifacts, lineage manifests, and audit documentation.
• Troubleshoot distributed production environments and implement resilient, self-healing pipelines.

Qualifications

• Bachelor's or Master's degree in a relevant computing field or equivalent practical experience.
• Professional experience in enterprise data engineering and architecture.
• Expert SQL and Snowflake experience with Apache Iceberg data lake architecture.
• Production backend services experience in Java or Scala on AWS.
• Real-time streaming architecture experience, including Kafka, and knowledge of modern data engineering patterns.
• Practical use of AI developer tools for code, SQL, testing, and documentation workflows.
• Experience with Git, CI/CD, TDD, and BDD.
• Understanding of clinical trial workflows, healthcare data models, and GxP, HIPAA, and GDPR standards.

Compensation and Benefits

• Base pay is part of Medidata's total rewards package.
• Many non-sales positions may be eligible for annual bonuses.
• Benefits include insurance, pension, and paid holidays.

Application Notes

• Applications are accepted on an ongoing basis until the position is filled.