{bc}
greenhouse

Microbiologist IV (Genomic Data Engineer)

Great Hill Solutions
Atlanta, USA
Full-time
Senior
Onsite
Discovered 1 months ago
Hadoop Distributed File System (HDFS)Apache SparkApache HiveApache ImpalaGitPython

Full Job Posting

Job Description

Develop, maintain, and optimize distributed data pipelines using Hadoop ecosystem tools (Hadoop Distributed File System, Spark, Hive, Impala).

Manage large-scale ETL workflows involving genomic, epidemiological, and laboratory datasets to support bioinformatic workflows.

Implement and optimize data validation, transformation, harmonization, and standardization workflows to ensure consistent, high-quality outputs.

Ingest, harmonize, and manage genomic datasets from external repositories (e.g., NCBI GenBank, Sequence Read Archive) and maintain pipelines for routine updates and submissions.

Work with genomic sequence files and associated metadata and integrate them into epidemiological and laboratory surveillance systems.

Ensure appropriate handling of sensitive public health data and compliance with data governance expectations.

Maintain reproducible workflows and version-controlled pipelines (e.g., Git) and prepare associated technical documentation.

Collaborate with bioinformaticians, laboratory scientists, and epidemiologists to translate scientific questions into scalable engineered data workflows.

Support development of analytical methods for outbreak detection and situational awareness, including Spark/SQL-based analysis.

Document advanced data lineage, governance processes, or other high-level data management structures beyond required quality controls.

Prepare reports, summaries, or scientific communication materials, and contribute to publications when appropriate.

Be proficient in common programming or scripting languages, such as Python, Rust, Scala, and/or Bash

Be present on site and attend weekly team meetings and provide updates on data engineering activities, pipeline performance, and ongoing tasks.

Education and Experience

Bachelor's degree in Bioinformatics, Data Science, Genomics, Computational Biology or a related field.

Master's degree is preferred in a relevant technical or scientific discipline.

Required Skils/Qualifications

  • Proficiency with Hadoop ecosystem technologies, including: Hadoop Distributed File System (HDFS), Apache Spark, Apache Hive, Apache Impala,
  • Strong experience in data engineering, ETL development, and large-scale data integration.
  • Experience with genomic, laboratory, epidemiological, or public health datasets.
  • Ability to develop and optimize data validation, transformation, harmonization, and standardization processes.
  • Experience ingesting and managing datasets from external genomic repositories such as NCBI GenBank and Sequence Read Archive (SRA).
  • Proficiency working with genomic sequence files and associated metadata.
  • Experience with version control systems, particularly Git.
  • Knowledge of data governance, data quality management, and secure handling of sensitive health-related information.
  • Proficiency in one or more programming and scripting languages such as: Python, Scala, Rust, Bash.
  • Strong analytical, problem-solving, and technical documentation skills.
  • Ability to collaborate effectively with multidisciplinary teams including bioinformaticians, epidemiologists, and laboratory scientists.
  • Ability to work on-site and participate in regular team meetings and project updates.

Desirable Skills/Qualifications

  • Master's degree or higher in Bioinformatics, Computational Biology, Computer Science, Data Science, Public Health Informatics, or a related discipline.
  • Experience supporting pathogen genomics and infectious disease surveillance programs.
  • Advanced experience with Spark-based analytics and large-scale distributed computing environments.
  • Familiarity with bioinformatics workflows, genomic analysis pipelines, and sequence data management.
  • Experience with analytical methods related to outbreak detection and situational awareness.
  • Knowledge of public health surveillance systems and laboratory information management systems.
  • Experience creating and maintaining data lineage documentation and enterprise data governance frameworks.
  • Experience contributing to technical reports, scientific publications, or peer-reviewed research.
  • Familiarity with cloud-based data platforms and modern data engineering practices.
  • Strong communication skills with the ability to translate scientific and public health requirements into scalable technical solutions.
  • Equal Opportunity Statement: Seneca Holdings provides equal employment opportunities to all employees and applicants without regard to race, color, religion, sex/gender, sexual orientation, national origin, age, disability, marital status, genetic information and/or predisposing genetic characteristics, victim of domestic violence status, veteran status, or other protected class status. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leave of absence, compensation and training. The Company also prohibits retaliation against any employee who exercises his or her rights under applicable anti-discrimination laws. Notwithstanding the foregoing, the Company does give hiring preference to Seneca or Native individuals. Veterans with expertise in these areas are highly encouraged to apply.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Great Hill Solutions