{bc}
greenhouse

Staff Data Engineer

Unite Us
New York City, USA
Senior · 4+ years experience
Onsite
$175,000 - $200,000 / year
Discovered 1 weeks ago
PythonSQLAWSDockerKubernetes

Full Job Posting

Job Requirements

  • Requires at least a Master’s degree or foreign equivalent in Data Science, Applied Computer
  • Science, Computer Science or a related field. Must possess 4 years (48 months) of experience
  • with all of the following: (a) developing and optimizing scalable pipelines using Apache Airflow
  • and Python; (b) building streaming pipelines using Kafka; (c) tuning big data systems using
  • Kafka and Hive; (d) using Spark to create jobs for batch and streaming analytics; (e) writing and
  • using complex SQL queries to retrieve data from data warehouses for analysis and reporting (f)
  • using AWS for data processing and large-volume workloads; (g) automating deployment of code
  • and processes using Python; (h) working with cloud-based infrastructure; (i) building Datadog
  • dashboards to monitor pipelines and system performance; (j) using Docker and Kubernetes to
  • improve and validate containerization and automation reliability; (k) implementing Continuous
  • Integration/Continuous Deployment (CI/CD) using Jenkins; and (l) utilizing all of the following:
  • GitHub as a code repository, Windows and Linux operating systems. Experience may be gained
  • concurrently. Telecommuting available anywhere in the United States.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Unite Us