{bc}
Apply
workday

Senior Data Engineer

CoStar Group
USA
Full-time
Senior · 5+ years experience
Discovered 3 weeks ago
airflowawsaws-glueazureazure-data-factorybigquery

Full Job Posting

Responsibilities:

  • Design, build, and maintain scalable data pipelines and data platforms
  • Develop and optimize ETL/ELT processes for large, complex datasets
  • Collaborate with engineering, product, DevOps and DBA teams to deliver production systems
  • Contribute to technical design decisions and mentor other engineers on the team

Basic Qualifications:

  • Bachelor's degree required from an accredited, not-for-profit, in-person college/university
  • Track record of commitment to prior employers
  • 5+ years of data engineering experience, including experience setting technical direction on projects and influencing design across a team
  • Hands-on experience building batch and incremental ingestion pipelines from multiple heterogeneous external sources (REST/GraphQL APIs, flat-file and SFTP feeds, third-party data vendors, and database replication/CDC)
  • Demonstrated experience normalizing inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution
  • Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus proficiency in Python, Scala, Java, or C#/.NET
  • Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory)
  • Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
  • Experience with agentic engineering with AI-assisted development tools (Claude Code or similar) to accelerate software delivery
  • Production-scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi)
  • Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
  • Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
  • Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation)
  • Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
  • AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# /.NET
  • AI/ML and feature-engineering pipelines and ability to apply AI assist or agentic workflows for code generation, review and root-cause analysis
  • What’s in it for you?
  • When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.
  • We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, and tuition reimbursement.
  • Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
  • Life, legal, and supplementary insurance
  • Virtual and in person mental health counseling services for individuals and family
  • Commuter and parking benefits
  • 401(K) retirement plan with matching contributions
  • Employee stock purchase plan
  • Paid time off
  • Tuition reimbursement
  • On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
  • Access to CoStar Group’s Employee Resource Groups
  • Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks
  • The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.
  • Base Compensation: $133,000 - $172,000 annually.
  • We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
  • #LI-CH1
  • CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

Preferred Qualifications:

  • Production-scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi)
  • Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
  • Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
  • Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation)
  • Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
  • AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# /.NET
  • AI/ML and feature-engineering pipelines and ability to apply AI assist or agentic workflows for code generation, review and root-cause analysis
  • What’s in it for you?
  • When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.
  • We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, and tuition reimbursement.
  • Our benefits package includes (but is not limited to):
  • Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
  • Life, legal, and supplementary insurance
  • Virtual and in person mental health counseling services for individuals and family
  • Commuter and parking benefits
  • 401(K) retirement plan with matching contributions
  • Employee stock purchase plan
  • Paid time off
  • Tuition reimbursement
  • On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
  • Access to CoStar Group’s Employee Resource Groups
  • Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks
  • The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.
  • Base Compensation: $133,000 - $172,000 annually.
  • We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
  • #LI-CH1
  • CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at CoStar Group

Field Sales Account Executive - Matterport - Los Angeles, CA

Los Angeles, USA

Discovered TodayFull-time

Account Executive, CoStar Data & Analytics - St. Louis, MO

Louisville, USA

Discovered 2 days agoFull-time

Debt Solutions - Lead Software Engineer

, USA

Discovered 2 days agoFull-time

Business Development Consultant, Patch: South Coast, Bournemouth, Southampton, Dorset, OnTheMarket - London

, GBR

Discovered 3 days agoFull-time

Business Development Consultant, Patch: South Coast, Bournemouth, Southampton, Dorset, OnTheMarket - London

, GBR

Discovered 4 days agoFull-time

AI Engineer I - Zonda - Glasgow, Scotland, United Kingdom

Glasgow, GBR

Discovered 4 days agoFull-time

Senior Sales Associate-Homes.com, Inside Sales

, USA

Discovered 4 days agoFull-time

Sales Executive, Residential

Melbourne, AUS

Discovered 5 days agoFull-time