Software Engineer

Role overview

Responsibilities

• Build scalable data catalog components and automate governance processes; integrate the catalog with Databricks and other platforms.
• Develop data quality, profiling, and classification solutions.
• Lead technical design discussions, guide architecture, and promote strong engineering practices.
• Assess trade-offs, identify technical risks, and propose scalable long-term solutions.
• Mentor junior engineers and work with stakeholders and product managers to align data infrastructure with product goals.

Requirements

• Bachelor’s or master’s degree in computer science, engineering, or a related field.
• Understanding of design patterns, lakehouse architecture, and backend and frontend frameworks.
• Strong programming skills in Python and/or Java; experience with Databricks, Unity Catalog, Delta Lake, and Apache Spark.
• Experience with enterprise data catalogs, data quality frameworks, data security, and access control.
• Understanding of governance, metadata management, and lineage.
• Cloud platform and infrastructure-as-code experience, including Azure or GCP and Terraform.
• Familiarity with REST APIs, microservices, distributed designs, and streaming technologies such as Kafka or structured streaming.
• Strong analytical problem-solving skills and understanding of product development and data infrastructure.

Benefits

• Offers professional development, tuition assistance, bonus, flexible vacation, personal and sick days, and benefits starting on the first day.
• Provides employee resource groups, accessibility accommodations, and opportunities for community engagement.