Software Engineer (Java/Big Data)

What you’ll do

What experience you need

What could set you apart

Responsibilities

• Design, develop, and operate high scale applications across the full engineering stack.
• Design, develop, test, deploy, maintain, and improve software.
• Apply modern software development practices (serverless computing, microservices architecture, CI/CD, infrastructure-as-code, etc.)
• Work across teams to integrate our systems with existing internal systems, Data Fabric, CSA Toolset.
• Participate in technology roadmap and architecture discussions to turn business requirements and vision into reality. Participate in a tight-knit, globally distributed engineering team.
• Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
• Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
• Implement security best practices in pipelines and infrastructure.
• Develop and implement data quality checks and troubleshoot data anomalies.
• What experience you need
• Bachelor's degree or equivalent experience
• 5+ years of software engineering experience
• 5+ years experience with Cloud technology: GCP, AWS, or Azure
• 5+ years experience designing and developing microservices using Java, SpringBoot, GCP SDKs, GKE/Kubernetes
• Intermediate level understanding and experience with Google Cloud Platforms and overall cloud computing concepts, as well as basic knowledge of other cloud environments
• Experience building and maintaining moderately-complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects
• Experience designing and implementing moderately complex data models and experience enabling optimization to improve performance
• Demonstrates advanced Git usage and CI/CD integration skills
• What could set you apart
• Experience designing and developing big data processing solutions using Dataflow/Apache Beam, Bigtable, BigQuery, PubSub, GCS, Composer/Airflow, and others
• Any AI Model Development Experience
• In-depth, hands-on experience with BigData tools such as Apache Spark or Apache Beam.
• Proven experience with Google Cloud Platform (GCP) services that include Dataflow, Dataproc, BigQuery, and Pub/Sub.
• Experience with workflow orchestration tools like Apache Airflow (or GCP's Cloud Composer).
• Solid understanding of data modeling, data warehousing, and ETL/ELT best practices.
• Background of Large Data Analysis and building AI ML Models would be a huge plus.
• Excellent problem-solving skills and the ability to troubleshoot complex distributed systems.
• Effective communication and collaboration skills, with the ability to articulate technical concepts to both technical and non-technical stakeholders
• #LI-Hybrid!! #LI-KC1
• We offer comprehensive compensation and healthcare packages, 401k matching, paid time off, and organizational growth potential through our online learning platform with guided career tracks.
• Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference!
• Primary Location:
• Function