Big Data Engineer – Java, Apache Spark, AWS EMR, Lambda, EKS & Airflow

Qualifications

• A bachelor’s degree in Computer Science, Information Technology, Engineering or a related field is preferred; equivalent relevant experience may be considered.
• Certifications in AWS, Java, Apache Spark, data engineering or related technical disciplines are preferred but not mandatory.
• Practical training or demonstrated experience in Java, Apache Spark, AWS EMR, AWS Lambda, Amazon EKS and Apache Airflow is required.
• Training or experience in distributed systems, serverless applications, container orchestration and cloud-based data processing is beneficial.
• Commitment to continuous professional development in Java, Apache Spark, AWS services, Apache Airflow and related data engineering practices is expected.
• Professional Competencies
• Applies critical thinking to understand data-processing requirements and design scalable and reliable technical solutions.
• Uses structured problem-solving to troubleshoot pipeline failures, application defects, integration issues and deployment problems.
• Collaborates effectively with engineering, architecture, QA and delivery teams and contributes to shared technical outcomes.
• Communicates implementation decisions, progress, risks, dependencies and technical concerns clearly to relevant stakeholders.
• Adapts to evolving Java, Apache Spark, AWS, serverless, container orchestration and workflow-orchestration technologies.
• Manages priorities, technical dependencies and delivery timelines while maintaining solution quality, reliability and maintainability.
• S YNECHRON’S DIVERSITY & INCLUSION STATEMENT
• Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
• All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
• Candidate Application Notice
• Requirements
• 5+ years of experience in big data engineering, Java development, cloud engineering or a related technical role.
• Experience designing, developing and deploying scalable and reliable data-processing solutions on AWS using Java and Apache Spark.
• Experience implementing big data processing pipelines using Apache Spark on AWS EMR.
• Experience developing and deploying serverless applications using AWS Lambda and integrating them with other AWS services.
• Experience utilizing Amazon EKS for container orchestration and microservices management.
• Experience designing and implementing workflow orchestration using Apache Airflow for complex data pipelines.
• Strong hands-on experience in Java development and proficiency in Apache Spark for distributed data processing.
• Experience with AWS services including EMR, Lambda, EKS and Airflow.
• Experience supporting the deployment, troubleshooting and maintenance of AWS-based data-processing solutions is relevant to the role.
• Candidates may qualify through equivalent experience in Java-based data engineering, distributed data processing, AWS engineering or cloud-based application development that demonstrates the required capabilities.
• Day-to-Day Activities
• Develop, test and deploy Java and Apache Spark data-processing pipelines on AWS EMR and troubleshoot pipeline issues.
• Build and maintain AWS Lambda applications, Amazon EKS services and Apache Airflow workflows in collaboration with technical teams.
• Participate in technical discussions, requirement reviews, code reviews, planning meetings, defect resolution and release activities.
• Make implementation decisions within agreed technical and security standards, document deliverables and communicate progress, risks and dependencies.