Software Engineering Consultant II/Senior Consultant I
Role Overview
The Software Engineer Consultant II implements applications following 12-factor principles to build out the product and iterative enhancements.
They partner on full stack of software products; developing and implementing frontends (web or mobile), and backend services.
They leverage test driven development and continuous integration to ensure agility and quality of products.
We are seeking a highly motivated Data Engineer with expertise in Apache Spark (Scala), Python, SQL, MongoDB, and Java to design, develop, and maintain scalable data processing solutions.
Key Skills for This Role
Full Job Posting
Job Overview
The Software Engineer Consultant II implements applications following 12-factor principles to build out the product and iterative enhancements.
They partner on full stack of software products; developing and implementing frontends (web or mobile), and backend services.
They leverage test driven development and continuous integration to ensure agility and quality of products.
We are seeking a highly motivated Data Engineer with expertise in Apache Spark (Scala), Python, SQL, MongoDB, and Java to design, develop, and maintain scalable data processing solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Apache Spark and Scala.
- Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.
- Develop data processing and automation solutions using Python and Java.
- Design and implement data models, data transformation logic, and data integration workflows.
- Work with MongoDB, relational databases, and data warehouses to manage and access data efficiently.
- Write complex and optimized SQL queries, stored procedures, and performance tuning solutions.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Participate in daily standups, sprint planning, retrospectives, and other Agile ceremonies.
- Contribute to solution architecture, technical design discussions, and technology decisions.
- Implement data quality, validation, monitoring, and governance controls.
- Troubleshoot and resolve data pipeline failures and performance bottlenecks.
- Build and maintain CI/CD pipelines and deployment processes for data engineering solutions.
Primary Skills
- Software Development
About Allstate
The Allstate Corporation is one of the largest publicly held insurance providers in the United States.
Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue.
Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation.
The India talent center was set up in 2012 and operates under the corporation's Good Hands promise.
With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Allstate Insurance
Analyst, Business Intelligence
Toronto, CAN
Allstate is seeking a business intelligence analyst to deliver reporting and analytics that support data-driven decisions and operational performance. The role requires expertise in Microsoft Fabric ETL Pipelines, SQL, P
Senior Analyst, Business Intelligence -
Toronto, CAN
Allstate is seeking a Senior Business Intelligence Analyst to turn complex data into actionable insights for operations and customer-focused decisions. The role develops reporting, forecasts, and recommendations while pa
Provincial Product Analyst
, CAN
Allstate is seeking a Provincial Product Analyst to support business decisions through performance monitoring, reporting, analytics, and actionable insights. Candidates need Power BI and data visualization experience, st
Property Field Claims Manager
, CAN
Allstate is seeking a Property Field Claims Manager to lead field property claims operations and develop a team of Property Field Advisors across Ontario. Candidates need at least five years of progressive property claim
Commercial and Privacy Counsel
Toronto, CAN
Allstate is seeking a Commercial and Privacy Counsel to advise business leaders on commercial, privacy, data, technology, and emerging technology matters. The role supports contracting, regulatory analysis, privacy progr
Software Engineer Consultant I
, IND
Allstate is seeking a Senior Data Engineer to design and support enterprise-scale data platforms and pipelines for analytics, reporting, and AI/ML. The role requires strong Apache Spark, cloud data platform, and lakehous
Vended Application Senior Consultant II
, IND
Allstate is seeking a highly experienced engineer to build scalable application and AI-enabled solutions, including secure generative AI and agentic workflows. The role calls for 5+ years in software engineering, strong
Software Engineer Lead Consultant
, IND
Allstate is seeking a technical lead consultant to design and deliver digital insurance applications using Guidewire ProducerEngage, Jutro, React, and TypeScript. The role includes solution design, integrations, technica
Analyst, Business Intelligence
Toronto, CAN
Senior Analyst, Business Intelligence -
Toronto, CAN
Provincial Product Analyst
, CAN
Property Field Claims Manager
, CAN
Commercial and Privacy Counsel
Toronto, CAN
Software Engineer Consultant I
, IND
Vended Application Senior Consultant II
, IND
Software Engineer Lead Consultant
, IND