oracle
Big Data Lead
Hexaware Technologies
USA
Lead
Discovered 1 months ago
awsazuregcpgithadoopmssql
Key Skills for This Role
awsazuregcpgithadoopmssql
Full Job Posting
Responsibilities
- Development and Maintain Data Pipelines: Design, implement, and optimize end-to-end ETL/ELT pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
- Utilize Python and Pyspark: Write efficient, scalable and maintainable code in Python and leverage Pyspark for large-scale data processing in distributed computing environments. Also be able to review existing code and identify areas of improvement.
- Ensure Data Quality and Integrity: Implement data validation, cleansing, transformation and reconciliation processes to ensure data accuracy and consistency throughout the data lifecycle.
- Collaborate with Stakeholders: Work closely with IT teams and business stakeholders to gather data requirements and translate them to technical solutions.
- Troubleshoot and Optimize: Monitor job performance, troubleshoot complex data issues and fine-tune for performance and scalability.
- Adhere to Best Practices: Participate in code reviews, establish coding standards, and implement CI/CD pipelines for automated testing and deployment.
Skills
- Strong hands-on coding proficiency in Python, Pyspark and SQL (Microsoft SQL Server preferred)
- Experience with big data frameworks (Hadoop, Spark).
- Experience with cloud platforms ( AWS, Azure or GCP)
- Experience with Code versioning tools ( Bitbucket, Github )
- Experience with CI/CD and setting up pipelines.
- Solid understanding of database design principles, data modelling, schemas and data warehousing solutions.
- Excellent problem-solving and analytical skills to troubleshoot complex data issues independently.
About Hexaware Technologies
Technology10,001+Founded 1990
Hexaware Technologies is an IT services and digital transformation company offering cloud, data, AI, application modernization, and business process services to global enterprises.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hexaware Technologies
Non Customer Service Healthcare Claims Adjudication Team Member-BPS
, IND
Mid
Discovered 2 days agoView →
Senior ServiceNow Discovery Developer
, USA
SeniorFull-time
Senior ServiceNow Discovery Developer (ServiceNow Discovery Certified) Position Overview We are seeking a highly skilled Senior ServiceNow Discovery Developer with deep expertise in ServiceNow Discovery, CMDB, cloud i
Discovered 2 days agoView →
Non Customer Service Healthcare Claims Adjudication Team Member-BPS
, IND
Discovered 2 days ago
DevOps Track Sr.Engineer
, USA
Discovered 2 days ago
ServiceNow Scoped / Custom Application Developer
, USA
Discovered 2 days agoFull-time
Senior ServiceNow Discovery Developer
, USA
Discovered 2 days agoFull-time
Capital Market Custody Operations Team Member-BPS
, IND
Discovered 2 days ago
Executive - Order to Cash (O2C)
, IND
Discovered 3 days ago
Digital CM Developer
, IND
Discovered 3 days ago
Senior Domain Consultant - Professional Services
, USA
Discovered 3 days ago