{bc}
workday

Associate Data Engineer

TaskUs
Navi Mumbai, IND
Full-time
Mid · 4–8 years experience
Onsite
Discovered 2 weeks ago
airflowawsaws-gluegcpkafkapython

Full Job Posting

Key Responsibilities:

  • As an Associate Data Engineer, you will:
  • Configure
  • Configures and sets up solutions based on pre-approved patterns to move data from operational and external environments to the business intelligence environment.
  • Management of data integration & ETL jobs – consolidation, aggregation, filtering, validation, data quality routines, dimension creation, etc.
  • Configure and Deploy automation of jobs based on pre-approved and reusable patterns framework. Executes production-level jobs by considering data dependencies, schedules, validation routines, data stream updates.
  • Design, develop and verify the data model according to the business requirements, and continuously optimize the model.
  • Collaborate with technical users to define data requirements & establish business rules to be applied
  • Collaborate with key business stakeholders to deliver and continually enhance the BI platform to provide relevant and accurate insights through the delivery of new datasets
  • Test
  • Validate and verify the data model according to the business requirements, and continuously optimize the model.
  • Performs unit and system integration testing, on development projects.
  • Undertaking peer reviews, assisting with testing, and ensuring documentation is current.
  • Monitor
  • Monitor Error Handling and Logging tools and processes. Troubleshoot configuration and data errors.
  • Monitor Performance and raise appropriate flags.
  • Identify opportunities to optimize the ETL environment, and implement monitoring, quality, and validation processes to ensure data accuracy and integrity.

Qualifications:

  • At least 2 years of experience in Data Engineering.
  • Knowledgeable with Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration.
  • Strong knowledge of Data Warehousing concepts with understanding of traditional and MPP database designs, star and snowflake schemas with at least 2 years of data modeling.
  • At least 2 years of hands-on development experience using ETL Tools such as Pentaho, SSIS, Informatica, Talend, Fivetran or Airflow.
  • Knowledge on the architecture, design and implementation of MPP Databases such as Teradata, Snowflake or Redshift.
  • 3-year development using Cloud-based analytics solutions preferable AWS or GCP.
  • Knowledge of designing and implementing streaming pipelines using Apache Kafka, Apache Spark, or Segment.
  • Knowledgeable in Database Tuning and ETL tuning.
  • Experience of using Python in a cloud-based environment is preferred.
  • Knowledge on NoSQL DBs is preferred.
  • Knowledge, experience and exposure to AI tools is preferred but not required.
  • Someone who has the ability to work effectively across internal functional areas in ambiguous situations.
  • Someone who is a structured thinker and effective communicator.
  • Education / Certifications:
  • Bachelor's/College Degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or 4-8 years experience in place of a degree.
  • Work Location / Work Schedule / Travel:
  • Site Location: Any TaskUs IND Site (Remote)
  • Work Setup: Work from Home
  • How We Partner To Protect You: TaskUs will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. Kindly ensure that you are always in communication with only authorized recruiters of TaskUs.
  • DEI: In TaskUs we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds, demographics, and circumstances. Inclusive and equitable practices are our responsibility as a business. TaskUs is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process, please let us know.
  • We invite you to explore all TaskUs career opportunities and apply through the provided URL https://www.taskus.com/careers/.

Preferred Qualifications

  • Experience of using Python in a cloud-based environment is preferred.
  • Knowledge on NoSQL DBs is preferred.
  • Knowledge, experience and exposure to AI tools is preferred but not required.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at TaskUs