Senior Python Data Scraping Engineer (Freelance)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + huma.
Key Skills for This Role
Responsibilities
- Own end to end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript rendered content
- Enforce data quality standards through validation checks, cross source consistency controls, and systematic verification
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability
Requirements
- Hands on experience in web scraping, data extraction and processing
- Technical precision for web extraction and processing
- Ability to handle dynamic and interactive web sources
- Experience with Apify and OpenRouter or similar tools
Full Job Posting
Role Overview
- Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system.
- In this role, as an AI Pilot, you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control.
- This part time remote opportunity is ideal for technical professionals with hands on experience in web scraping, data extraction and processing.
Key Responsibilities
- Own end to end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements.
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript rendered content and changing site behavior.
- Enforce data quality standards through validation checks, cross source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Project Time Expectations
- For this project, tasks are estimated to require around 10 20 hours per week during active phases, based on project requirements.
- This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
- On this project, contributors can earn up to $37 per hour equivalent, depending on their level and pace of contribution.
- Compensation varies across projects depending on scope, complexity, and required expertise.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Mindrift
Freelance Presentation Designer
Doha, QAT
Mindrift is seeking a skilled Presentation Designer for the Tendem project, focusing on storytelling and visual hierarchy. You will design high-stakes pitch decks and one-pagers, translating complex data into compelling
Freelance Presentation Designer
Riyadh, KSA
Mindrift is seeking a Freelance Presentation Designer to create high-stakes pitch decks and one-pagers for the Tendem project. The role requires 2+ years of experience in presentation design, proficiency in PowerPoint, K
Freelance Chatbot Developer (WhatsApp / Telegram / Discord)
Abu Dhabi, UAE
Mindrift is looking for a Freelance Chatbot Developer to build conversational bots for WhatsApp, Telegram, and Discord as part of the Tendem project. The role involves designing conversational flows, integrating with LLM
Freelance Chatbot Developer (WhatsApp / Telegram / Discord)
Doha, QAT
Mindrift is looking for a skilled Bot Developer to join the Tendem project, building conversational bots and messaging-platform integrations. This freelance remote role involves designing, building, and refining bots for
Freelance Mobile App Developer (iOS / Android)
Doha, QAT
Mindrift is looking for a skilled Mobile App Developer (React Native, Flutter, Swift, or Kotlin) to join the Tendem project. The role involves building native and cross-platform mobile applications, integrating device fe
Freelance Presentation Designer
Abu Dhabi, UAE
Mindrift is seeking a skilled Presentation Designer for a freelance role on the Tendem project. You will design high-stakes pitch decks and one-pagers, translating complex data into compelling visual stories. Requires ex
Freelance Presentation Designer
Doha, QAT
Mindrift is seeking a creative Presentation Designer for the Tendem project, focusing on storytelling and visual hierarchy. You will design high-stakes pitch decks and one-pagers, translating complex data into compelling
Customer Support Specialist - Freelance AI Trainer
Saudi Arabia, KSA
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-...
Freelance Presentation Designer
Doha, QAT
Freelance Presentation Designer
Riyadh, KSA
Freelance Chatbot Developer (WhatsApp / Telegram / Discord)
Abu Dhabi, UAE
Freelance Chatbot Developer (WhatsApp / Telegram / Discord)
Doha, QAT
Freelance Mobile App Developer (iOS / Android)
Doha, QAT
Freelance Presentation Designer
Abu Dhabi, UAE
Freelance Presentation Designer
Doha, QAT
Customer Support Specialist - Freelance AI Trainer
Saudi Arabia, KSA