Mindrift
Freelance Data Scraping Engineer (Python)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Python Data Scraping Engineer (Freelance) – Tendem Project at Mindrift
Mindrift is seeking highly skilled Python Data Scraping Engineers to contribute to the Tendem project, driving specialized data scraping workflows in our hybrid AI + human system.
As an AI Pilot, you’ll collaborate with Tendem Agents handling repetitive tasks while applying critical thinking, domain expertise, and rigorous quality control—ensuring accuracy and actionable results.
This part-time remote opportunity suits experienced professionals with hands-on expertise in web scraping, data extraction, and processing.
What We Do
The Mindrift platform connects specialists with AI projects from global tech innovators. Our mission is to unlock the potential of Generative AI by leveraging real-world expertise worldwide.
About the Role
You’ll work as a Python Data Scraping Engineer on a freelance basis for the Tendem project, responsible for:
- Handling technically precise data scraping tasks
- Ensuring web extraction and processing using tools like Apify and OpenRouter, alongside your own innovative solutions
Key Responsibilities
- Own end-to-end scraping workflows for complex websites, ensuring 100% coverage, accuracy, and structured datasets.
- Optimize performance by combining internal tools (Apify, OpenRouter) with custom workflows for faster data collection, validation, and execution.
- Extract data reliably from dynamic and interactive sites, adapting to JavaScript-rendered content and evolving HTML structures.
- Enforce high data quality standards through:
- Validation checks
- Cross-source consistency audits
- Adherence to formatting specifications
- Systematic verification before delivery
- Scale scraping operations efficiently for large datasets, using batching, parallelization, failure monitoring, and mitigation of structural changes.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Compensation
Compensation for this project ranges up to $37 per hour depending on:
- Your skill level
- Work pace
Pay scales varies across projects based on scope, complexity, and required expertise. Other Mindrift projects may have different earnings—confirmed upon selection.
How to Get Started
- Apply to this opportunity
- Qualify for the project
- Contribute on your own schedule to AI-driven tasks
Your involvement can range from coding/automation to fine-tuning AI outputs, playing a vital role in advancing AI and real-world applications.
Requirements
Technical & Experience Requirements
- At least 3 years of hands-on experience in:
- Data engineering
- Web scraping
- Automation, or software development
- Bachelor’s or Master’s degree (or equivalent) in:
- Engineering / Applied Mathematics / Computer Science
- Python scraping expertise covering:
- Libraries: BeautifulSoup, Selenium
- Dynamic content: JavaScript, AJAX, infinite scroll
- APIs & proxies
- Proven skills extracting data from:
- Complex structures (relationships, archived pages)
- Inconsistent HTML
- Experience with data cleaning, normalization, and validation, outputting structured datasets (CSV, JSON, CSV, Google Sheets)
- LLM/AI framework experience to augment automation pipelines
- Rigorous attention to detail and unwavering commitment to data accuracy
- Self-motivated with troubleshooting independence
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Soft Skills & Preference
- Public GitHub portfolio is a plus
- English proficiency: Upper-intermediate (B2) or higher
Why This Opportunity Excites
- Fully remote hybrid AI-specialist role—no commute required beyond a stable internet connection.
- Groundbreaking hybrid environment: Collaborate between real-time human experts and AI agents, a future-proof skillset in a rapidly advancing field.
- Performance-based bonuses for speed, quality, and consistency—align compensation with your achievements.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location