Python Developer - Associate
Role Overview
Build robust, secure, scalable scraping solutions for complex web applications and secured portals.
The role combines Python automation, browser interactions, and cloud-native AWS deployment.
Key Skills for This Role
Full Job Posting
Role overview
Build robust, secure, scalable scraping solutions for complex web applications and secured portals.
The role combines Python automation, browser interactions, and cloud-native AWS deployment.
Responsibilities
- Design and implement scraping solutions with Python, Playwright, and AWS.
- Automate JavaScript-heavy sites and secured login flows, including MFA, CAPTCHA, and session/token handling.
- Build serverless pipelines using Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
- Scale extraction with fault tolerance, retries, and intelligent logging.
- Integrate workflows across portals, APIs, and data sources; contribute to architecture and best practices.
Required qualifications
- 5+ years of Python development focused on automation and data extraction.
- Expertise with web scraping tools such as Playwright, Selenium, Scrapy, BeautifulSoup, or requests.
- Experience with MFA, CAPTCHA, authentication flows, and session/cookie management.
- AWS workload deployment experience, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
- Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.
- Understand web protocols and network calls; work with APIs, JSON/XML, and data transformation.
- Bachelor’s or Master’s degree in a related field, or equivalent professional experience.
Preferred qualifications
- CI/CD, Docker, infrastructure as code, Airflow or Step Functions experience is preferred.
- Secure or enterprise portal scraping, data engineering/ETL, and Python testing experience are preferred.
Work arrangement
- Employees work in the office four days per week and may work remotely one day, Friday.
Benefits
- Full-time employees receive competitive salary, annual performance bonus, and equity.
- Benefits include employer-paid health and dental insurance and paid time off.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at iCapital
ETF and 1940 Act Registered Funds Compliance Officer - Assistant Vice President
New York City, USA
About the Role iCapital is looking to hire a Compliance Officer to support the relevant investment advisers serving the Exchange-Traded Funds (ETF), Alternative Investments Fund-of-Funds, and 1940 Act Registered Funds bu
ETF and 1940 Act Registered Funds Compliance Officer - Assistant Vice President
Greenwich, USA
About the Role iCapital is looking to hire a Compliance Officer to support the relevant investment advisers serving the Exchange-Traded Funds (ETF), Alternative Investments Fund-of-Funds, and 1940 Act Registered Funds bu
Regulatory Reporting - Vice President
Greenwich, USA
About the Role iCapital is looking to hire a Vice President of Regulatory Reporting to join the Regulatory and Compliance team. This position will work closely with the Senior Vice Presidents and Co-Chief Compliance Offi
Cloud Architecture Engineer - Vice President
New York City, USA
About the Role The ideal candidate for this role is a strong cloud architect who excels at both big-picture thinking as well as hands-on technical work. With very strong AWS, Kubernetes and web infrastructure skillsets,
Regulatory Reporting - Vice President
New York City, USA
About the Role iCapital is looking to hire a Vice President of Regulatory Reporting to join the Regulatory and Compliance team. This position will work closely with the Senior Vice Presidents and Co-Chief Compliance Offi
.NET Application and Solutions Architect - Assistant Vice President
Salt Lake City, USA
About the Role iCapital is seeking a.NET Application/Solutions Architect to lead the architecture, design, and modernization of the illustration related applications. This role serves as a key member of the Core Architec
.NET Application and Solutions Architect - Assistant Vice President
Colorado Springs, USA
About the Role iCapital is seeking an Application Architect to lead the architecture, design, and modernization of the illustration related applications. This role serves as a key member of the Core Architecture Team, pa
Product Manager - Analyst / Associate
Colorado Springs, USA
About the Role iCapital is seeking an Analyst or Associate responsible for supporting the Product Managers with all aspects of the successful operations of the funds in the Independent Advisor Solutions Business (IAS). T
ETF and 1940 Act Registered Funds Compliance Officer - Assistant Vice President
New York City, USA
ETF and 1940 Act Registered Funds Compliance Officer - Assistant Vice President
Greenwich, USA
Regulatory Reporting - Vice President
Greenwich, USA
Cloud Architecture Engineer - Vice President
New York City, USA
Regulatory Reporting - Vice President
New York City, USA
.NET Application and Solutions Architect - Assistant Vice President
Salt Lake City, USA
.NET Application and Solutions Architect - Assistant Vice President
Colorado Springs, USA
Product Manager - Analyst / Associate
Colorado Springs, USA