{"schemaVersion":"jobsearcher.job.v1","id":"f8044cbf20354a6ac0879655","url":"https://jobsearcher.com/jobs/f8044cbf20354a6ac0879655","canonicalUrl":"https://jobsearcher.com/jobs/f8044cbf20354a6ac0879655","title":"Python Developer (Web Scraping & Data Extraction)","description":"Are you interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualityAI!We are looking for a Python Developer (Web Scraping & Data Extraction) to join our growing team in United StatesLocation: US/CAN/ARG/MEXAbout the RoleWe're looking for an experienced Python developer who is strong in web scraping and data extraction to join our data engineering team. You'll build and maintain reliable, scalable pipelines that collect data from websites, APIs, and other online sources. This data feeds analytics, research, and decision-making across our business.This role suits someone who has outgrown writing one-off scripts. You like building resilient, well-tested systems and take pride in data quality. Experience in finance, fintech, or investments is a real advantage, since much of our data supports market, investment, and financial analysis.Key ResponsibilitiesDesign, develop, and maintain scalable web scraping and crawling solutions in PythonExtract data from static pages, JavaScript-heavy sites, and REST/GraphQL APIsBuild robust pipelines that handle anti-bot measures, rate limits, CAPTCHAs, dynamic content, and site structure changesClean, validate, normalize, and transform raw data into analysis-ready datasetsMonitor scraper health, set up alerting, and quickly fix breakages to keep data fresh and accurateOptimize scrapers for speed, reliability, and cost, including proxy management and concurrencyStore and manage data in relational and non-relational databases and cloud storageWrite clean, tested, well-documented code and take part in code reviewsWork with analysts, data scientists, and business stakeholders to turn data needs into technical solutionsEnsure scraping practices comply with terms of service, robots.txt, and data privacy regulationsMentor junior developers and help set team standards for scraping and data qualityRequiredQualifications5-8 years of professional Python development experience, including at least 3 years focused on web scraping or data extractionStrong hands-on experience with Scrapy, BeautifulSoup, Requests/HTTPX, and Selenium, Playwright, or PuppeteerExperience with asynchronous and concurrent programming (asyncio, multithreading, multiprocessing)Solid understanding of HTTP, HTML/CSS, DOM structure, XPath/CSS selectors, cookies, sessions, and authentication flowsExperience with proxies, user-agent rotation, headless browsers, and techniques for avoiding detectionProficiency in data processing with Pandas, NumPy, and regular expressionsWorking knowledge of SQL and at least one NoSQL database (e.g., PostgreSQL, MongoDB)Experience building and scheduling data pipelines (e.g., Airflow, Prefect, or cron-based orchestration)Familiarity with Git, CI/CD, Docker, and automated testing (pytest)Experience with a cloud platform (AWS, Azure, or GCP)Strong debugging and problem-solving skills, and clear written and verbal communicationBachelor's degree in Computer Science, Engineering, Mathematics, Finance, or a related field (or equivalent experience)PreferredQualifications (Finance / Fintech / Investments)Background in financial services, fintech, asset management, or investment researchExperience collecting and structuring data such as market prices, company filings (SEC/EDGAR), earnings reports, news, ESG data, alternative data, or fund and security reference dataFamiliarity with financial concepts such as equities, fixed income, funds, portfolios, and risk and return metricsUnderstanding of data quality, lineage, and audit requirements in regulated environmentsAwareness of financial data licensing, compliance, and data governance considerationsExperience with financial data providers and APIs (e.g., Bloomberg, Refinitiv, Alpha Vantage, Yahoo Finance, Polygon)Knowledge of NLP or text extraction from PDFs, filings, and unstructured documentsExperience with big data tools (Spark, Kafka) or data warehouses (Snowflake, BigQuery, Redshift)Exposure to Kubernetes, infrastructure as code, or distributed scraping architecturesKey CompetenciesReliability mindset: builds scrapers that keep running and recover gracefully when sites changeData quality focus: treats accuracy and completeness as non-negotiableOwnership: takes responsibility for solutions end to end, from design to monitoringCollaboration: communicates clearly with technical and non-technical stakeholdersEthical judgment: respects legal, compliance, and data privacy boundariesBenefitsWhy QualityAI?Be a part of a company who strives to support for diversity and inclusion in the workplace - we are one, we are many at QualityAI. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences. We have more than 40% women and around 120 different nationalities.Local and global opportunities - we offer you internal rotation and international mobility opportunities to grow your career.Clear view of your career and progression with the company - QualityAI is growing massively (since 2021 - tripled our employees base - we now have more than 8,000 engineers) and giving you the opportunity to grow with us.Work hard and play harder with our flexible and casual culture.Take care of health with enrollment into one of our competitive healthcare benefits from Day 1.Never stop experimenting and learning with QCraft - our Learning & Development platform: 50,000+ courses, 300+ virtual labs, mentorship and leadership programs, professional tribes, sponsored certifications, and much more.Earn bonuses via our Client Referral and Employee Referral Program's. Refer and earn - tap your network for net-worth.We recognize our employees work via our Qudos platform - You can earn bonuses and spot awards by celebrating your and your peers' achievements.Intrigued to find more about us?Visit our website at https://www.qualitestgroup.com/If you like what you have read, send us your resume and let's start talking!","company":"Qualitest Group","rawCompany":"qualitest group","city":"Santa Clara","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-15T12:49:05.398Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1254.00","title":"Web Developers","slug":"web-developers"},{"code":"15-1251.00","title":"Computer Programmers","slug":"computer-programmers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Python Developer (Web Scraping & Data Extraction)","description":"Are you interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualityAI!We are looking for a Python Developer (Web Scraping & Data Extraction) to join our growing team in United StatesLocation: US/CAN/ARG/MEXAbout the RoleWe're looking for an experienced Python developer who is strong in web scraping and data extraction to join our data engineering team. You'll build and maintain reliable, scalable pipelines that collect data from websites, APIs, and other online sources. This data feeds analytics, research, and decision-making across our business.This role suits someone who has outgrown writing one-off scripts. You like building resilient, well-tested systems and take pride in data quality. Experience in finance, fintech, or investments is a real advantage, since much of our data supports market, investment, and financial analysis.Key ResponsibilitiesDesign, develop, and maintain scalable web scraping and crawling solutions in PythonExtract data from static pages, JavaScript-heavy sites, and REST/GraphQL APIsBuild robust pipelines that handle anti-bot measures, rate limits, CAPTCHAs, dynamic content, and site structure changesClean, validate, normalize, and transform raw data into analysis-ready datasetsMonitor scraper health, set up alerting, and quickly fix breakages to keep data fresh and accurateOptimize scrapers for speed, reliability, and cost, including proxy management and concurrencyStore and manage data in relational and non-relational databases and cloud storageWrite clean, tested, well-documented code and take part in code reviewsWork with analysts, data scientists, and business stakeholders to turn data needs into technical solutionsEnsure scraping practices comply with terms of service, robots.txt, and data privacy regulationsMentor junior developers and help set team standards for scraping and data qualityRequiredQualifications5-8 years of professional Python development experience, including at least 3 years focused on web scraping or data extractionStrong hands-on experience with Scrapy, BeautifulSoup, Requests/HTTPX, and Selenium, Playwright, or PuppeteerExperience with asynchronous and concurrent programming (asyncio, multithreading, multiprocessing)Solid understanding of HTTP, HTML/CSS, DOM structure, XPath/CSS selectors, cookies, sessions, and authentication flowsExperience with proxies, user-agent rotation, headless browsers, and techniques for avoiding detectionProficiency in data processing with Pandas, NumPy, and regular expressionsWorking knowledge of SQL and at least one NoSQL database (e.g., PostgreSQL, MongoDB)Experience building and scheduling data pipelines (e.g., Airflow, Prefect, or cron-based orchestration)Familiarity with Git, CI/CD, Docker, and automated testing (pytest)Experience with a cloud platform (AWS, Azure, or GCP)Strong debugging and problem-solving skills, and clear written and verbal communicationBachelor's degree in Computer Science, Engineering, Mathematics, Finance, or a related field (or equivalent experience)PreferredQualifications (Finance / Fintech / Investments)Background in financial services, fintech, asset management, or investment researchExperience collecting and structuring data such as market prices, company filings (SEC/EDGAR), earnings reports, news, ESG data, alternative data, or fund and security reference dataFamiliarity with financial concepts such as equities, fixed income, funds, portfolios, and risk and return metricsUnderstanding of data quality, lineage, and audit requirements in regulated environmentsAwareness of financial data licensing, compliance, and data governance considerationsExperience with financial data providers and APIs (e.g., Bloomberg, Refinitiv, Alpha Vantage, Yahoo Finance, Polygon)Knowledge of NLP or text extraction from PDFs, filings, and unstructured documentsExperience with big data tools (Spark, Kafka) or data warehouses (Snowflake, BigQuery, Redshift)Exposure to Kubernetes, infrastructure as code, or distributed scraping architecturesKey CompetenciesReliability mindset: builds scrapers that keep running and recover gracefully when sites changeData quality focus: treats accuracy and completeness as non-negotiableOwnership: takes responsibility for solutions end to end, from design to monitoringCollaboration: communicates clearly with technical and non-technical stakeholdersEthical judgment: respects legal, compliance, and data privacy boundariesBenefitsWhy QualityAI?Be a part of a company who strives to support for diversity and inclusion in the workplace - we are one, we are many at QualityAI. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences. We have more than 40% women and around 120 different nationalities.Local and global opportunities - we offer you internal rotation and international mobility opportunities to grow your career.Clear view of your career and progression with the company - QualityAI is growing massively (since 2021 - tripled our employees base - we now have more than 8,000 engineers) and giving you the opportunity to grow with us.Work hard and play harder with our flexible and casual culture.Take care of health with enrollment into one of our competitive healthcare benefits from Day 1.Never stop experimenting and learning with QCraft - our Learning & Development platform: 50,000+ courses, 300+ virtual labs, mentorship and leadership programs, professional tribes, sponsored certifications, and much more.Earn bonuses via our Client Referral and Employee Referral Program's. Refer and earn - tap your network for net-worth.We recognize our employees work via our Qudos platform - You can earn bonuses and spot awards by celebrating your and your peers' achievements.Intrigued to find more about us?Visit our website at https://www.qualitestgroup.com/If you like what you have read, send us your resume and let's start talking!","datePosted":"2026-10-15T12:49:05.398Z","dateModified":"2026-10-15T12:49:05.398Z","hiringOrganization":{"@type":"Organization","name":"Qualitest Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Santa Clara","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f8044cbf20354a6ac0879655"},"url":"https://jobsearcher.com/jobs/f8044cbf20354a6ac0879655"}}