Senior Python Web Engineer
2 days ago
Prefer 2–3 hours/day with Pacific Time (PST)
About the role We’re building a high-throughput product data ingestion pipeline across hundreds of domains. You’ll also drive the automation around scheduling, retries, and monitoring so runs are hands‑off, and you’ll integrate vendor/public APIs (REST/GraphQL) wherever available to complement crawling.
Design an crawler (Scrapy or aio with Playwright fallback only for JS‑heavy pages.
Build a lightweight “needs JS?” classifier (HTML length, JSON‑LD presence, data‑product markers) to auto‑route vs Playwright.
Ship observability : per‑site field coverage, error rates, retries, avg page time, and PDF success.
collaborate with data team on schemas/normalization.
4+ years Python , including 2+ years building production web crawlers at scale.
~ Confident with CSS/XPath , schema.org/JSON‑LD , and HTML parsing.
~ APIs: consuming REST/GraphQL (auth, pagination, backoff) and building small internal services ( FastAPI or similar).
~ Airflow/Temporal/Celery (or equivalent schedulers/queues) for scheduled runs and monitoring.
~ Queues ( Redis/Kafka ), Docker , Linux basics; Go or Node.js experience for high‑performance crawlers.
Cloud: AWS/GCP , S3 , ECS/Kubernetes; warehousing ( Snowflake/Postgres ).
LLM‑assisted selector generation with deterministic verification (optional).
Ship in small, measurable increments.
Compensation Competitive;
-
Senior Python Web Engineer
3 days ago
India TripleChoice Inc Full timeSenior Web Scraping Engineer (Python) — India (Remote) Employment type: Full-time (open to contract-to-hire) Work location: Remote in India Prefer 2–3 hours/day with Pacific Time (PST)About the role We're building a high-throughput product data ingestion pipeline across hundreds of domains. You'll also drive the automation around scheduling,...
-
Python QA
2 weeks ago
India CES Full timeWe are hiring a Senior QA Automation Engineer (Python/Selenium) with 10+ years of QA experience. The role involves building robust automation frameworks for web, API, and data workflows, leveraging Python, Selenium, Pandas, SQL, and CI/CD tools. Ideal for professionals passionate about delivering scalable, reliable, and high-quality software solutions.Full...
-
sr python developer web scraping
20 hours ago
Ahmedabad, India Actowiz Solutions Full timeJob Description Job Title: Senior Python Developer Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time Working Days: 5 Days a Week About Us Actowiz Solutions is a leading provider of data extraction, web scraping, andautomation solutions. We empower businesses with actionable insights by deliveringclean,...
-
Senior Web Developer
1 week ago
India BRIDGING FX LIMITED Full timeCompany Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with a dedicated technology team. BRIDGING FX is fully focused on FinTech trading solutions that enable brokerages...
-
Python QA
21 hours ago
India CES Full timeWe are hiring a Senior QA Automation Engineer (Python/Selenium) with 10+ years of QA experience. The role involves building robust automation frameworks for web, API, and data workflows, leveraging Python, Selenium, Pandas, SQL, and CI/CD tools. Ideal for professionals passionate about delivering scalable, reliable, and high-quality software solutions. Full...
-
Backend Developer Python
2 days ago
India Elife Transfer Full timeA fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. All employees outside San Francisco headquarter work remotely. Elife is a Startup developing innovative technology in the passenger transport industry, providing any type of ground transportation worldwide,...
-
Senior Web Developer
2 weeks ago
India BRIDGING FX LIMITED Full timeCompany DescriptionBRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with...
-
Backend Developer Python
7 days ago
India ELife Full timeA fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. All employees outside San Francisco headquarter work remotely. Elife is a Startup developing innovative technology in the passenger transport industry, providing any type of ground transportation worldwide,...
-
Senior Web Developer
2 weeks ago
India BRIDGING FX LIMITED Full timeCompany Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with...
-
Senior Web Developer
2 days ago
India BRIDGING FX LIMITED Full timeCompany Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled...
