Senior Python Web Engineer

2 days ago

India TripleChoice Inc Full time
Senior Web Scraping Engineer (Python) — India (Remote) Employment type: Full-time (open to contract-to-hire) Work location: Remote in India

Prefer 2–3 hours/day with Pacific Time (PST)

About the role We're building a high-throughput product data ingestion pipeline across hundreds of domains. You'll also drive the automation around scheduling, retries, and monitoring so runs are hands‑off, and you'll integrate vendor/public APIs (REST/GraphQL) wherever available to complement crawling.

Design an crawler (Scrapy or aio with Playwright fallback only for JS‑heavy pages.

Build a lightweight "needs JS?" classifier (HTML length, JSON‑LD presence, data‑product markers) to auto‑route vs Playwright.

Ship observability : per‑site field coverage, error rates, retries, avg page time, and PDF success.

collaborate with data team on schemas/normalization.

4+ years Python , including 2+ years building production web crawlers at scale.

~ Confident with CSS/XPath , ‑LD , and HTML parsing.

~ APIs: consuming REST/GraphQL (auth, pagination, backoff) and building small internal services ( FastAPI or similar).

~ Airflow/Temporal/Celery (or equivalent schedulers/queues) for scheduled runs and monitoring.

~ Queues ( Redis/Kafka ), Docker , Linux basics; Go or experience for high‑performance crawlers.

Cloud: AWS/GCP , S3 , ECS/Kubernetes; warehousing ( Snowflake/Postgres ).

LLM‑assisted selector generation with deterministic verification (optional).

Ship in small, measurable increments.

Compensation Competitive;

  • Senior Python Web Engineer

    1 day ago

    India TripleChoice Inc Full time

    Senior Web Scraping Engineer (Python) — India (Remote) Employment type: Full-time (open to contract-to-hire) Work location: Remote in India Prefer 2–3 hours/day with Pacific Time (PST) About the role We’re building a high-throughput product data ingestion pipeline across hundreds of domains. You’ll also drive the automation around scheduling,...

  • Python QA

    2 weeks ago

    India CES Full time

    We are hiring a Senior QA Automation Engineer (Python/Selenium) with 10+ years of QA experience. The role involves building robust automation frameworks for web, API, and data workflows, leveraging Python, Selenium, Pandas, SQL, and CI/CD tools. Ideal for professionals passionate about delivering scalable, reliable, and high-quality software solutions.Full...

  • sr python developer web scraping

    11 hours ago

    Ahmedabad, India Actowiz Solutions Full time

    Job Description Job Title: Senior Python Developer Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time Working Days: 5 Days a Week About Us Actowiz Solutions is a leading provider of data extraction, web scraping, andautomation solutions. We empower businesses with actionable insights by deliveringclean,...

  • Senior Web Developer

    1 week ago

    India BRIDGING FX LIMITED Full time

    Company Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with a dedicated technology team. BRIDGING FX is fully focused on FinTech trading solutions that enable brokerages...

  • Python QA

    12 hours ago

    India CES Full time

    We are hiring a Senior QA Automation Engineer (Python/Selenium) with 10+ years of QA experience. The role involves building robust automation frameworks for web, API, and data workflows, leveraging Python, Selenium, Pandas, SQL, and CI/CD tools. Ideal for professionals passionate about delivering scalable, reliable, and high-quality software solutions. Full...

  • Backend Developer Python

    1 day ago

    India Elife Transfer Full time

    A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. All employees outside San Francisco headquarter work remotely. Elife is a Startup developing innovative technology in the passenger transport industry, providing any type of ground transportation worldwide,...

  • Senior Web Developer

    2 weeks ago

    India BRIDGING FX LIMITED Full time

    Company DescriptionBRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with...

  • Backend Developer Python

    6 days ago

    India ELife Full time

    A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. All employees outside San Francisco headquarter work remotely. Elife is a Startup developing innovative technology in the passenger transport industry, providing any type of ground transportation worldwide,...

  • Senior Web Developer

    2 weeks ago

    India BRIDGING FX LIMITED Full time

    Company Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with...

  • Senior Web Developer

    1 day ago

    India BRIDGING FX LIMITED Full time

    Company Description BRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled...