Python Backend Engineer + Web scraper

7 days ago

Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 14,40,000 per year

Position: Associate Tech Specialist / Tech Specialist

Experience: 6 to 8 Years

Location: Remote

Work timing: 2 PM to 11 PM

Contact Duration: 6 Months (Extendable)

PF & BGV Mandatory

Roles and Responsibilities:

* Lead the design, architecture, and implementation of scalable and maintainable web scraping solutions using the Scrapy framework, integrated with tools such as Kafka, Zookeeper, and Redis

* Develop and maintain web crawlers to automate data extraction from various sources, ensuring alignment with user and application requirements

* Research, design, and implement automation strategies across multiple platforms, tools, and technologies to optimize business processes

* Monitor, troubleshoot, and resolve issues affecting the performance, reliability, and stability of scraping systems and automation tools

* Serve as a Subject Matter Expert (SME) for automation systems, providing guidance and support to internal teams

* Analyze and validate extracted data to ensure accuracy, integrity, and compliance with client's data standards

* Define, implement, and enforce data requirements, standards, and best practices to ensure consistent and efficient operations

* Collaborate with stakeholders and end users to define technical requirements, business goals, and alternative solutions for data collection and reporting

* Create, manage, and document reports, processes, policies, and project plans, including risk assessments and goal tracking

* Conduct code reviews, enforce coding standards, and provide technical leadership and mentorship to development team members

* Proactively identify and mitigate technical risks, recommending improvements in technologies, tools, and processes

* Drive the adoption of modern development tools, frameworks, and best practices

* Contribute to strategic planning related to automation initiatives and product development

* Ensure clear, thorough communication and documentation across teams to support knowledge sharing and training

Minimum Qualifications:

* Bachelor's degree in Computer Science, Software Engineering, or related field.

* 5+ years of professional software development experience.

* Strong proficiency in HTML, XML, XPath, XSLT, and Regular Expressions for data extraction and transformation

* Hands-on experience with Visual Studio

* Strong proficiency in Python

* Some experience with C# .NET

* Solid experience with MS SQL Server, with strong skills in SQL querying and data analysis

* Experience with web scraping, particularly using the Scrapy framework integrated with Kafka, Zookeeper, and Redis

* Experience with .NET automation tools such as Selenium

* Understanding of CAPTCHA-solving services and working with proxy services

* Experience working in a Linux environment is a plus

* Highly self-motivated and detail-oriented, with a proactive, goal-driven mindset

* Strong team player with dependable work habits and well-developed interpersonal skills

* Excellent verbal and written communication skills

* Demonstrates willingness and flexibility to adapt schedule when necessary to meet client needs.

Core Technical Skills- Python (strong proficiency)

  1. HTML, XML, XPath, XSLT, Regex (for data extraction)

  2. Visual Studio

  3. C# .NET (some experience)

  4. MS SQL Server (SQL querying & analysis)

  5. Web Scraping Framework: Scrapy (integrated with Kafka, Zookeeper, Redis)

  6. Automation Tools: Selenium (.NET automation tools)

Job Types: Freelance, Internship

Contract length: 6 months

Pay: ₹80,000.00 per month

Work Location: Remote

  • Python/JavaScript Developer – Web Scraping

    5 days ago

    Remote, India FullStackTechies Full time ₹ 3,50,000 - ₹ 6,00,000 per year

    Python/JavaScript Developer – Web Scraping Experience: 3+ YearsLocation: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer ScienceIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in web scraping with hands-on experience in...

  • Web Scraper Intern

    2 weeks ago

    Remote, India HelpStudyAbroad.com Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. **Responsibilities**: - Use official website of universities and...

  • Web Scraping Internship

    1 week ago

    Remote, India Talrn Full time

    Web Scraper Intern Location: Remote Duration: 3-6 months Start Date: Immediate Stipend: Unpaid **About the Role**: We are looking for a motivated Web Scraper Intern to join our team. You will be responsible for building and maintaining web scrapers, extracting and cleaning data, and automating data collection processes. This is a great opportunity to...

  • Web Scraper

    4 hours ago

    Remote, India Hyperhire Full time

    **Job Description for Web Scraping Developer (Crawling Developer)** - **Experience**: 3+ years - **Job Type**: 3 months full-time Contractual Role (may get extended) - **Duration**: Initially 3 months, with the possibility of extension based on performance or project requirements. **Skillsets Required**: - Proven experience in scraping data from...

  • Python Backend Developer

    2 days ago

    Remote, India vlitechnologies Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Locations: RemoteTime : 9:00PM or 10:00PM to 5:00AM or 6:00AM (PST time)Interview round : 5Budget : 1LPM (No GST)EXP : 10 + YearJob Description:== This is what mean by Backend ==Load Balancers, Distributed Systems (Consistency, Availability, Latency (p50, p90, p99)Sticky Sessions, Long poll and/or Web SocketsStateless and Stateful servers.SQL and NoSQL...

  • Python Backend Developer

    3 days ago

    Remote, India NotDisclosed Full time ₹ 11,00,000 per year

    Must-Have Skills:Strong expertise in Python (async patterns, type annotations, unit testing).Hands-on experience with FastAPI / Flask and GraphQL frameworks.Proven track record in building & scaling RESTful / GraphQL APIs.Containerization using Docker and CI/CD with GitHub Actions.Strong communication & self-driven work style.Good to Have:Experience with...

  • Backend Engineer

    2 days ago

    Remote, India Sentellent LLC Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Backend Engineer (Python, AI, AWS) – 3+ YearsRole OverviewWe are looking for a Backend Engineer with 3+ years of experience in Python (FastAPI/ Flask), AWS cloud infrastructure, and AI/ML integration. You will design scalable APIs, manage cloud-native deployments, and work with AI/LLM frameworks to power modern applications.Key ResponsibilitiesBuild and...

  • Python Dev

    7 days ago

    Remote, India Codash Solutions Full time

    Payment will be hourly basis Python Langchain developer Exp - 5+yrs Budget - 650 rs per hour Open positions - 15 Role Overview: This role is for an experienced and high-caliber engineer with strong proficiency in Python and hands-on expertise integrating Large Language Models (LLMs) into production systems. This individual contributor (IC) role focuses...

  • Senior Backend Product Engineer

    5 days ago

    Remote, India Etaclam Techno Services Full time ₹ 9,60,000 - ₹ 12,00,000 per year

    **Location:** Noida, India (Remote)**Experience:** 4–8 YearsJob Overview· This role requires a strong backend engineer with proven experience in designing and building scalable applications.· The candidate should be able to work independently and deliver high-quality solutions in a remote setup.· The engineer will collaborate with product, frontend, and...

  • Python Web Scraping Developer

    3 days ago

    Remote, India Serv Armada Infotech Technologies Pvt Ltd Full time ₹ 20,000 - ₹ 50,000 per year

    About Us:We are a technology solutions company providing innovative services across multiple industries including hospitality, retail, real estate, construction, and more. We are looking to expand our team with a skilled Python Web Scraping Developer to support various data extraction and automation projects.Role Overview:As a Python Web Scraping Developer,...