Python Backend Engineer + Web scraper

1 week ago

Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 14,40,000 per year

Position: Associate Tech Specialist / Tech Specialist

Experience: 6 to 8 Years

Location: Remote

Work timing: 2 PM to 11 PM

Contact Duration: 6 Months (Extendable)

PF & BGV Mandatory

Roles and Responsibilities:

* Lead the design, architecture, and implementation of scalable and maintainable web scraping solutions using the Scrapy framework, integrated with tools such as Kafka, Zookeeper, and Redis

* Develop and maintain web crawlers to automate data extraction from various sources, ensuring alignment with user and application requirements

* Research, design, and implement automation strategies across multiple platforms, tools, and technologies to optimize business processes

* Monitor, troubleshoot, and resolve issues affecting the performance, reliability, and stability of scraping systems and automation tools

* Serve as a Subject Matter Expert (SME) for automation systems, providing guidance and support to internal teams

* Analyze and validate extracted data to ensure accuracy, integrity, and compliance with client's data standards

* Define, implement, and enforce data requirements, standards, and best practices to ensure consistent and efficient operations

* Collaborate with stakeholders and end users to define technical requirements, business goals, and alternative solutions for data collection and reporting

* Create, manage, and document reports, processes, policies, and project plans, including risk assessments and goal tracking

* Conduct code reviews, enforce coding standards, and provide technical leadership and mentorship to development team members

* Proactively identify and mitigate technical risks, recommending improvements in technologies, tools, and processes

* Drive the adoption of modern development tools, frameworks, and best practices

* Contribute to strategic planning related to automation initiatives and product development

* Ensure clear, thorough communication and documentation across teams to support knowledge sharing and training

Minimum Qualifications:

* Bachelor's degree in Computer Science, Software Engineering, or related field.

* 5+ years of professional software development experience.

* Strong proficiency in HTML, XML, XPath, XSLT, and Regular Expressions for data extraction and transformation

* Hands-on experience with Visual Studio

* Strong proficiency in Python

* Some experience with C# .NET

* Solid experience with MS SQL Server, with strong skills in SQL querying and data analysis

* Experience with web scraping, particularly using the Scrapy framework integrated with Kafka, Zookeeper, and Redis

* Experience with .NET automation tools such as Selenium

* Understanding of CAPTCHA-solving services and working with proxy services

* Experience working in a Linux environment is a plus

* Highly self-motivated and detail-oriented, with a proactive, goal-driven mindset

* Strong team player with dependable work habits and well-developed interpersonal skills

* Excellent verbal and written communication skills

* Demonstrates willingness and flexibility to adapt schedule when necessary to meet client needs.

Core Technical Skills- Python (strong proficiency)

  1. HTML, XML, XPath, XSLT, Regex (for data extraction)

  2. Visual Studio

  3. C# .NET (some experience)

  4. MS SQL Server (SQL querying & analysis)

  5. Web Scraping Framework: Scrapy (integrated with Kafka, Zookeeper, Redis)

  6. Automation Tools: Selenium (.NET automation tools)

Job Types: Freelance, Internship

Contract length: 6 months

Pay: ₹80,000.00 per month

Work Location: Remote

  • Python/JavaScript Developer – Web Scraping

    4 days ago

    Remote, India FullStackTechies Full time ₹ 3,50,000 - ₹ 6,00,000 per year

    Python/JavaScript Developer – Web Scraping Experience: 3+ YearsLocation: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer ScienceIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in web scraping with hands-on experience in...

  • Web Scraper Intern

    7 days ago

    Remote, India HelpStudyAbroad.com Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. **Responsibilities**: - Use official website of universities and...

  • Web Scraper Intern

    1 week ago

    Remote, India Green Dream Earth Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. The stipend is performance-based, linked to the number of successful...

  • Principal Architect

    1 week ago

    Remote, India Agastya Hire World Full time ₹ 7,63,000 - ₹ 17,43,659 per year

    Job Title: *Sr. Principal Architect**Role Overview:*We are seeking a highly experienced Principal Engineer / Architect with 8–9+ years of hands-on experience in building end-to-end software systems. The ideal candidate is a generalist who has delivered full product cycles, excels in frontend and backend design, and has strong expertise in orchestration,...

  • Python Backend Engineer

    11 hours ago

    Remote, India HANSRAJ VENTURES PVT LTD Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Description:We are seeking a Senior Python Backend Engineer to design, develop, and secure cloud-based voice applications. The ideal candidate will have deep experience with FastAPI, secure HTTP protocols, audio processing, IVR workflows, and production-grade cloud deployment. You will play a pivotal role in building highly scalable, secure, and reliable...

  • Web Scraper

    2 weeks ago

    Remote, India InspectHOA Full time

    InspectHOA is a US-based startup bringing technology and standardization to real estate transactions. The $36.2 trillion residential real estate space is undergoing a once-in-a-lifetime transformation, and we are excited to play our role. Our current product connects Investors, Lenders, Title companies, and other real estate professionals with HOAs, so they...

  • Backend Engineer

    6 days ago

    Remote, India Forage AI Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Description : Experience Level : Data Engineer 3-7 years of relevant experience in data engineering.About Forage AI : Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and...

  • Python Backend Developer

    3 days ago

    Remote, India vlitechnologies Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Locations: RemoteTime : 9:00PM or 10:00PM to 5:00AM or 6:00AM (PST time)Interview round : 5Budget : 1LPM (No GST)EXP : 10 + YearJob Description:== This is what mean by Backend ==Load Balancers, Distributed Systems (Consistency, Availability, Latency (p50, p90, p99)Sticky Sessions, Long poll and/or Web SocketsStateless and Stateful servers.SQL and NoSQL...

  • Backend Engineer

    11 hours ago

    Remote, India Bigbell Full time ₹ 15,00,000 - ₹ 22,50,000 per year

    Job Title: Backend Engineer(Python/Django/DRF)Reports to: Chief Technology Officer (CTO)Division: TechnologyLocation: RemoteWhy join us?Exciting Projects: Work on a unique platform with real-world impactCollaborative Team: Join a talented and friendly team that values innovation andgrowthProfessional Development: Opportunities to learn and work with...

  • Python Backend Developer

    2 days ago

    Remote, India NotDisclosed Full time ₹ 11,00,000 per year

    Must-Have Skills:Strong expertise in Python (async patterns, type annotations, unit testing).Hands-on experience with FastAPI / Flask and GraphQL frameworks.Proven track record in building & scaling RESTful / GraphQL APIs.Containerization using Docker and CI/CD with GitHub Actions.Strong communication & self-driven work style.Good to Have:Experience with...