Python Backend Engineer + Web scraper

1 week ago

Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 14,40,000 per year

Position: Associate Tech Specialist / Tech Specialist

Experience: 6 to 8 Years

Location: Remote

Work timing: 2 PM to 11 PM

Contact Duration: 6 Months (Extendable)

PF & BGV Mandatory

Roles and Responsibilities:

* Lead the design, architecture, and implementation of scalable and maintainable web scraping solutions using the Scrapy framework, integrated with tools such as Kafka, Zookeeper, and Redis

* Develop and maintain web crawlers to automate data extraction from various sources, ensuring alignment with user and application requirements

* Research, design, and implement automation strategies across multiple platforms, tools, and technologies to optimize business processes

* Monitor, troubleshoot, and resolve issues affecting the performance, reliability, and stability of scraping systems and automation tools

* Serve as a Subject Matter Expert (SME) for automation systems, providing guidance and support to internal teams

* Analyze and validate extracted data to ensure accuracy, integrity, and compliance with client's data standards

* Define, implement, and enforce data requirements, standards, and best practices to ensure consistent and efficient operations

* Collaborate with stakeholders and end users to define technical requirements, business goals, and alternative solutions for data collection and reporting

* Create, manage, and document reports, processes, policies, and project plans, including risk assessments and goal tracking

* Conduct code reviews, enforce coding standards, and provide technical leadership and mentorship to development team members

* Proactively identify and mitigate technical risks, recommending improvements in technologies, tools, and processes

* Drive the adoption of modern development tools, frameworks, and best practices

* Contribute to strategic planning related to automation initiatives and product development

* Ensure clear, thorough communication and documentation across teams to support knowledge sharing and training

Minimum Qualifications:

* Bachelor's degree in Computer Science, Software Engineering, or related field.

* 5+ years of professional software development experience.

* Strong proficiency in HTML, XML, XPath, XSLT, and Regular Expressions for data extraction and transformation

* Hands-on experience with Visual Studio

* Strong proficiency in Python

* Some experience with C# .NET

* Solid experience with MS SQL Server, with strong skills in SQL querying and data analysis

* Experience with web scraping, particularly using the Scrapy framework integrated with Kafka, Zookeeper, and Redis

* Experience with .NET automation tools such as Selenium

* Understanding of CAPTCHA-solving services and working with proxy services

* Experience working in a Linux environment is a plus

* Highly self-motivated and detail-oriented, with a proactive, goal-driven mindset

* Strong team player with dependable work habits and well-developed interpersonal skills

* Excellent verbal and written communication skills

* Demonstrates willingness and flexibility to adapt schedule when necessary to meet client needs.

Core Technical Skills- Python (strong proficiency)

  1. HTML, XML, XPath, XSLT, Regex (for data extraction)

  2. Visual Studio

  3. C# .NET (some experience)

  4. MS SQL Server (SQL querying & analysis)

  5. Web Scraping Framework: Scrapy (integrated with Kafka, Zookeeper, Redis)

  6. Automation Tools: Selenium (.NET automation tools)

Job Types: Freelance, Internship

Contract length: 6 months

Pay: ₹80,000.00 per month

Work Location: Remote

  • Web Scraper

    1 week ago

    Remote, India STerry Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Web Scraper / Data EngineerLocation: RemoteJob Type: Full-time About STERRYAt STERRY, we're not your average Growth Marketing Agency—we're the rocket fuel behind crowdfunding and e-commerce success. Since day one, we've helped clients pull in over $100 million in trackable online revenue. We build strategies that go beyond brand and marketing—we deliver...

  • Web Scraper Intern

    7 days ago

    Remote, India Green Dream Earth Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. The stipend is performance-based, linked to the number of successful...

  • Python/JavaScript Developer – Web Scraping

    6 days ago

    Remote, India FullStackTechies Full time ₹ 3,50,000 - ₹ 6,00,000 per year

    Python/JavaScript Developer – Web Scraping Experience: 3+ YearsLocation: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer ScienceIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in web scraping with hands-on experience in...

  • Senior Python Backend Developer

    1 week ago

    [REMOTE], India Insignia Consultancy Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Python Backend DeveloperExperience: 8+ yearsLocation: RemoteSalary- hike on candidate's current ctcJob Description:We are seeking a skilled Python Backend Developer to join our team and contribute to the development and maintenance of high-quality backend applications. The ideal candidate will have strong experience in Python development,...

  • Principal Architect

    1 week ago

    Remote, India Agastya Hire World Full time ₹ 7,63,000 - ₹ 17,43,659 per year

    Job Title: *Sr. Principal Architect**Role Overview:*We are seeking a highly experienced Principal Engineer / Architect with 8–9+ years of hands-on experience in building end-to-end software systems. The ideal candidate is a generalist who has delivered full product cycles, excels in frontend and backend design, and has strong expertise in orchestration,...

  • Web Scraper

    1 week ago

    Remote, India InspectHOA Full time

    InspectHOA is a US-based startup bringing technology and standardization to real estate transactions. The $36.2 trillion residential real estate space is undergoing a once-in-a-lifetime transformation, and we are excited to play our role. Our current product connects Investors, Lenders, Title companies, and other real estate professionals with HOAs, so they...

  • Backend Engineer

    1 week ago

    Remote, India AAGANERA CONSULTING PRIVATE LIMITED Full time ₹ 1,00,000 - ₹ 2,50,000 per year

    Description : Job Title : Backend Engineer (Python/Django/DRF) Reports to : Chief Technology Officer (CTO) Division : Technology Location : Remote Why join us? - Exciting Projects : Work on a unique platform with real-world impact - Collaborative Team : Join a talented and friendly team that values innovation and growth - Professional Development :...

  • Backend Engineer

    1 week ago

    Remote, India Forage AI Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Description : Experience Level : Data Engineer 3-7 years of relevant experience in data engineering.About Forage AI : Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and...

  • Python Developer

    1 week ago

    Remote, India Web Spiders Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for an experienced Python Developer with a strong background in ERPNext and the Frappe Framework to join our growing team. The ideal candidate will have hands-on experience in building, customizing, and integrating ERPNext applications, along with a solid foundation in Python, REST API development, and modern web...

  • Python Developer

    1 week ago

    [REMOTE], India Insignia Consultancy Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: Python Backend DeveloperExperience: 3+ yearsLocation: Remote (All over India)Job Description:We are seeking a skilled Python Backend Developer to join our team and contribute to the development and maintenance of high-quality backend applications. The ideal candidate will have strong experience in Python development, particularly in building...