Python Automation and Web Scraping Specialist

4 weeks ago

New Delhi, India Foresiet Full time

Company DescriptionForesiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research (HUMAN+TECHNOLOGY) protects individuals, enterprises, and the Federal Government.Role DescriptionThe specialist will be responsible for developing and maintaining automation processes.- Develop and maintain sophisticated web scraping and automation scripts, troubleshooting issues, - Understanding of CAPTCHA-solving approaches and working with proxy services, anti-blocking strategies: IP rotation, session management, fingerprinting/stealth, polite crawling (rate limiting, backoff), distributed workers & queueing. - Social Media Scraping - Integrate scalable captcha handling (human + automated fallbacks) and robust retry logic. - Make the solution deployable (Docker + orchestration) and include monitoring, logging, and clear operational documentation. - Creating and executing test cases, and ensuring quality assurance. - Collaborate with the team to identify automation opportunities and implement solutions. - Troubleshoot and debug technical issues related to scripts and data extraction. - Stay updated with the latest trends in web technologies, anti-scraping measures, and AI tools.Qualifications- Process Automation, Automation skills - Expert with web scraping libraries and tools such as Beautiful Soup and Scrapy - Anti Blocking Strategy- Captcha Bypass, IP rotation, session management, fingerprinting/stealth, polite crawling (rate limiting, backoff), distributed workers & queueing. - Social Media Scraping - Troubleshooting skills - Experience with creating and executing Test Cases - Quality Assurance skills - Proficiency in Python programming - Familiarity with web scraping libraries and tools such as Beautiful Soup and Scrapy - Excellent problem-solving and analytical skills - Ability to work independently and remotely

  • Data Scraping Expert

    2 days ago

    Nirman Vihar, Delhi, Delhi, India GEMTECH PARAS SOLUTIONS PVT LTD Full time

    **Key Responsibilities** - Develop and maintain robust web-scraping pipelines to extract tender information from GeM, state/central portals, and private aggregators. - Integrate OCR tools to accurately extract text from scanned PDFs and tender-related images. - Parse, normalize, and structure scraped tender data (e.g., tender ID, project title, department,...

  • AI Web Scraping Engineer

    6 days ago

    Delhi, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:- Design and implement scalable data extraction solutions using AI to rapidly...

  • Ai web scraping engineer

    3 days ago

    Delhi, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:- Design and implement scalable data extraction solutions using AI to rapidly...

  • AI Web Scraping Engineer

    2 days ago

    Delhi, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:- Design and implement scalable data extraction solutions using AI to rapidly...

  • Web Crawling Engineer

    3 days ago

    New Delhi, India Forage AI Full time

    We are seeking aWeb Crawling Engineerwho will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Salary budget...

  • Senior Associate- Web Scrapping

    6 days ago

    New Delhi, India Acuity Knowledge Partners Full time

    Job Responsibilities:- Develop and maintain web scraping scripts using Javascript, Python and Selenium to extract data from websites and APIs - Understanding requirement of customer needs, identify source and scrape/collect data. - Writing efficient, reusable, testable, and testing scalable code. - Build code that is easily readable, properly documented, and...

  • Python Developer

    2 days ago

    Delhi, India Whatjobs IN C2 Full time

    Job Description for Python Developer profile with SecNinjaz Technologies LLP Profile : Python Developer Number of Requirements : 02 Location of Deputation : New Delhi Experience Range : 05 years – 07 years Salary Range : No Bar for Potential Candidates Education Qualifications : B.Tech. / B.E. / M .C.A. What We Are Looking For: - Strong expertise in web...

  • Senior Python Developer

    4 weeks ago

    New Delhi, India CJ Konsultants Full time

    Position: Python Developer Location: Remote (India) Salary: 80-90k pm Experience: 4+ yearsJob Description: We’re looking for a Python Developer with solid hands-on experience in job and web data scraping, AI-enabled data processing, and building scalable ETL pipelines. You’ll design, implement, and operate scraping and enrichment systems that feed...

  • Web Crawling Engineer

    2 days ago

    Delhi, India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Salary budget...

  • Web Crawling Engineer

    14 hours ago

    Delhi, India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Salary budget...