Web Crawling Engineer
2 weeks ago
We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Salary budget upto - Rs. 9 LPA About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by global clients in finance, real estate, and healthcare, Forage AI enables businesses to automate workflows, reduce manual rework, and access high-quality data at scale.Key Responsibilities:Maintain and enhance existing web scraping and data crawling projects.Develop and refine crawlers using Python-based tools and frameworks.Utilize browser automation tools (e.g., Playwright, Selenium) to handle dynamic content.Clean, validate, and integrate extracted data into downstream storage systems.Implement and manage solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.).Optimize crawling efficiency and ensure compliance with web crawling best practices.Collaborate with cross-functional teams to improve data acquisition strategies.Required Skills & Qualifications:Proficiency in Python and 2 years of work experience of web scraping frameworks (especially Scrapy).Strong knowledge of browser automation tools such as Playwright or Selenium.Solid understanding of HTML, CSS, and selector languages (XPath/CSS).Experience in handling anti-scraping challenges and ensuring robust data extraction.Familiarity with distributed scraping techniques and data pipelines.Ability to troubleshoot and optimize web crawlers for performance and reliability.Strong analytical and problem-solving skills with attention to detail.Excellent communication and inter-personal skills.Other Infrastructure RequirementsSince this is a completely work-from-home position, you will also require the following -● High-speed internet connectivity for video calls and efficient work.● Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM, andno other obstacles to interrupted, efficient work).● Headphones with clear audio quality.● Stable power connection and backups in case of internet/power failure.
-
Software Development Manager, Amazon Q Business
3 weeks ago
Bengaluru, India Amazon Web Services (AWS) Full timeJob Description Description Amazon Q Business is revolutionizing workplace productivity through innovative generative AI technology. As an AI-powered assistant, it transforms how enterprises operate by empowering employees to be more creative, data-driven, efficient, prepared, and productive. Unlike traditional AI assistants, Amazon Q Business leverages...
-
Software Engineer
3 weeks ago
India Forage AI Full timeExperience required: 2–4 years of professional software engineering experience.Budget for the role - Max Up to Rs. 15 LPA depending on your interview.100% remote OpportunityRole Overview:You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and...
-
Web Performance
7 days ago
Mumbai, India arrivia Full timeJob Description Job Details Description Are you a developer who sees search engines as the ultimate API Do you thrive on optimizing the code and architecture of major websites to drive massive organic traffic We are searching for a Web Performance & SEO Developer to join our global Performance Marketing team. This is a critical hybrid role where you use your...
-
Software Engineer
3 weeks ago
India Forage AI Full timeExperience required: 2–4 years of professional software engineering experience. Budget for the role - Max Up to Rs. 15 LPA depending on your interview. 100% remote Opportunity Role Overview: You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and...
-
Software Development Engineer II
3 weeks ago
India ClearDemand Full timeJob Summary:Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world...
-
Engineering Manager
2 weeks ago
Nagar, India VT Netzwelt Full timeJob Description Job Title: Engineering Manager - Web Location: Mohali, India Company Overview Leveraging over 12 years of experience, VT Netzwelt Pvt. Ltd. is a globally trusted technology partner recognized for its deep technical expertise, agile delivery model, and unwavering commitment to quality. We specialize in the design, development, and maintenance...
-
Software Development Engineer II
3 weeks ago
India ClearDemand Full timeJob Summary: Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world...
-
Technical Architect with hands on coding
2 weeks ago
India Terra Technology Circle Consulting Private Limited Full time1.Experience with Data /Content Crawling from public Internet,bot detection avoidance techniques and use of VPN.2.Expertise in Data Engineering-modelling and managing multi dimensional entitles and graphs,knowledge of Graph Databases and Data Lake technologies.3.Experience in architecting and implementing ETL processes with cloud native...
-
Web Development Engineer
6 hours ago
India Zoom Communications Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWhat you can ExpectWe are seeking an experienced Web Development Engineer to join our dynamic team. In this role, you will build exceptional digital experiences using both traditional and headless CMS architectures while collaborating with cross-functional teams. The role requires creating versatile components and templates combining backend C# with frontend...
-
Technical SEO Specialist
3 days ago
India QR TIGER - QR Code Generator Full timeTechnical SEO Specialist (Expert) As a Technical SEO Specialist at QR TIGER, you will take a role in shaping and maintaining the technical foundation of our digital ecosystem. Your mission is to optimize site infrastructure, enhance crawlability and indexation, and ensure our website consistently meets modern search engine standards. While you will...