Current jobs related to Web Scraping Specialist - Coimbatore - SmartStream

  • Python Web Scraping

    2 weeks ago

    Coimbatore, India Client of Sanumas Solutions Full time

    Web Scraping Specialist - Python - At least 2 years of experience in large scale scraping projects - Excellent skill in Python with knowledge of scrapy framework - Experience of developing and managing scalable systems to crawl and scrape data - Ability to create crawlers for all types of websites irrespective of the technical roadblocks - Experience of...

  • AI Web Scraping Engineer

    3 weeks ago

    Coimbatore, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:Design and implement scalable data extraction solutions using AI to rapidly...

  • Web Scrapping

    7 days ago

    Rs Puram, Coimbatore, Tamil Nadu, India Bambus Technologies LLP Full time

    **Job Title: Web Scraping Developer** **Responsibilities**: - **Web Scraping**: - Develop and maintain web scraping scripts, programs, or automated processes to extract data from target websites. - Ensure efficient and reliable data extraction by handling dynamic content, AJAX requests, and anti-scraping mechanisms. - **Data Transformation**: - Clean,...

  • Data research analyst

    3 weeks ago

    Coimbatore, India Juego Studios Full time

    Job Description: Data Research Specialist – B2 B LeadsLocation:Bangalore, India About the Role:We are seeking a highly skilled Data Research Specialist who can leverage advanced AI, data science, and automation to identify, enrich, and deliver high-quality B2 B leads. This role is integral to enhancing our sales pipeline by providing actionable...

  • Web/graphic Designer

    2 weeks ago

    Coimbatore, India Malay Soft Full time

    We welcome both - experienced engineers from the industry, and freshers out of college with a Masters or Bachelors degree having good understanding of software development in any of our focus technologies. **Responsibilities** - Creating website designs. - Producing sample sites - Designing sample page layouts including text size and colors - Designing...

  • Search Marketing Specialist

    4 days ago

    Coimbatore, India NORTHENTIC e-Store agency Full time

    Company Description NORTHENTIC e-Store offers high-quality lifestyle products that are Nordic, authentic, and sustainable. Drawing on Nordic traditional craftsmanship, creativity, and innovation, NORTHENTIC provides items with an affinity for nature and a concern for the planet's future. Our mission is to help you create your own NORTHENTIC lifestyle with...

  • Digital Marketing Specialist

    3 days ago

    Coimbatore, Tamil Nadu, India Creatoos Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Company DescriptionAt Creatoos, we go beyond thoughts and ideas to bring your brand to the forefront with a strong digital marketing strategy and corporate identity. We are dedicated to creating the designs of your dreams and curating innovative and creative solutions for all your digital platform needs.Role DescriptionThis is a full-time, on-site role for a...

  • Digital Marketing Specialist

    2 weeks ago

    Coimbatore, India MITHRA HOME TECH Full time

    Job Description Company Description At Mithra Home Tech, we specialize in fast and reliable appliance repair services across Tamil Nadu. From washing machines to refrigerators and AC units, our expert technicians provide doorstep service, ensuring you save time and money. With a focus on customer satisfaction and efficiency, we make home appliance...

  • Software & Application Development Specialist

    2 weeks ago

    Coimbatore, Tamil Nadu, India PSGR Krishnammal College for Women Full time ₹ 4,20,000 - ₹ 8,40,000 per year

    We Are Hiring – Software & Application Development Specialist – Web, ERP & Mobile PlatformsInstitution: PSGR Krishnammal College for Women (PSGRKCW), CoimbatoreJob Type: Full-time | Permanent | On-sitePSGRKCW, an institution committed to academic excellence and societal impact, is seeking a highly skilled Software & Application Development Specialist to...

  • Order Management Specialist

    2 weeks ago

    Coimbatore, India Vserve Ebusiness Solution Private Limited Full time

    Job Title: Order Management Specialist Shift: Night Shift Job Location: Coimbatore (WFO) Job Summary: We are seeking a highly skilled Order Management Specialist with experience in Infor CloudSuite (Web UI - SX) ERP . The ideal candidate will have expertise in order sourcing, order entry, and end-to-end order management processes, including Shopify...

Web Scraping Specialist

4 weeks ago

Coimbatore, India SmartStream Full time

Job Title: Web Scraping Specialist

Experience: 3 - 6 Years

Location: Remote (Work from Home)

About the job

We are seeking a highly skilled Web Scraping Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for competitor analysis, and other business intelligence purposes.

Responsibilities:

  • Scalability/Performance: Lead and provide expertise in scraping at scale e-commerce marketplaces.
  • Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives
  • Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes selecting appropriate tools, libraries, or frameworks for the task
  • Data Extraction: Create and maintain web scraping scripts or programs to extract the required data. Ensure the code is optimized, reliable, and can handle changes in the website's structure
  • Data Cleansing and Validation: Cleanse and validate the collected data to eliminate errors, inconsistencies, and duplicates. Ensure data integrity and accuracy throughout the process
  • Monitoring and Maintenance: Continuously monitor and maintain the web scraping processes. Address any issues that arise due to website changes, data format modifications, or anti-scraping mechanisms
  • Scalability and Performance: Optimize web scraping procedures for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources
  • Compliance and Legal Considerations: Stay up-to-date with legal and ethical considerations related to web scraping, including website terms of service, copyright, and privacy regulations
  • Documentation: Maintain detailed documentation of web scraping processes, data sources, and methodologies. Create clear and concise instructions for others to follow
  • Collaboration: Collaborate with other teams such as data analysts, developers, and business stakeholders to understand data requirements and deliver insights effectively
  • Security: Implement security measures to ensure the confidentiality and protection of sensitive data throughout the scraping process

Requirements:

  • Proven experience of 3+ years as a Web Scraping Specialist or similar role, with a track record of successful web scraping projects
  • Expertise in handling dynamic content, user-agent rotation, bypass CAPTCHAs, rate limits, and utilization of proxy services
  • Knowledge on browser fingerprinting
  • Has leadership experience
  • Proficiency in programming languages commonly used for web scraping, such as Python, BeautifulSoup, Scrapy, or Selenium
  • Strong knowledge of HTML, CSS, XPath, and other web technologies relevant to web scraping and Coding
  • Knowledge and experience in best of class data storage and retrieval of large volume of scraped data.
  • Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
  • Attention to detail and the ability to handle and process large volumes of data accurately
  • Familiarity with data cleansing techniques and data validation processes
  • Good communication skills and the ability to collaborate effectively with cross-functional teams
  • Knowledge of web scraping ethics, legal considerations, and compliance with website terms of service
  • Strong problem-solving skills and the ability to adapt to changing web environments

Preferred Qualifications:

  • Bachelor's degree in Computer Science, Data Science, Information Technology, or related fields
  • Experience with cloud-based solutions and distributed web scraping systems
  • Familiarity with APIs and data extraction from non-public sources
  • Knowledge of machine learning techniques for data extraction and natural language processing is desired but not mandatory
  • Prior experience in handling large-scale data projects and working with big data frameworks
  • Understanding of various data formats such as JSON, XML, CSV, etc
  • Experience with version control systems like Git