Only 24h Left: Web Scraping Developer|| Exp 3 to 5 yrs|| CTC 6.5 LPA ||NP 30 days || Location Bangalore

3 weeks ago


India Angel & Genie Full time
Job Description

Job Summary:

We are seeking a skilled Web Scraping Developer to design and develop scalable and efficient web scraping applications to extract data from various websites. The ideal candidate should be proficient in PHP/Python, web scraping frameworks (Scrapy, Beautiful Soup), MySQL, HTML/CSS and Javascript. This role requires strong analytical thinking, problem-solving abilities, and a proactive approach to tackling challenges.

Key Responsibilities:

1. Requirement Analyzing:

. Understand the requirement from the Project Manager via the Project Management tool.

. Analyze tasks and discuss them with the team.

. Record all details in the Project Management Tool, including time estimation for completion.

2. Data Extraction:

. Research and identify websites, APIs, and data sources for extraction.

. Analyze website structures (HTML, CSS, JavaScript) to determine the best extraction approach.

. Develop scripts using PHP, Python, or JavaScript to extract data.

. Implement techniques to bypass anti-scraping measures (e.g., CAPTCHAs, rate limiting, IP blocking).

. Store extracted data in structured formats (JSON, CSV).

3. Data Processing & Storage:

. Clean and preprocess extracted data to ensure accuracy and completeness.

. Transform data into required formats (JSON, CSV).

. Handle missing data using imputation techniques or data cleaning methods.

. Design a database schema to store extracted data securely.

. Implement data validation and error-handling mechanisms.

4. Troubleshoot Issues:

. Identify and resolve issues related to web scraping applications.

. Ensure data extraction remains functional despite website changes.
  • 3 Days Left Manager

    3 weeks ago


    India Hema's Enterprises Pvt Ltd Full time

    We are seeking a dynamic Business Development Manager for the recruitment industry The ideal candidate will be responsible for - Identifying and pursuing new business opportunities in contract and permanent staffing- Building and maintaining strong client relationships- Developing and executing strategic sales plans- Achieving sales targets and driving...


  • India PRONTO CONSULTING SERVICES Full time

    Client : STL Sterlite Technologies Limited. Full-time Emp with STL. Location : Hyderabad, Bangalore, Pune, Noida, Gurgaon. Role : Oracle AIA Developer / Lead. Exp : 5 to 10 yrs. Location : Bangalore, Hyderabad, Pune, Gurgaon, Noida Hybrid. NP : < 60 days. Max CTC : 30 LPA. Job Description : - Proven experience as a Senior Oracle AIA Developer, working on...

  • Oracle AIA Developer

    3 weeks ago


    India PRONTO CONSULTING SERVICES Full time

    Client : STL Sterlite Technologies Limited. Full-time Emp with STL. Location : Hyderabad, Bangalore, Pune, Noida, Gurgaon.Role : Oracle AIA Developer / Lead. Exp : 5 to 10 yrs. Location : Bangalore, Hyderabad, Pune, Gurgaon, Noida Hybrid. NP : < 60 days. Max CTC : 30 LPA.Job Description :- Proven experience as a Senior Oracle AIA Developer, working on...


  • india oneviewHR Full time

    Job Title: JAVA J2EE Developer - 5+ Yrs Exp MAX BUDGET: 25 LPA BASED ON EXPERIENCE Work from Office, Murugeshpalya Bengaluru  Key Responsibilities: ● Work with junior developers and ensure good delivery to customer ● Work closely with customer and/or his team and ensure good experience to customer along with technical delivery ● Provide prompt...


  • India Forage AI Full time

    We are seeking a talented Python Web Scraping Developer to join our team at Forage AI. As a Python Web Scraping Developer, you will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.You will develop and refine crawlers using Python-based tools and frameworks such as Scrapy, and...


  • India MrScraper Full time

    Job Overview: We are seeking a skilled Web Scraping Engineer to help us extract, process, and analyze large-scale data from the web. This role involves developing efficient, scalable, and resilient scraping solutions to gather structured and unstructured data from diverse online sources. Key Responsibilities: Design, build, and maintain web scraping scripts,...


  • India MrScraper Full time

    Job Overview:We're looking for a Web Scraping Engineer to join our team and help us extract, process, and analyze large-scale data from the web. You'll be responsible for developing efficient, scalable, and resilient scraping solutions to gather structured and unstructured data from diverse online sources. If you thrive on solving complex problems, working...


  • India hotsourced Full time

    Job DescriptionSummaryWere a fully female-founded company on a mission to change the way people search and shop online for fashionforever Were going to spark a new era of fashion discovery, igniting confidence in everybody and every body, and to create a world where fashion confidence starts with us.We are at the beginning of an exciting journey and were...

  • Data Scientist

    4 days ago


    India Adglobal360 Full time

    We are seeking a highly skilled Data Scientist to join our team as a Web Scraping Specialist. In this role, you will be responsible for designing and developing robust web scraping solutions using Python and related libraries.">The ideal candidate will have strong expertise in web scraping and data extraction using Python, proficiency in web scraping...

  • Web Scraping Expert

    5 days ago


    India YipitData Full time

    Crafting Resilient Web ScrapersYipitData is seeking a skilled Web Scraping Expert to join our Data Solutions team. In this transformative role, you will design, refactor, and maintain web scrapers that drive critical reports across our organization, ensuring data ingestion processes are resilient, efficient, and scalable.About the JobCollaborate with...


  • India Nityo Infotech Services Pte. Ltd Full time

    Job DescriptionJob DescriptionExperience range - 2 to 6 Years. Production support experience. AWS: Knowledge of scheduling spark applications in AWS EMR cluster. Design, build and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB,...


  • India LION & ELEPHANTS Full time

    HIRING MERN Full stack LEADS & ARCHITECTS Location: Bangalore, Pune, Mumbai (Architect - +Gurugram)Budget: 30 – 40 LPANotice Period: Immediate to 15 days Exp:  Lead - 6 to 10 yrs || Architect: 8 to 13 yrsRole DescriptionThis is a full-time role for a MERN Full Stack Lead or Architect. The individual in this position will be...

  • Web Scraping Expert

    7 days ago


    India brightedge Full time

    Data Engineer Job DescriptionThe successful candidate will be responsible for developing and maintaining data collection pipelines to efficiently ingest and store structured and unstructured data. They will also implement web scraping techniques and APIs for real-time and batch data retrieval. Additionally, they will optimize data storage and query...


  • India HTC Global Services Full time

    IBM DataStage Development with ETL Experience: 6+ years Location: Chennai/Bangalore/Hyderabad Notice Period: Immediate to 15 days Job Description: Min 6+ Yrs of experience in IBM DataStage Development, ETL Design, Development, Support and basic administration with IBM DataStage. Interested candidates please do share your updated CV to...


  • India Jay Infoservices Full time

    Sales Manage-Health Agency - work 1 - 10 yrs 24 - 40 Years local_offer sales Manager-Health Agency CTC : 3.50 - 5.0 lacs Description The role of Sales Manager is to recruit and Develop a Team of Advisors and get Health Insurance Business through them. ndustry Type : General Insurance Minimum Qualification :Graduate Key Skills :Agency Sales, Health...


  • India Burgeon It Services Pvt Ltd Full time

    We are Looking "Salesforce Developer" - C2H-Pan India NOTE : Apply only who are interested in C2H(Contract to Hire) Position : Salesforce.com Developer Work Location : Pan India Total Experience : 6 Years Relevant Experience : 3 Years Notice Period : Immediate-30 Days Description : - 6 year hands on experience as Salesforce.com developer, involved in...


  • Anywhere in India/Multiple Locations ALTERNATIVE PATH PRIVATE LIMITED Full time

    Company Overview">The Web Scraping Team at Alternative Path Private Limited is a dynamic and innovative group focused on delivering high-quality proprietary datasets, timely notifications, and exceptional service to support clients' daily investment decisions.Job DescriptionWe are seeking a creative and detail-oriented developer to contribute to client...


  • India Petras Solutions Private Limited Full time

    About the Job : In full growth, particularly internationally, we are looking for new collaborators to join our fabulous team A young but experienced, dynamic and complementary team: a resolutely start-up spirit Real job and career opportunities A friendly atmosphere and a climate of trust that promotes autonomy and challenge" Responsibilities : - Responsible...

  • Frontend Architect

    3 days ago


    India Napier & Tidd Full time

    Location: If candidate is in Bangalore then Hybrid / If other locations then Remote work Domain : IT Services (Not mandatory) Exp : 11 yrs exp (3 years relevant Architect experience is mandatory) Mode : Permanent under us Annual Salary : INR 30 LPA Notice : immediate - 30 days Working Hours : 1 PM - 10 PM IST (UK Time Zone) Note : In future short business...

  • Tandem 3 Days Left

    3 days ago


    India Nityo Infotech Services Pte. Ltd Full time

    Job DescriptionJob DescriptionExperience 3-5 years CTC: 10LPA Location: Pune Professional & Relevant Experience 3-5 years on Tandem technologies like COBOL, Netbatch, Pathway, ENFORM, SCOBOL, TACL, TAL, SQL, FUP Good to have - Java, C,NDM,MQ Role Description : Responsible for design, develop, modify, debug and/or maintain software systems. Actively look for...