SDE - Bengaluru

4 weeks ago

bangalore, India Weekday Full time
This role is for one of the Weekdays clients
We are seeking a talented and motivated Software Development Engineer (SDE) with expertise in data scraping to join our team. The ideal candidate will have strong experience in designing and implementing web scraping solutions data extraction techniques and working with structured and unstructured data. You will collaborate closely with the data engineering and product teams to ensure highquality reliable data scraping for business insights and decisionmaking.
Key Responsibilities:
  • Develop maintain and optimize web scraping tools to extract large volumes of data from multiple websites and APIs.
  • Design and implement scalable data pipelines for efficient data collection storage and processing.
  • Write clean efficient and maintainable code for data scraping and parsing.
  • Implement solutions for dynamic website scraping handling AJAX requests Captchas and other challenges.
  • Ensure data quality by validating cleaning and formatting scraped data.
  • Collaborate with crossfunctional teams to understand data requirements and integrate data into the companys data infrastructure.
  • Monitor and troubleshoot scraping jobs ensuring timely and accurate data collection.
  • Stay uptodate with the latest trends and technologies in web scraping automation and data extraction.

Required Skills and Qualifications:
  • Bachelor s degree in Computer Science Engineering or a related field.
  • 2 years of experience in data scraping web crawling or data extraction.
  • Proficiency in programming languages like Python Java or Node.js.
  • Strong knowledge of libraries and frameworks such as BeautifulSoup Scrapy Selenium Puppeteer or Playwright.
  • Experience working with APIs (RESTful GraphQL) and understanding of HTTP/HTTPS protocols.
  • Handson experience with database systems (SQL NoSQL) for storing and processing large data sets.
  • Familiarity with cloud services like AWS GCP or Azure for scaling data scraping solutions.
  • Experience handling dynamic web pages Captchas and ratelimiting challenges.
  • Solid understanding of data structures algorithms and software design principles.
  • Strong debugging problemsolving and optimization skills.

Preferred Qualifications:
  • Experience in building scalable distributed data scraping systems.
  • Familiarity with DevOps practices CI/CD pipelines and version control (Git).
  • Exposure to big data tools such as Hadoop Spark or Kafka.
  • Knowledge of web automation and bots development.

programming languages,devops practices,web automation,data,web scraping,data extraction,data scraping,apis,cloud services,big data tools,database systems,libraries and frameworks

  • Sde - Bengaluru

    1 day ago

    bangalore, India Hevo Data Full time

    About Hevo: Ever wondered, what’s common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful No-code...

  • SDE - Bengaluru

    3 weeks ago

    bangalore, India Weekday Full time

    This role is for one of the Weekdays clientsWe are seeking a talented and motivated Software Development Engineer (SDE) with expertise in data scraping to join our team. The ideal candidate will have strong experience in designing and implementing web scraping solutions data extraction techniques and working with structured and unstructured data. You will...

  • Sde java

    5 days ago

    Bangalore, India Enterprise Minds, Inc Full time

    Hiring: Senior Software Development Engineer - Java (SDE - Java) Location: Bengaluru Experience: 5to 8 years Notice Period: Immediate to 10 days Are you a passionate and skilled Java Developer with strong expertise in building scalable and robust microservices-based applications? We are looking for a Senior Software Development Engineer (SDE) to join...

  • Software Development Manager- Backend Java

    3 weeks ago

    bangalore, India Tesco Bengaluru Full time

    Company DescriptionTesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global Business...

  • SDE Java

    7 days ago

    bangalore, India Enterprise Minds, Inc Full time

    Hiring: Senior Software Development Engineer - Java (SDE - Java)Location: BengaluruExperience: 5to 8 yearsNotice Period: Immediate to 10 daysAre you a passionate and skilled Java Developer with strong expertise in building scalable and robust microservices-based applications? We are looking for a Senior Software Development Engineer (SDE) to join our dynamic...

  • Software development manager- backend java

    3 weeks ago

    Bangalore, India Tesco Bengaluru Full time

    Company Description Tesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global...

  • Software Development Manager- Backend Java

    3 weeks ago

    Bangalore, India Tesco Bengaluru Full time

    Company Description Tesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global Business...

  • Sde - Bengaluru

    1 day ago

    bangalore, India Rupicard Full time

    Company Overview: Rupicard is a fintech startup based in Bengaluru that aims to democratize access to credit cards and design a credit card tailored for Bharat. We strive to make credit cards accessible to all, transcending geographical constraints and financial backgrounds. We actively support users in building and improving their credit scores,...

  • Software Development Manager- Backend Java

    1 month ago

    Bangalore City, India Tesco Bengaluru Full time

    Company DescriptionTesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global Business...

  • Software Development Manager- Backend Java

    1 month ago

    bangalore, India Tesco Bengaluru Full time

    Company Description Tesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global Business...

  • Software Development Manager- Backend Java

    3 weeks ago

    Bangalore, India Tesco Bengaluru Full time

    Company Description Tesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global...

  • Software Development Manager- Backend Java

    2 weeks ago

    bangalore, India Tesco Bengaluru Full time

    Company Description Tesco Bengaluru: We are a multi-disciplinary team creating a sustainable competitive advantage for Tesco by standardising processes, delivering cost savings, enabling agility, providing cutting-edge technological solutions and empowering our colleagues to do ever more for our customers. With cross-functional expertise in Global Business...

  • SDE Java

    7 days ago

    bangalore, India Enterprise Minds, Inc Full time

    Hiring: Senior Software Development Engineer - Java (SDE - Java) Location: Bengaluru Experience: 5to 8 years Notice Period: Immediate to 10 days Are you a passionate and skilled Java Developer with strong expertise in building scalable and robust microservices-based applications? We are looking for a Senior Software Development Engineer (SDE) to join our...

  • Software Development Engineer

    3 weeks ago

    Bangalore, India Bhanzu Full time

    Job Title: Front-End Software Development Engineer Department: Engineering Location: HSR Layout, Bengaluru Summary: We are seeking a highly skilled and passionate Front-End Software Development Engineer (SDE) to join our team. As an SDE, you will play a crucial role in designing, developing, and maintaining the user interface of our innovative products....

  • Software development engineer

    3 weeks ago

    Bangalore, India Bhanzu Full time

    Job Title: Front-End Software Development Engineer Department: Engineering Location: HSR Layout, Bengaluru Summary: We are seeking a highly skilled and passionate Front-End Software Development Engineer (SDE) to join our team. As an SDE, you will play a crucial role in designing, developing, and maintaining the user interface of our innovative...

  • Software Development Engineer

    6 days ago

    bangalore, India Bhanzu Full time

    Job Title: Front-End Software Development EngineerDepartment: EngineeringLocation: HSR Layout, BengaluruSummary:We are seeking a highly skilled and passionate Front-End Software Development Engineer (SDE) to join our team. As an SDE, you will play a crucial role in designing, developing, and maintaining the user interface of our innovative products. You will...

  • Software Development Engineer

    1 month ago

    bangalore, India Bhanzu Full time

    Job Title: Front-End Software Development Engineer Department: Engineering Location: HSR Layout, Bengaluru Summary: We are seeking a highly skilled and passionate Front-End Software Development Engineer (SDE) to join our team. As an SDE, you will play a crucial role in designing, developing, and maintaining the user interface of our innovative products....

  • Software Engineer with Testing experience

    3 weeks ago

    bangalore, India Recro Full time

    Job Title: Software Development Engineer (SDE) with Testing ExpertiseExperience Required: 3.5 - 4.5 yearsLocation: Bengaluru, 5 days/week !! Need immediate joiners only !!Job Description:We are seeking a highly skilled and motivated Software Development Engineer (SDE) with a strong background in both development and testing. The ideal candidate will be...

  • Software engineer with testing experience

    3 weeks ago

    Bangalore, India Recro Full time

    Job Title: Software Development Engineer (SDE) with Testing Expertise Experience Required: 3.5 - 4.5 years Location: Bengaluru, 5 days/week !! Need immediate joiners only !! Job Description: We are seeking a highly skilled and motivated Software Development Engineer ( SDE ) with a strong background in both development and testing . The ideal...

  • Software Engineer with Testing experience

    3 days ago

    bangalore, India Recro Full time

    Job Title: Software Development Engineer (SDE) with Testing Expertise Experience Required: 3.5 - 4.5 years Location: Bengaluru, 5 days/week !! Need immediate joiners only !! Job Description: We are seeking a highly skilled and motivated Software Development Engineer (SDE) with a strong background in both development and testing. The ideal candidate will...