Python Web Scraper

1 week ago

Bengaluru, India Talent Acceleration Corridor Full time

Requirements :


They are looking for Python Web Scraper, who should continually strive to advance engineering excellence and technology innovation.


The mission is to power the next generation of digital products and services through innovation, collaboration, and transparency.


You will be a technology leader and doer who enjoys working in a dynamic, fast-paced environment.

Responsibilities :

- Design and build scalable, reliable web scraping solutions using Python/PySpark.

- Develop enterprise-grade scraping services that are robust, fault-tolerant, and production-ready.

- Work with large volumes of structured and unstructured data; parse, clean, and transform as required.

- Implement robust data validation and monitoring processes to ensure accuracy, consistency, and availability.

- Write clean, modular code with proper logging, retries, error handling, and documentation.

- Automate repetitive scraping tasks and optimize data workflows for performance and scalability.

- Optimize and manage databases (SQL/NoSQL) to ensure efficient data storage, retrieval, and manipulation for both structured and unstructured data.

- Analyze and identify data sources relevant to business needs.

- Collaborate with data scientists, analysts, and engineers to integrate data from disparate sources and ensure smooth data flow between systems.

Desired Profile :

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

- 2-4 years of experience in web scraping, data crawling, or data engineering.

- Proficiency in Python with web scraping tools and libraries (e.g., Beautiful Soup, Scrapy, or Selenium).

- Basic working knowledge of PySpark and data pipelines.

- Experience with cloud-based platforms (AWS, Google Cloud, Azure) and familiarity with cloud-native data tools like Apache Airflow and EMR.

- Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).

- Understanding of data governance, data security best practices, and data privacy regulations (e.g., GDPR, HIPAA).

- Familiarity with version control systems like Git.

(ref:hirist.tech)

  • Web Scraping Developer

    6 days ago

    Bengaluru, India Gmware Full time

    We are hiring a Python Developer (0.52 yrs) for web scraping. Responsibilities: build & optimize scrapers, handle dynamic sites, proxies & CAPTCHAs, ensure data accuracy. Skills: Python, Scrapy, BeautifulSoup, Selenium, regex, debugging. Provident fundHealth insurance

  • Web Scraping Developer

    2 weeks ago

    Bengaluru, Karnataka, India Gmware Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    We are hiring a Python Developer (0.52 yrs) for web scraping. Responsibilities: build & optimize scrapers, handle dynamic sites, proxies & CAPTCHAs, ensure data accuracy. Skills: Python, Scrapy, BeautifulSoup, Selenium, regex, debugging.Provident fundHealth insurance

  • Gmware - Web Scraping Developer

    1 week ago

    Bengaluru, India GM WARE Full time

    Job Description :Web Scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated knowledge experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.Roles and Responsibilities :- Develop and maintain service that extracts websites...

  • Data Engineer

    1 week ago

    Bengaluru, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Python Web Developer

    1 week ago

    Bengaluru, India hashxpert Full time

    Skills and Qualifications : - Work experience as a Python web Developer- Expertise in Python framework such as FastAPI.- Knowledge of object-relational mapping (ORM) such as SqlAlchemy.- Strong knowledge of database technologies like SQL and NoSQL.- Able to write complex SQL/NoSQL queries.- Experience working with containerised applications like docker.-...

  • Web Scraping Expert

    1 week ago

    Bengaluru, India FullStackTechies Full time

    AIMLEAP is Hiring: **Web Scraping Expert - Python Trainer** Experience: 3 to 7 Years Location: Bangalore (Work from Home) No of positions: 2 Work Timing**:8:30AM to 1:00 PM** Industry: Automation/IT-Software Employment Type**:Full Time/Part Time/Consulting** Educational Qualification: B.Tech / B.E / MCA / BCA/MBA Salary/CTC: 4 lacs to 8 lacs INR per...

  • Web Automation Engineer Python+Selenium

    1 week ago

    Bengaluru, India L&T Technology Services Full time

    Role : Web Automation Engineer Python+Selenium Experience : 2-5 Years Location : Bengaluru Job Description • Analyse requirements and create detailed test plans, test cases, and test scripts. • Execute manual test cases to validate software functionality, performance, and usability. • Perform regression, functional, integration, and system...

  • Web automation engineer python+selenium

    6 days ago

    Bengaluru, India L&T Technology Services Full time

    Role : Web Automation Engineer Python+SeleniumExperience : 2-5 YearsLocation : BengaluruJob Description• Analyse requirements and create detailed test plans, test cases, and test scripts. • Execute manual test cases to validate software functionality, performance, and usability.• Perform regression, functional, integration, and system testing.•...

  • Web Automation Engineer Python+Selenium

    3 weeks ago

    Bengaluru, Karnataka, India L&T Technology Services Full time

    Role : Web Automation Engineer Python+Selenium Experience : 2-5 Years Location : Bengaluru Job Description • Analyse requirements and create detailed test plans, test cases, and test scripts. • Execute manual test cases to validate software functionality, performance, and usability. • Perform regression, functional, integration, and system testing....

  • Web Automation Engineer Python+Selenium

    2 weeks ago

    Bengaluru, Karnataka, India L&T Technology Services Full time

    Role : Web Automation Engineer Python+SeleniumExperience : 2-5 YearsLocation : BengaluruJob Description• Analyse requirements and create detailed test plans, test cases, and test scripts. • Execute manual test cases to validate software functionality, performance, and usability.• Perform regression, functional, integration, and system testing.•...