AdvaRisk - Junior Data Engineer - Web Scraping

1 week ago


Pune, Maharashtra, India AdvaRisk Full time

Roles and responsibilities :

- Build scrapers for collect data from websites with high throughput

- Maintain and improve the existing scrapers

- Solve bottlenecks such as captchas, anti-bots, blockers

- Solve bugs arising from ongoing scraping jobs

Skills required Mandatory :

- 2+ years of experience with Python scripting and development

- 1+ years of experience in building scrapers with Python based libraries such as requests, aiohttp, httpx, selenium, playwright

- In depth knowledge of how different types of websites work

- 2+ years of experience with SQL databases - MySQL/PSQL

- 2+ years of experience with NoSQL databases - MongoDB

- 1+ years of experience with technologies like Proxy, Captcha solvers

- 1+ years of experience with Git

- 1+ years of experience with Agile development cycle

Good to have :

- Understanding of REST API development

- Understanding of ETL pipelines

- Contribution in any open source projects

(ref:hirist.tech)

  • Pune, Maharashtra, India AdvaRisk Full time

    Job overview : This role is crucial for driving the development and optimization of our data pipelines, ensuring data quality. The ideal candidate is a problem-solver who is proficient in Python, SQL, MongoDB and data orchestration tools.Key Responsibilities :- Design, construct, install, test, and maintain highly scalable data pipelines.- Develop complex...


  • Pune, Maharashtra, India AdvaRisk Full time

    Roles and Responsibilities :- REST API development using Python-FastAPI- Understanding product requirements and convert to code- Production environment monitoring and resolving bugs- To stay on top of the product to ensure performance Mandatory :- 3+ years of experience in REST API development with any Python based frameworks (Flask or FastAPI preferable)-...


  • Pune, Maharashtra, India AdvaRisk Full time

    Roles and Responsibilities : REST API development using Python-FastAPI Understanding product requirements and convert to code Production environment monitoring and resolving bugs To stay on top of the product to ensure performanceMandatory : 3+ years of experience in REST API development with any Python based frameworks (Flask or FastAPI preferable) 4+ years...


  • Pune, Maharashtra, India AdvaRisk Full time

    Job Description and Responsibilities :- Data modelling, implementing business logic as well as focusing on engineering and design of the platform.- API design and development- Implementation of CRUD (Create, update, read, delete)- Writing reusable, testable, and efficient code- Design and implementation of low-latency, high-availability, and performant...


  • Pune, Maharashtra, India AdvaRisk Full time

    Job Description and Responsibilities :- Data modelling, implementing business logic as well as focusing on engineering and design of the platform.- API design and development- Implementation of CRUD (Create, update, read, delete)- Writing reusable, testable, and efficient code- Design and implementation of low-latency, high-availability, and performant...


  • Pune, Maharashtra, India AdvaRisk Full time

    Job Description : This is an independent contributor role working in a dynamic team to lead the business requirements for technical implementation working closely with the Product Owner.1. Define project requirements by identifying project milestones, phases and elements; forming a project team; establishing project budget2. Support the product team to...


  • Pune, Maharashtra, India AdvaRisk Full time

    Job Description : This is an independent contributor role working in a dynamic team to lead the business requirements for technical implementation working closely with the Product Owner.1. Define project requirements by identifying project milestones, phases and elements; forming a project team; establishing project budget2. Support the product team to...


  • Pune, Maharashtra, India AdvaRisk Full time

    About Job role :As a Quality Analyst, you will be working on one of our flagship products AdvaSmart. We are scouting for a Quality Analyst enthusiast who possesses hands-on experience in Manual Testing and Automation Testing. This role requires you to take ownership of the end-to-end system and take all requirements ,issues, and enhancements to closure...


  • Pune, Maharashtra, India AdvaRisk Full time

    About Job role :As a Quality Analyst, you will be working on one of our flagship products AdvaSmart. We are scouting for a Quality Analyst enthusiast who possesses hands-on experience in Manual Testing and Automation Testing. This role requires you to take ownership of the end-to-end system and take all requirements ,issues, and enhancements to closure...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India AdvaRisk Full time

    Job overview : This role is crucial for driving the development and optimization of our data pipelines, ensuring data quality. The ideal candidate is a problem-solver who is proficient in Python, SQL, MongoDB and data orchestration tools.Key Responsibilities : Design, construct, install, test, and maintain highly scalable data pipelines. Develop complex...


  • Pune, Maharashtra, India NielsenIQ Full time

    Job Description "The very rapid development of e-commerce today gives access to thousands of information. These data are difficult to exploit by companies, which then have difficulty choosing the right levers of action and measuring their impact. This is where Data Impact by NielsenIQ comes in Every day, we collect more than 60 billion pieces of...


  • Pune, Maharashtra, India AdvaRisk Full time

    Job Description and Responsibilities : Data modelling, implementing business logic as well as focusing on engineering and design of the platform. API design and development Implementation of CRUD (Create, update, read, delete) Writing reusable, testable, and efficient code Design and implementation of lowlatency, highavailability, and performant...


  • Pune, Maharashtra, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...


  • Pune, Maharashtra, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...


  • Pune, Maharashtra, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...

  • Junior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India NetSPI Full time

    Title:Junior Data Engineer Location: Pune, MH We are seeking a Junior Data Engineer to play a pivotal role in our cybersecurity innovation efforts.As a member of our dynamic team, you will be instrumental in developing and maintaining the data pipelines for our new Saa S platform.You will have the opportunity to work on key initiatives that drive the...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India iMind Your Business Solutions Private Limited Full time

    Position: Data EngineerCompany: Leading company in Analytics & Cloud ApplicationsWe are looking for skilled Data Engineers to join the team at our client, a prominent company with headquarters in San Francisco and additional offices in India (Bangalore, Hyderabad, and Pune). Our client specializes in offering strategic guidance and cutting-edge technology...


  • Pune, Maharashtra, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...


  • Pune, Maharashtra, India NR Consulting - India Full time

    Profile:Junior GCP Data EngineerExperience:3 to 7 YearsLocation :Pune , MumbaiJob Description:-" Experience working data warehouses, including data warehouse technical architectures, infrastructure components, ETL ELT and reporting analytic tools and environments. " Experience in technical consulting. " Experience architecting, developing software, or...


  • Pune, Maharashtra, India NR Consulting - India Full time

    Profile:Junior GCP Data EngineerExperience:3 to 7 YearsLocation: Pune , MumbaiJob Description:-" Experience working data warehouses, including data warehouse technical architectures, infrastructure components, ETLELT and reportinganalytic tools and environments." Experience in technical consulting." Experience architecting, developing software, or internet...