Advanced Data Engineer

3 days ago

Nashik, Maharashtra, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

Job Description

The ideal candidate will have expertise in automating data extraction processes from web platforms with a strong proficiency in Python and experience with web scraping frameworks like Selenium Scrapy and BeautifulSoup.

Main Responsibilities:
  • Design develop and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.
  • Use tools like Python Selenium BeautifulSoup Scrapy and Pandas for data scraping and processing.
  • Build and manage automated scripts to scrape dynamic websites including handling JavaScript-driven content.
  • Optimize scraping workflows to ensure data extraction is efficient accurate and scalable.
  • Work with APIs to gather and integrate data ensuring proper rate limits and authentication handling.
  • Clean preprocess and store extracted data in databases (SQL) or cloud-based systems.
  • Collaborate with data analysts and other stakeholders to provide required data for further analysis and reporting.
  • Debug and troubleshoot issues in scraping pipelines and scripts.
  • Ensure compliance with ethical data scraping standards including legal considerations like website terms of use and robots.txt policies.

Requirements:

  • 1-3 years of hands-on experience in web scraping and data extraction.
  • Strong proficiency in Python.
  • Experience with web scraping frameworks and libraries like Selenium Scrapy BeautifulSoup and Requests.
  • Experience with data manipulation libraries like Pandas.
  • Familiarity with API integration (REST GraphQL etc.).
  • Proficiency in SQL for data querying database design and managing large datasets.
  • Knowledge of JavaScript and front-end technologies to work with dynamic web pages.
  • Experience with version control (Git) and collaborative development environments.

  • Advanced Data Analyst

    2 days ago

    Nashik, Maharashtra, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Are you a highly skilled and experienced data professional seeking a challenging role where you can utilize your analytical skills to drive business outcomes? We are looking for a Senior Data Scientist to join our team, responsible for leading advanced analytics initiatives. The ideal candidate will have a strong background in mathematics and experience with...

  • Data Engineering Expert

    3 days ago

    Nashik, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    Job Title:Senior Data EngineerJob Description:We are seeking a Senior Data Engineer to join our team. The ideal candidate will have experience in designing, building, and maintaining highly scalable data pipelines.The Senior Data Engineer will be responsible for constructing and optimizing our data pipeline architecture, collaborating closely with data...

  • Advanced Big Data Architect

    2 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job DescriptionWe are seeking a highly skilled Data Architect to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into our data lake and data warehouse.Key...

  • Senior Data Engineer

    2 weeks ago

    Nashik, Maharashtra, India SPIRO Full time

    Position: Senior Data Engineer Location: Pune Experience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Advanced Well Data Analyst

    6 hours ago

    Nashik, Maharashtra, India beBeePetrophysicist Full time ₹ 1,50,00,000 - ₹ 2,12,00,000

    Job OpportunityRole Overview:The Senior Petrophysicist will lead petrophysical evaluations across exploration, appraisal, and development wells. Ensuring high-quality data acquisition and reservoir characterization are key responsibilities of this role.Key Responsibilities:Lead petrophysical activities for exploration, appraisal, and development wells.Design...

  • Senior Data Engineer

    2 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a highly skilled and experienced Data Engineering Professional to join our team.Job DescriptionData Ingestion and Transformation: Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.Scalable Data Architectures: Design and implement scalable data architectures following best...

  • Master Data Engineer

    2 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Power BI Developer OpportunityAptimized seeks a skilled Power BI Developer to support enterprise data initiatives. This role combines hands-on data engineering and ETL development with business intelligence and power BI reporting delivery, ensuring timely and accurate insights for business stakeholders.Key Responsibilities:Data Engineering &...

  • Advanced Data Analyst

    1 day ago

    Nashik, Maharashtra, India beBeeDataScience Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    AI Talent WantedWe're seeking a skilled Data Analyst/Scientist to join our team.Job Description:As a key member of our data science team, you will be responsible for building and deploying large-scale AI models that predict on-the-job performance. You'll work closely with our engineering team to design and run experiments, analyze results, and make...

  • Data Engineering Expert for AI Systems

    21 hours ago

    Nashik, Maharashtra, India beBeeArtificialIntelligence Full time US$ 90,000 - US$ 1,20,000

    About UsWe are a leading data engineering company serving over 2,000 customers worldwide. We combine advanced technologies and subject matter expertise to unlock the full potential of artificial intelligence.

  • Cloud Data Engineer Leadership Opportunity

    2 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Engineer PositionWe are seeking a highly experienced data engineer to lead our team. As a senior data engineer, you will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS...