Highly Skilled Data Miner

11 hours ago

Mangalore, Karnataka, India beBeeDataMining Full time ₹ 15,00,000 - ₹ 20,00,000
Job Description:

This role involves developing robust web scraping solutions to extract structured and unstructured data from various websites and APIs.

  • Data Extraction: Design, develop, and maintain automated scripts to extract data from dynamic websites, including handling JavaScript-driven content.
  • Data Processing: Utilize tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for efficient data scraping and processing.
  • Automated Scripting: Build and manage automated scripts to scrape websites efficiently and accurately.
  • API Integration: Work with APIs to gather and integrate data, ensuring proper rate limits and authentication handling.
  • Data Storage: Clean, preprocess, and store extracted data in databases (SQL) or cloud-based systems.
  • Collaboration: Collaborate with data analysts and other stakeholders to provide required data for further analysis and reporting.

Key Responsibilities Include:

  1. Designing, developing, and maintaining robust web scraping solutions.
  2. Extracting structured and unstructured data from various websites and APIs.
  3. Utilizing tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for efficient data scraping and processing.
  4. Building and managing automated scripts to scrape websites efficiently and accurately.
  5. Working with APIs to gather and integrate data, ensuring proper rate limits and authentication handling.
  6. Cleaning, preprocessing, and storing extracted data in databases (SQL) or cloud-based systems.

Required Skills and Qualifications:

  • 2-3 years of hands-on experience in web scraping and data extraction.
  • Strong proficiency in Python programming language.
  • Experience with web scraping frameworks and libraries like Selenium, Scrapy, BeautifulSoup, and Requests.
  • Experience with data manipulation libraries like Pandas.
  • Familiarity with API integration (REST, GraphQL, etc.).
  • Proficiency in SQL for data querying, database design, and managing large datasets.

  • Highly Skilled Data Integration Professional

    7 days ago

    Mangalore, Karnataka, India beBeeDataIntegration Full time ₹ 10,00,000 - ₹ 20,00,000

    Business Systems Integration SpecialistWe are seeking a highly skilled Business Systems Integration Specialist to join our team.The ideal candidate will have expertise in building data crawlers, extracting data from customers' data sources, and troubleshooting issues during data loading & processing. They will also be responsible for designing and building...

  • Highly Skilled Data Integration Specialist

    1 week ago

    Mangalore, Karnataka, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Informatica DeveloperWe are seeking a highly skilled and experienced professional with expertise in data pipeline development, ETL design, and cloud data integration.Key Responsibilities:Design, develop, and deploy complex data solutions using Informatica IDMC.Collaborate with stakeholders to define technical requirements and create...

  • Senior Data Miner

    7 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking a skilled Data Analyst to join our team in designing, developing and maintaining robust data mining solutions. As a key member of the data team, you will be responsible for extracting structured and unstructured data from various websites and APIs.Responsibilities:Design and implement efficient and scalable data extraction systems using...

  • Highly Skilled Data Quality Professional Wanted

    6 days ago

    Mangalore, Karnataka, India beBeeDataQuality Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Data Quality professional to join our organization. This is an exciting opportunity for someone with hands-on experience in developing and executing tests using various tools and technologies.Develop and execute tests using SQL, Tricentis, Python (PySpark), and data quality frameworks.Focus on Data Pipeline,...

  • Highly Skilled Data Expert

    6 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Role: Senior Data EngineerJob Description:We are seeking a talented professional to fill the role of Senior Data Engineer. As a member of our team, you will be responsible for designing and implementing high-quality data pipelines and systems that power reporting, analytics, and operational use cases.This is a remote-first opportunity with a strong...

  • Highly Skilled Data Engineer Wanted

    7 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data Engineer Role OverviewJob Description:We are seeking an experienced data engineer to develop and maintain automated data pipelines in support of business analytics initiatives. The ideal candidate will have a strong understanding of data engineering principles, excellent technical skills, and excellent communication and collaboration skills.Main...

  • Highly Skilled Freelance Data Architect

    5 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    Job Title: Freelance Data EngineerRole OverviewWe are seeking a skilled Freelance Data Engineer to join our team. As a key member, you will design, build, and optimize large-scale data pipelines using cutting-edge technologies.Main ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data profiling,...

  • Highly Skilled Data Professional Wanted

    4 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Key Data Engineer RoleWe are seeking an experienced data engineer to design, build and maintain production-level data pipelines that handle large-scale data.As a key member of our data engineering team, you will be responsible for working closely with AI/ML teams to support model training, retrieval-augmented generation (RAG), and analytics pipelines. You...

  • Highly Skilled Software Developer

    2 days ago

    Mangalore, Karnataka, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleWe are looking for a highly skilled software developer to join our team. The ideal candidate will have a strong background in desktop application development with 3-5 years of experience.

  • Highly Skilled Software Development Professional with Data Engineering Expertise

    4 days ago

    Mangalore, Karnataka, India beBeeDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Senior Full Stack Developer with expertise in data engineering to join our team. As a key member of our software development team, you will be responsible for designing and building software systems, user interfaces, and data infrastructure that power our analytics, data science, and decision support...