Senior Data Pipeline Specialist

6 days ago

Bijapur, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Summary

We are seeking an experienced Data Engineer to join our team and contribute to the design and implementation of efficient data pipelines.

Main Responsibilities
  • Design, develop, and maintain scalable and efficient data pipelines using big data technologies such as PySpark.
  • Write complex data transformations using PySpark to process large datasets and extract meaningful insights.
  • Optimize Spark jobs for performance, manage memory and data partitioning, and troubleshoot performance bottlenecks.
  • Build and manage ETL workflows that process data from various sources, including databases, APIs, and file systems.
  • Work with different data sources like HDFS, AWS S3, Google Cloud Storage, and relational or NoSQL databases.
  • Implement data validation checks and monitor data pipeline health, logging, and error handling.
  • Collaborate with data scientists, analysts, and business teams to ensure data infrastructure meets the company's needs.
  • Deploy and manage big data workflows on cloud platforms such as AWS, Azure, or GCP.
  • Maintain clear documentation for code, processes, and system designs and promote best practices in coding, version control, and testing.

  • Data Science Specialist

    2 weeks ago

    Bijapur, Karnataka, India Carrier Full time

    Country IndiaLocation Ecospace Campus 3A 4th Floor Outer Ring Road Bellandur Bengaluru- 560103Location - BengaluruSkills - Data Science SpecialistAbout the Role We are seeking an experienced Data Science Specialist to join our AI delivery team in a strategic technical leadership role The ideal candidate will serve as a technical thought leader ...

  • Big Data

    6 days ago

    Bijapur, Karnataka, India Diverse Lynx Full time

    Hiring for Big Data PySpark Engineer - Chennai Bangalore Job Overview We are looking for a Big Data PySpark Engineer to join our dynamic data engineering team The ideal candidate will have hands-on experience with big data frameworks particularly Apache Spark with a focus on PySpark and be capable of building optimizing and managing large-scale...

  • Senior Consultant

    3 weeks ago

    Bijapur, Karnataka, India HCLTech Full time

    8+ years of strong proficiency in designing and implementing the solution involvingDesigning data models, Planning databases, Ensuring data security, Improving databases, Creating a data catalog, Staying current5+ years of experience with testing tools related to big data technologies (e.g., Spark, Databricks)3+ years of expertise with big data technologies...

  • Visualization Specialist

    1 week ago

    Bijapur, Karnataka, India beBeeVisualization Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Visualization Specialist">We are seeking a highly skilled Visualization Specialist to join our team. The successful candidate will be responsible for creating engaging and informative visualizations that effectively communicate complex data and information.Key Responsibilities:Design visually appealing graphics for various platforms, including...

  • Senior Engineer

    1 week ago

    Bijapur, Karnataka, India kec international Full time

    We are seeking a highly motivated and experienced Assistant Manager Quality for our solar division The ideal candidate will have a strong background in quality management preferably within the solar industry The Assistant Manager Quality will be responsible for ensuring that our solar projects meet and exceed quality standards contributing to the overall...

  • Senior Debt Collector

    6 days ago

    Bijapur, Karnataka, India beBeeDebtRecovery Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Debt Recovery SpecialistA key position in our organization, the Debt Recovery Specialist plays a crucial role in managing and coordinating debt collection activities.This involves collaborating with teams to maintain credit portfolios and administer corporate policies that minimize front-end delinquencies.Main Responsibilities:To recover assigned products...

  • AI Delivery Team Lead

    2 weeks ago

    Bijapur, Karnataka, India beBeeDataScience Full time ₹ 30,00,000 - ₹ 40,00,000

    About the Role:">We are seeking a seasoned Machine Learning Architect to lead our AI delivery team in a strategic technical leadership role.">Architect and lead the development of sophisticated machine learning solutions for our most complex and high-impact business challenges, ensuring scalability, maintainability, and business value.Drive technical...

  • Hospice Support Specialist

    4 days ago

    Bijapur, Karnataka, India beBeeHospital Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Opportunity:As a Hospital Enabling Support professional, you will be part of a dynamic team that delivers high-quality patient care and support services across multiple locations. Our goal is to provide a safe and compassionate environment for patients, families, and staff.Key Responsibilities:Provide enabling support to patients, families, and staff in...

  • Senior Laboratory Specialist

    7 days ago

    Bijapur, CT, IN beBeeLaboratory Full time ₹ 18,000 - ₹ 1,80,000

    As a key member of our team, we are seeking a skilled and experienced laboratory professional to operate microscopes and conduct diagnostic tests.Job RequirementsA minimum qualification in Medical Laboratory Technology (DMLT)Extensive experience in pathology procedures, with a proven track record of conducting accurate and reliable test resultsProficiency in...