Senior Data Pipeline Specialist

2 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Summary:

We are seeking a highly skilled Data Engineer to design, develop and maintain scalable data pipelines and ETL processes using GCP services.

  • Data Pipeline Design and Development: Utilize GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer, Cloud Function, and Cloud Run to create efficient and scalable data pipelines.
  • Collaboration and Communication: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Data Integration: Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources.
  • Data Optimization: Optimize and tune data pipelines for performance, reliability, and cost-efficiency.
  • Data Quality Assurance: Ensure data quality and integrity through data validation, cleansing, and transformation processes.
  • Data Modeling: Develop and maintain data models, schemas, and metadata to support data analytics and reporting.
  • Troubleshooting: Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to data workflows.
  • Professional Development: Stay up-to-date with the latest GCP technologies and best practices, and provide recommendations for continuous improvement.
  • Mentorship: Mentor and guide junior data engineers, fostering a culture of knowledge sharing and collaboration.

Qualifications:

  • Educational Background: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Experience: 4 to 6 years of experience in data engineering, with a strong focus on GCP.
  • Technical Skills: Proficiency in GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer, Cloud Function, and Cloud Run. Strong programming skills in Python and PLSQL. Experience with SQL and NoSQL databases.
  • Soft Skills: Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work in a fast-paced, dynamic environment.

  • Senior Data Pipeline Specialist

    7 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 18,00,000

    Unlock Your Potential in Data EngineeringTransform your career with a Data Engineer role that drives business success.As a critical member of our data engineering team, you will design, build, and manage scalable data pipelines and enterprise data solutions to support analytics, reporting, and data science initiatives. This high-impact role requires deep...

  • Senior Data Pipeline Specialist

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Data Engineer PositionJob Overview:We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will collaborate...

  • Lead Data Pipeline Tester

    2 days ago

    Madurai, Tamil Nadu, India beBeeTesting Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Test Lead JobWe are seeking an experienced Senior Test Engineer to drive the testing strategy and execution for a project.The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management.Drive testing strategy and execution for data pipeline projectsTest data pipelines using...

  • Senior Data Pipeline Developer

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,75,00,000

    Job Opportunity: Data EngineerMumbai is home to a thriving data engineering community, and we are seeking an experienced professional to join our team.We are looking for a skilled Data Engineer with expertise in designing, developing, and maintaining batch and streaming data pipelines using PySpark. The ideal candidate will have hands-on experience in...

  • Data Integration Professional

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Integration SpecialistWe are seeking a highly skilled data integration specialist to join our team. The ideal candidate will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business stakeholders to deliver scalable and high-performing data pipelines.

  • Senior Data Engineer

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role We're seeking an accomplished Data Pipeline Specialist to drive the development and operation of high-performance data pipelines that integrate healthcare data in real-time. As a critical member of our AI-powered applications team, you will design robust pipelines to process clinical encounter data, retrieve associated medical documents, and...

  • Senior Data Specialist

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataSpecialist Full time US$ 1,00,000 - US$ 1,20,000

    Senior Data SpecialistThe role of a Senior Data Specialist revolves around developing and implementing data-driven solutions to drive business growth. We are seeking an experienced professional to join our team and leverage their skills in data analysis, machine learning, and optimization methodologies.Key Responsibilities:Develop and maintain advanced data...

  • Senior Data Protection Specialist

    6 hours ago

    Madurai, Tamil Nadu, India beBeeDataProtection Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Senior Data Protection SpecialistOverviewWe are seeking an experienced Senior Data Protection Specialist to join our team in a data center environment. The ideal candidate will possess expertise in backup tools, tape libraries, and disaster recovery solutions.Key Responsibilities:Configure and manage backup systems for regular data backups,...

  • Expert Data Architect

    7 days ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,20,000 - US$ 1,60,000

    About usWe are seeking a Senior Data Engineer with deep expertise in building scalable data pipelines and integrating healthcare data.This is a critical role where you will design, build, and operate the backbone of our applications. You will work in close collaboration with software engineers, ML specialists, and clinical partners to bring our vision to...

  • # Senior Data Migration Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Migration SpecialistThe ideal candidate will be responsible for designing and implementing robust ETL workflows to streamline data migration activities.This senior-level position involves assessing legacy systems, formulating effective migration strategies, and ensuring seamless business continuity.We are seeking a highly skilled professional...