Senior Data Engineer

2 weeks ago

Alleppey, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Pipeline Specialist

We are seeking a skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience designing, developing, and maintaining efficient data pipelines using IBM DataStage and AWS Glue/Lambda. Our goal is to build scalable and accurate data flows that support analytics and AI/ML use cases.

Key Responsibilities:
  1. Design and develop ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from various sources.
  2. Bulk and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  3. Participate in code reviews, performance tuning, and defect triage sessions.
  4. Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  5. Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  6. Troubleshoot and resolve issues in QA/UAT/Production environments as needed.


Required Skills and Experience:
- 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
- Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
- Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
- Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
- Familiarity with S3, version control systems (Git), and job orchestration tools.
- Experience with data profiling, cleansing, and quality validation routines.
- Understanding of data lake/data warehouse architectures and DevOps practices.

About the Role:
We are looking for an experienced professional who can work independently and collaboratively to build high-quality data pipelines. The ideal candidate will be able to communicate effectively with cross-functional teams and stakeholders.

We Offer:
- Competitive salary and benefits package.
- Opportunity to work on challenging projects and contribute to the growth of our company.
- Collaborative and dynamic work environment.
- Professional development opportunities.

  • Unlock the Power of Big Data as a Senior Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team.This is a full-time role for a highly experienced ETL Developer based in Bengaluru, working with one of our esteemed overseas clients. The role involves understanding requirements, designing, developing, and testing of ETL architecture, transformation jobs, and workflow...

  • Senior Cloud Native Data Engineer

    2 weeks ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Join Our Team as a Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team and play a key role in designing, building, and maintaining our data pipelines. As a member of our founding technical team, you will have the opportunity to shape the core infrastructure of our company and contribute to its success.Job...

  • Large Scale Data Engineering

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 19,00,000

    **Senior Data Engineer Role**We are seeking a highly skilled Senior Data Engineer to play a crucial role in designing and developing large-scale data pipelines.The ideal candidate will have experience working with distributed systems, big data processing, and Snowflake.Key responsibilities include:Designing and implementing efficient data pipelines using...

  • High-Performance Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 14,35,200 - ₹ 21,66,400

    Job Title:Senior Data Engineer">">Job Description: We are seeking a skilled and experienced Senior Data Engineer to design and implement high-performance data pipelines that process massive amounts of data.The ideal candidate will have a strong background in data engineering, experience working with big data technologies such as Spark and Hadoop, and be...

  • Senior Data Engineering Specialist

    8 hours ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,12,50,000 - ₹ 2,02,50,000

    Our organization seeks an experienced Senior Data Engineer to lead large-scale data projects.We require a professional with extensive knowledge of designing and maintaining robust data infrastructure.The ideal candidate will have hands-on experience in building scalable data solutions using AWS, Spark, SQL, RDBMS, Databricks, and Python.The successful...

  • Data Engineering Lead

    5 days ago

    Alleppey, Kerala, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Senior ConsultantOur organization is seeking a highly skilled and experienced Data Engineering Senior Consultant to join our team. The ideal candidate will have expertise in designing, developing and maintaining ETL/ELT workflows using Informatica IICS.Design, develop, and maintain scalable data pipelines using Informatica...

  • Senior Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key ResponsibilitiesWe're seeking an expert in data engineering and analytics to join our team.Main Objectives:Design, develop, and automate scalable ETL workflows using Python and Pandas for large dataset processing.Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing.Configure, monitor, and optimize...

  • Senior Data Engineer

    1 week ago

    Alleppey, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionKey responsibilities for this position include developing and maintaining data pipelines, implementing client-specific data transformations, supporting data ingestion and quality checks during client onboarding, optimizing database queries, and collaborating with the Quality Control team.Key Responsibilities:Develop data engineering solutions...

  • Senior Data Systems Architect

    1 week ago

    Alleppey, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.Your primary focus will be on ensuring the availability,...

  • Data Engineering Leadership Position

    2 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionAs a Senior Data Engineer, you will be responsible for designing and implementing data pipelines using AWS services and Apache Airflow. Your primary focus will be on developing scalable and efficient data solutions that meet the needs of our business.Key Responsibilities:Design and implement data pipelines using AWS...