Senior Data Engineer

6 days ago

Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
About This Role

We're looking for a seasoned data engineer to design, develop, and maintain efficient ETL pipelines using IBM DataStage and AWS Glue. The ideal candidate will have expertise in building scalable data flows, collaborating with cross-functional teams, and ensuring timely delivery of critical data assets.

Key Responsibilities:

  • Design and develop ETL pipelines leveraging IBM DataStage and AWS Glue for ingestion from varied sources.
  • Bld and optimize data flows for loading curated datasets into Snowflake, applying best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Collaborate with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
Required Skills and Qualifications

To succeed in this role, you'll need the following skills and experience:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage.
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.
Benefits

In addition to a competitive salary, you'll enjoy:

  • A dynamic work environment that encourages collaboration and innovation.
  • Ongoing training and professional development opportunities.
  • A comprehensive benefits package that includes health insurance, retirement savings, and paid time off.
What We Offer

We're committed to providing a supportive and inclusive workplace that allows our employees to grow and thrive. If you're passionate about data engineering and want to join a team that's shaping the future of technology, we encourage you to apply.

  • Senior Data Engineer

    4 hours ago

    Alleppey, Kerala, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...

  • Unlock the Power of Big Data as a Senior Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team.This is a full-time role for a highly experienced ETL Developer based in Bengaluru, working with one of our esteemed overseas clients. The role involves understanding requirements, designing, developing, and testing of ETL architecture, transformation jobs, and workflow...

  • Senior Cloud Native Data Engineer

    2 weeks ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Join Our Team as a Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team and play a key role in designing, building, and maintaining our data pipelines. As a member of our founding technical team, you will have the opportunity to shape the core infrastructure of our company and contribute to its success.Job...

  • Large Scale Data Engineering

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 19,00,000

    **Senior Data Engineer Role**We are seeking a highly skilled Senior Data Engineer to play a crucial role in designing and developing large-scale data pipelines.The ideal candidate will have experience working with distributed systems, big data processing, and Snowflake.Key responsibilities include:Designing and implementing efficient data pipelines using...

  • High-Performance Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 14,35,200 - ₹ 21,66,400

    Job Title:Senior Data Engineer">">Job Description: We are seeking a skilled and experienced Senior Data Engineer to design and implement high-performance data pipelines that process massive amounts of data.The ideal candidate will have a strong background in data engineering, experience working with big data technologies such as Spark and Hadoop, and be...

  • Senior Data Engineering Specialist

    13 hours ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,12,50,000 - ₹ 2,02,50,000

    Our organization seeks an experienced Senior Data Engineer to lead large-scale data projects.We require a professional with extensive knowledge of designing and maintaining robust data infrastructure.The ideal candidate will have hands-on experience in building scalable data solutions using AWS, Spark, SQL, RDBMS, Databricks, and Python.The successful...

  • Data Engineering Lead

    5 days ago

    Alleppey, Kerala, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Senior ConsultantOur organization is seeking a highly skilled and experienced Data Engineering Senior Consultant to join our team. The ideal candidate will have expertise in designing, developing and maintaining ETL/ELT workflows using Informatica IICS.Design, develop, and maintain scalable data pipelines using Informatica...

  • Senior Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key ResponsibilitiesWe're seeking an expert in data engineering and analytics to join our team.Main Objectives:Design, develop, and automate scalable ETL workflows using Python and Pandas for large dataset processing.Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing.Configure, monitor, and optimize...

  • Senior Data Engineer

    1 week ago

    Alleppey, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionKey responsibilities for this position include developing and maintaining data pipelines, implementing client-specific data transformations, supporting data ingestion and quality checks during client onboarding, optimizing database queries, and collaborating with the Quality Control team.Key Responsibilities:Develop data engineering solutions...

  • Data Engineering Leadership Position

    2 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionAs a Senior Data Engineer, you will be responsible for designing and implementing data pipelines using AWS services and Apache Airflow. Your primary focus will be on developing scalable and efficient data solutions that meet the needs of our business.Key Responsibilities:Design and implement data pipelines using AWS...