Senior ETL Data Scientist

2 weeks ago

Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000
ETL Data Engineering Professional

We are seeking a highly skilled Senior ETL Developer to join our data engineering team.

You will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

Key Responsibilities:

  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.

Required Skills and Experience:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.

Good to Have:

  • Experience with Collibra, BigID, or other metadata/governance tools
  • Exposure to Data Mesh/Data Domain models
  • Experience with agile/Scrum delivery and Jira/Confluence tools
  • AWS or Snowflake certification is a plus

  • Senior ETL Developer

    1 week ago

    Kannur, Kerala, India beBeeETL Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Title: Senior ETL DeveloperAbout the RoleWe are seeking a highly skilled and experienced ETL developer to join our team. As an ETL developer, you will be responsible for designing, building, and optimizing data pipelines using IBM DataStage.Key Responsibilities:Design and develop efficient ETL jobs using IBM DataStage.Write optimized SQL queries for data...

  • ETL Data Integration Specialist

    2 weeks ago

    Kannur, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    ETL Data Integration SpecialistOur organization requires an experienced ETL Data Integration Specialist to develop, implement and maintain data pipelines utilizing a variety of ETL tools.Develop, test and deploy ETL solutions to extract, transform and load data from various sources into a centralized repository.Work closely with cross-functional teams to...

  • Senior Data Engineer

    2 weeks ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering SpecialistWe're seeking a skilled Data Engineering Specialist to design, develop, and maintain scalable, high-performance data solutions using Databricks. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture.About the Role:The Data Engineering Specialist will...

  • Data Scientist

    2 weeks ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Build a career in data engineering with our company as we are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience designing, developing, and maintaining large-scale data pipelines and infrastructure using Azure Data Factory and Databricks.Key Responsibilities:Design and develop scalable data pipelines using Azure Data...

  • ETL Developer

    1 week ago

    Kannur, Kerala, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: ETL Developer - Data Pipeline SpecialistGreetings from our organization!We are hiring for a Data Pipeline Specialist to join our team. This role involves designing, developing and managing data pipelines using ETL tools.The ideal candidate will have hands-on experience in ETL development and be able to analyze complex business...

  • ETL Data Quality Specialist

    2 weeks ago

    Kannur, Kerala, India beBeeQuality Full time ₹ 18,00,000 - ₹ 24,00,000

    Job DescriptionWe are seeking a QA Engineer with experience in ETL testing, Kafka/Redpanda, and MongoDB to fill a key role in our organization.Responsibilities:Test ETL processes and perform data reconciliation across systems.Validate Kafka/Redpanda pipelines (producers, consumers, topics, schema registry, Avro/JSON).Ensure data quality in terms of accuracy,...

  • Chief Data Architecture Specialist

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 37,80,000 - ₹ 42,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled and experienced Senior Data Engineer to join our organization. This role is ideal for individuals with a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.About the RoleThis position involves designing, optimizing, and implementing data pipelines using AWS Glue, Airflow,...

  • Large Scale Data Modeler

    1 week ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryData Engineer - Large Scale Data Modeling & ETLOur organization is seeking an experienced data engineer to design and implement large-scale data models, develop ETL processes using Snowflake, and collaborate with cross-functional teams to optimize data pipelines.Key Responsibilities:Design and Implement Data Models: Design and implement scalable...

  • Data Driven Innovation Specialist

    2 weeks ago

    Kannur, Kerala, India beBeeMachineLearningEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Machine Learning EngineerAs a senior machine learning engineer, you will be responsible for designing and implementing complex data pipelines using traditional machine learning and deep learning techniques.This role requires a strong understanding of large datasets and cloud-based AI services. You will work closely with cross-functional teams to...

  • Senior Azure Data Specialist

    1 week ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Unlock limitless opportunities in data-driven insights and cutting-edge digital solutions as a Senior Azure Data Engineer.A senior role awaits you where you will craft technical solutions to meet complex data requirements, collaborating with stakeholders to drive business growth. Key Responsibilities:Craft scalable data pipelines and ETL processes using...