Lead ETL Data Engineer

3 days ago

Salem, Tamil Nadu, India beBeeDatastage Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Job Title: ETL Developer - DataStage, AWS, Snowflake

We are seeking an experienced ETL Lead with expertise in IBM DataStage to design and develop scalable data pipelines using various technologies.

This role involves close collaboration with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

The ideal candidate will have 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).

  • Key Responsibilities:
  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
Required Skills and Experience:
  • Technical Requirements:
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Understanding of data lake/data warehouse architectures and DevOps practices.
About the Role:

This is a challenging opportunity for a skilled ETL professional to make a significant impact on our organization's data strategy.

We offer a collaborative work environment, opportunities for growth and development, and a competitive compensation package.

  • ETL Development Specialist

    4 days ago

    Salem, Tamil Nadu, India beBeeInformatica Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Opportunity: ETL DeveloperThe role involves understanding requirements, designing and developing ETL architecture, transformation jobs and workflow schedules for a global company.Key responsibilities include design and development of scalable ETL workflows using Informatica BDM/DEI, integrating data from structured and unstructured sources including big...

  • Data Pipeline Test Engineer

    5 days ago

    Salem, Tamil Nadu, India beBeeTest Full time ₹ 15,00,000 - ₹ 21,00,000

    Job TitleA senior test engineer is needed to lead the testing strategy and execution for a project using Databricks, Data Factory pipelines, and Power BI.5+ years of experience in data pipeline/ETL testing with at least 2+ years as a Test Lead.Key responsibilities include:Driving the testing strategy and execution for the project.Leading a team of test...

  • Lead Data Engineer

    3 weeks ago

    Salem, Tamil Nadu, India CoffeeBeans Full time

    Founded in the year 2017, Coffee Beans specialises in offering high end consulting services in technology, product, and processes.We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries.The company uses...

  • Technical Lead

    3 days ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team. This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced, engineering-driven environment.You'll work across the full data stack—from ingestion and transformation to...

  • Leading Data Architect

    3 days ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to design, develop and maintain large-scale data pipelines and ETL processes using tools like Databricks and Azure Data Factory.The ideal candidate will have a strong background in data engineering, data architecture, and data integration. They will be responsible for collaborating with...

  • Leading Cloud Data Migration Specialist

    1 day ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking an experienced data engineer to lead large-scale migrations of SQL workloads from on-premise environments to Azure, ensuring high data integrity and performance optimization.This role requires expertise in designing, developing, and managing end-to-end data pipelines using Azure Data Factory or Synapse Data Factory for...

  • Senior ETL Developer

    3 days ago

    Salem, Tamil Nadu, India beBeeETL Full time ₹ 20,00,000 - ₹ 40,00,000

    Senior ETL DeveloperWe are seeking a highly skilled Senior ETL Developer to join our team and help us design, develop, and maintain efficient data pipelines.Key Responsibilities:1. Data Pipeline Development:Design and develop robust data pipelines using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and...

  • Freelance Data Engineering Position

    3 days ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Freelance Data EngineerWe are seeking a skilled Freelance Data Engineer to design, build, and optimize large-scale data pipelines.Responsibilities include designing, developing, and maintaining ETL/ELT pipelines using PySpark, AWS, and Databricks.Key qualifications include 5+ years of data engineering experience, strong background in Python and...

  • ETL Data Quality Specialist

    3 days ago

    Salem, Tamil Nadu, India beBeeQuality Full time ₹ 24,00,000 - ₹ 30,00,000

    Job Title: Quality Assurance Analyst As a skilled quality assurance professional, you will play a crucial role in ensuring the integrity of our software products. Key Responsibilities:Develop and execute comprehensive test plans to identify defects and improve overall system reliability.Collaborate with cross-functional teams to analyze and resolve complex...

  • Senior Data Engineering Specialist

    3 days ago

    Salem, Tamil Nadu, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering Specialist   We are seeking an experienced data engineering specialist to join our team.   Key Responsibilities:Design and develop end-to-end data integration solutions using Informatica IICS.Integrate IICS solutions with cloud-based data platforms such as Google Cloud Platform (GCP) and Google BigQuery (GBQ).Optimize...