ETL Specialist with Advanced Data Pipelining Expertise

1 day ago

Mysore, Karnataka, India beBeeDatastage Full time ₹ 18,00,000 - ₹ 30,00,000
ETL Developer with IBM DataStage Experience

We are seeking an experienced and skilled ETL Developer to join our data engineering team.

  • Design, develop, and maintain scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.

Required Skills and Qualifications

  • 4+ years of experience in ETL development with at least 1-2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.

Desirable Skills

  • Experience with Collibra, BigID, or other metadata/governance tools
  • Exposure to Data Mesh/Data Domain models
  • Experience with agile/Scrum delivery and Jira/Confluence tools
  • AWS or Snowflake certification is a plus

  • Data Pipeline Architect

    7 days ago

    Mysore, Karnataka, India beBeeDataPipelineDeveloper Full time ₹ 37,50,000 - ₹ 52,50,000

    Senior Data Pipeline DeveloperJob OverviewAs a Senior Data Pipeline Developer, you will be responsible for designing and implementing high-performance data pipelines using advanced ETL concepts and methodologies.Key ResponsibilitiesDesign and implement complex data pipelines utilizing ETL frameworks and tools such as SSIS and AWS GlueDevelop and maintain...

  • Data Pipeline Specialist

    2 days ago

    Mysore, Karnataka, India beBeeetldeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you a data pipeline specialist looking for a new challenge?We have an exciting opportunity for an ETL Developer to join our team of talented professionals.In this role, you will be responsible for designing, developing, and maintaining efficient data pipelines using IBM DataStage and AWS Glue/Lambda. You will work closely with architects, business...

  • Data Specialist

    16 hours ago

    Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Expert Data Pipeline DeveloperAs a seasoned data pipeline developer, you will design and implement scalable and efficient data pipelines to support business growth. Your primary responsibility will be to develop and maintain data infrastructure using Azure Data Factory and Databricks for data ingestion, transformation, and movement.Data Pipeline Development:...

  • Cloud Data Specialist

    3 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistAbout the Role:We are seeking a highly skilled data professional to join our team. The ideal candidate should have expertise in cloud-based data solutions and experience with Microsoft Azure services.The successful candidate will be responsible for designing, implementing, and maintaining robust data systems that support...

  • Advanced Data Solutions Specialist – Oil Industry

    5 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: AWS Data Engineer in the Oil and Gas DomainWe seek a skilled AWS Data Engineer with expertise in the Oil and Gas industry to design, build, and optimize scalable data pipelines and cloud solutions.Develop and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services.Collect, process, and store structured/unstructured data...

  • Etl Architectural Expert

    6 days ago

    Mysore, Karnataka, India beBeeSpecialist Full time US$ 80,000 - US$ 1,20,000

    Job OpportunityWe are seeking a skilled professional to join our team as an ETL Architecture Specialist.The role involves understanding client requirements, designing, developing and testing of ETL architecture, transformation jobs and workflow schedules for an overseas client.To be successful in this position, you will need strong technical skills in data...

  • Data Integration Architect

    4 days ago

    Mysore, Karnataka, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a seasoned Azure Data Factory Specialist to support our organization's data integration and ETL needs. This is an excellent opportunity for a skilled professional to utilize their expertise in designing, building, and maintaining Azure Data Factory pipelines for ETL and ELT processes.Key Responsibilities:Design and implement...

  • Chief Data Pipeline Architect

    15 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,20,000

    Cloud Data Engineer Job DescriptionWe are seeking an experienced Cloud Data Engineer to design and develop scalable ETL pipelines using cloud-native tools. The ideal candidate will have extensive experience with cloud platforms (AWS, Azure, GCP), data lakes, and warehouses.Key Responsibilities:Design and Development: Design scalable ETL pipelines, architect...

  • Lead Data Solutions Specialist

    5 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Engineer About the Role:This is a seasoned position for a senior data engineer who can design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives.The ideal candidate will have deep expertise in ETL development, data modeling, and financial data domains, particularly within credit unions and...

  • Senior ETL Tester

    4 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    ETL SpecialistAt our organization, we are seeking a seasoned ETL Specialist to contribute to our team.Key Responsibilities:Design and execute comprehensive test plans to validate Databricks tables across various layers.Validate data transformations, ingestion, and processing logic.Develop complex SQL queries to ensure data accuracy.We are looking for a...