Data Engineering Specialist

1 week ago

Bellary, Karnataka, India beBeeEtalization Full time ₹ 15,00,000 - ₹ 20,00,000
ETL Developer Job Summary

We are seeking a skilled ETL developer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining efficient ETL pipelines using IBM DataStage, AWS Glue, and Snowflake.

About the Role

This is an exciting opportunity for a talented individual who wants to work on building scalable and efficient data pipelines. You will collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

Main Responsibilities
  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
Required Skills and Qualifications

To be successful in this role, you should have:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.
Benefits

The ideal candidate will have strong technical skills, excellent problem-solving abilities, and effective communication skills. They should be able to adapt quickly to new technologies and workflows, and be passionate about delivering high-quality results.

Good to Have

Experience with Collibra, BigID, or other metadata/governance tools; Exposure to Data Mesh/Data Domain models; Experience with agile/Scrum delivery and Jira/Confluence tools; AWS or Snowflake certification is a plus.

  • Data Engineering Specialist

    5 days ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistOverview: We are seeking a highly skilled Data Engineer to join our team. As a key member of the team, you will be responsible for designing and implementing scalable data systems that meet the needs of our business.Responsibilities:Designing and implementing RESTful/RPC API and services using Golang or...

  • Senior Cloud Data Engineering Specialist

    13 hours ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled Senior Cloud Data Engineering Specialist to design, implement, and optimize scalable data engineering solutions using Google Cloud Platform (GCP) services.Main Responsibilities:Design and build efficient data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer to process large-scale data.Leverage...

  • Data Flow Specialist

    11 hours ago

    Bellary, Karnataka, India beBeeDataFlow Full time ₹ 9,00,000 - ₹ 18,00,000

    Key Role:Data Flow SpecialistAs a seasoned data flow specialist, you will be responsible for designing and developing data pipelines that efficiently integrate and automate data services.Main Responsibilities:Create optimized data pipelines utilizing Oracle Data Flow or Apache Spark (PySpark) to drive business outcomes.Develop strong partnerships with...

  • Data Engineering Specialist

    5 days ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer">As a data engineer, you will play a key role in our organization by developing and maintaining scalable data pipelines to support continuing increases in data volume and complexity.">Our ideal candidate will have expertise in Big Data technologies such as Hadoop/HDFS, Spark, and Python. You will collaborate with analytics and...

  • Data Integration Specialist

    4 days ago

    Bellary, Karnataka, India beBeeInformatica Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data Integration SpecialistWe are seeking a skilled data integration specialist to join our team. The ideal candidate will have expertise in designing, developing, and testing ETL architectures for large-scale data systems.Design and develop scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured and unstructured sources,...

  • Unlock Your Career as a Senior Data Engineer

    6 days ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerOur team is seeking an experienced Data Engineering Professional to play a critical role in designing, building, and operating scalable data pipelines that support real-time clinical workflows. This position will work closely with software engineers, machine learning specialists, and clinical partners to bring our vision to life.

  • Data Ingestion Specialist

    2 days ago

    Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Ingestion SpecialistWe are seeking a skilled Data Ingestion Specialist to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes and integration with cloud platforms.The ideal candidate...

  • Medical Data Annotation Specialist

    5 days ago

    Bellary, Karnataka, India beBeeDataLabeling Full time US$ 90,000 - US$ 1,20,000

    Key Role: Medical Data Labeling SpecialistJob DescriptionAs a medical data labeling specialist, you will utilize your expertise in ophthalmology to accurately annotate and label medical data related to eye health.ResponsibilitiesReview and annotate various ophthalmic data including fundus images, OCT scans, and other visual dataApply standardized grading...

  • Senior Data Integration Engineer

    5 days ago

    Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Ingestion SpecialistWe are seeking an experienced Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for...

  • AI Engineering Specialist

    5 days ago

    Bellary, Karnataka, India beBeeMachine Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AI Engineering SpecialistWe are seeking an experienced AI Engineering Specialist to lead our team in delivering exceptional machine learning solutions.The ideal candidate will have 7+ years of experience in programming, scripting, data and feature engineering, monitoring and logging, experiment tracking and workflow orchestration.Key Responsibilities:Develop...