Data Engineer

5 days ago

Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
ETL Developer Role

We are seeking an experienced ETL Developer to join our data engineering team.

This role involves designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

About the Role

The ideal candidate will have 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).

Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing is also required.

  • Data Ingestion: Design and develop ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Data Loading: Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Pipeline Management: Participate in code reviews, performance tuning, and defect triage sessions.
  • Data Governance: Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
Key Responsibilities
  • Development: Develop and maintain ETL pipelines using IBM DataStage and AWS Glue/Lambda.
  • Troubleshooting: Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
  • Collaboration: Collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets.
Requirements
  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version)
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation
  • Familiarity with S3, version control systems (Git), and job orchestration tools
  • Experience with data profiling, cleansing, and quality validation routines
  • Understanding of data lake/data warehouse architectures and DevOps practices
Bonus Skills
  • Experience with Collibra, BigID, or other metadata/governance tools
  • Exposure to Data Mesh/Data Domain models
  • Experience with agile/Scrum delivery and Jira/Confluence tools
  • AWS or Snowflake certification is a plus

  • Data Engineer

    3 weeks ago

    Ghaziabad, Uttar Pradesh, India Indsafri Full time

    Hiring Now: Senior Data Engineers (Banking Domain – 2 Positions)Location: RemoteExperience: 7+ Years | Banking sector experience preferred Type: Contract About the OpportunityWe're looking for highly skilled Senior Data Engineers to join a mission-critical banking project. This is your chance to work on cutting-edge data pipelines, streaming platforms,...

  • Data Engineer Architect

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering LeadershipAs a seasoned engineering manager, you will lead a talented team of data engineers to design and deliver scalable data pipelines and analytics platforms on the cloud.Key Responsibilities:Lead and mentor a high-performing team of data engineers working on large-scale distributed data systems.Architect and oversee the...

  • Senior Data Engineer

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data pipelines and ETL processes on Databricks.The ideal candidate will have 7+ years of experience in Data Engineering and a proven track record of delivering...

  • Head of Data Engineering

    2 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer RoleWe are seeking a Senior Data Engineer with 4–5 years of experience to join our remote-first team.This is a remote-first opportunity, with a strong preference for candidates located in Chennai or anywhere within Tamil Nadu for occasional in-person collaboration sessions.Mandatory Skills and QualificationsPowerBI: Must have expertise...

  • PostgreSQL Data Engineer

    57 minutes ago

    Ghaziabad, Uttar Pradesh, India beBeeDatabase Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    PostgreSQL Data EngineerWe are seeking an experienced PostgreSQL data engineer to join our global team. In this role, you will be responsible for managing and optimizing database management systems using Azure PostgreSQL and SQL Server.The ideal candidate will have a strong understanding of security principles in the context of data and experience with...

  • Cloud Data Engineer

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Data Engineering SpecialistAbout the Position:We are seeking a skilled Data Engineering Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing scalable data platforms using Databricks and related technologies.The successful candidate will have hands-on experience with...

  • Senior Data Engineer Role

    8 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title:Senior Data Engineer RoleA senior data engineer is required to build data pipelines and integrate healthcare data with expertise.

  • Data Engineer

    3 weeks ago

    Ghaziabad, Uttar Pradesh, India Insight Global Full time

    Required Skills & Experience- 8-10+ years software engineering- SQL- AWS- Python- Snowflake- RESTful APIsJob Description- We are seeking a skilled and experienced Engineer with a strong focus on API development using Python and hands-on experience with AWS.- The ideal candidate will have a deep understanding of backend systems, RESTful API design, and cloud...

  • Distinguished Data Engineering Professional

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionWe are seeking an experienced Senior Data Engineer to play a key role in designing, developing, and maintaining large-scale data pipelines using various tools such as FiveTran, DBT Cloud, and custom frameworks.Some of the key duties and responsibilities of this role include:Developing and maintaining ETL pipelines for...

  • Chief Data Engineering Specialist

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:A senior data engineer is required to design, develop, and maintain large-scale data engineering solutions.The ideal candidate will have a strong foundation in data warehousing and data engineering principles, with hands-on experience using Ab Initio, Databricks, and Pyspark.Experience working with multiple databases and cloud-hosted DWH...