Senior Data Engineer

2 days ago

Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

**ETL Developer – Data Pipelines Specialist**

We are seeking an experienced ETL Developer to lead the development of scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

The ideal candidate will have a strong background in ETL development, with at least 2 years of experience in IBM DataStage and 1 year of experience in AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.

**Key Responsibilities:**

  • Design, develop, and maintain ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.

**Required Skills and Qualifications:**

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage.
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.

**Benefits:**

  • Opportunity to work on cutting-edge data engineering projects.
  • Collaborative and dynamic work environment.
  • Ongoing training and professional development opportunities.

  • Senior Data Engineer

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJoin us in shaping the future of data engineering with a challenging role that offers opportunities for growth and development.Location: Mumbai, IndiaDesign, develop, and maintain large-scale data pipelines using PySpark.Implement complex business logic using Spark SQL, DataFrame, and RDD APIs.Proficient in Python programming...

  • Data Engineering Leader

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data Engineer(Lead)DescriptionWe are seeking a highly skilled and experienced Senior Data Engineer to lead our team in designing, developing, and optimizing large-scale data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Around 6+ years of experience in data engineering or cloud computing data development is required.The...

  • A Highly Experienced Data Engineer

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerA highly skilled and experienced data engineer is required to join our organization.

  • Data Engineer Lead Role

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineering Manager Position AvailableA leading organization seeks an experienced Senior Data Engineering Manager to lead our Data Engineering team.The successful candidate will have a strong background in data engineering, excellent technical skills, and the ability to collaborate with both technical teams and business stakeholders.This is an...

  • Senior Data Architect

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Data Engineering RoleHiring Now: Senior Data Engineers for Banking Project. A remote opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Designing and implementing ETL pipelines for large-scale data ingestion and transformation.Building real-time streaming solutions using Apache Kafka.Implementing...

  • Senior Data Engineer

    4 weeks ago

    Bareilly, Uttar Pradesh, India NEXWARE TECHNOLOGIES PRIVATE LIMITED Full time

    Mandatory Skills : Microsoft Fabric, PySpark, SQL, Data Factory, Power BI, Data Modeling, ETL/ELTExperience : 6-8 YrsPreferred Skills:- Microsoft Fabric: Experience with Lakehouse architecture, notebooks, and warehousing- PySpark: Proficiency in writing PySpark code for data transformation- SQL: Advanced knowledge of SQL for data manipulation and analysis-...

  • Data Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineering SpecialistWe are seeking a highly skilled data engineer to assume the role of Senior Data Engineering Specialist. This position involves working on high-level marketing platforms and performing in-depth data analysis.This role requires expertise in API extraction, automation, and orchestration using advanced Python programming...

  • Senior Data Engineer Position

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Data Engineering PotentialWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of innovative data solutions.As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Databricks, PySpark, and Delta Lake. You will work closely with...

  • Senior Backend Engineering Specialist

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 75,00,000 - ₹ 1,50,00,000

    We are seeking a highly skilled Senior Data Engineer to join our team as a backend engineer and help implement an application for a large retailer. In this role, you will be working with Telemetry, Big Data, and backend engineering. Key Responsibilities: Hands on coding expertise in Python and Pyspark Expertise in Telemetry, Big Data, and backend engineering...

  • Senior Data Engineering Specialist

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,60,000

    Data Engineering OpportunityWe're seeking a highly skilled Data Engineer to join our team. As a key member of our data organization, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark, AWS, and Databricks.Responsibilities:Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and...