Senior Data Engineer

21 hours ago

Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Summary

We are seeking a seasoned data engineer to design, build and optimize large-scale data pipelines using IBM DataStage.

The ideal candidate will have hands-on experience in designing, building and optimizing complex data pipelines using IBM DataStage, along with strong SQL skills (Teradata).

Key Responsibilities
  • Data Pipeline Design and Development: Design, develop and maintain ETL jobs using IBM DataStage, ensuring high performance and scalability.
  • SQL Query Optimization: Write optimized SQL queries (Teradata) for data extraction, transformation and validation, focusing on efficiency and accuracy.
  • Collaboration and Integration: Collaborate with data analysts and business users to implement integration solutions, leveraging data modeling best practices.
  • Quality Assurance and Troubleshooting: Perform manual and automated data validation and reconciliation, as well as conduct root cause analysis for data discrepancies and ETL failures.
  • Component Development and Reusability: Develop reusable DataStage job components, adhering to data modeling best practices and documentation standards.
  • Etl Job Management: Monitor ETL jobs and manage dependencies via Job Sequencers or Airflow, ensuring smooth execution and timely delivery.
Requirements
  • Mandatory Skills:
    • IBM DataStage
    • Teradata
    • SQL
    • Oracle
  • Nice to Have Skills:
    • Python
    • Shell Scripting
    • Unix/Linux
    • Apollo Airflow
    • Cloud Platforms
    • Agile
    • CI/CD

  • Senior Data Engineering Leader

    2 hours ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled professional to join our team as a Senior Analytics Engineer. This role involves delivering high-quality data assets that support analytical modeling and visualization, driving personalization opportunities.Key Responsibilities:Gathering and transforming large datasets into well-structured integrated data assets using advanced...

  • Senior Cloud Data Engineer

    7 days ago

    Jamnagar, Gujarat, India beBeeEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer PositionAbout the Role:We are seeking an experienced and skilled Senior Cloud Data Engineer to join our team. The ideal candidate will have a strong background in designing, implementing, and optimizing data pipelines using cloud-based technologies.The successful candidate will be responsible for developing scalable and efficient data...

  • Data Engineering Leader

    7 days ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer Lead to design, develop and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Responsibilities include working with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms. You will...

  • Senior Data Engineering Project Lead

    36 minutes ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Engineering Project LeadAbout the Role:We are seeking a seasoned Technical Project Manager with expertise in data engineering to lead our data platform, AI, BI, and analytics projects. The ideal candidate will have 13+ years of experience in IT, with a proven track record of managing end-to-end data engineering, analytics, or AI/ML...

  • Airflow Senior Data Engineer Opportunity

    3 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 10,00,000 - ₹ 19,00,000

    Senior Data Engineer PositionThe ideal candidate will have a strong background in data engineering, with expertise in Airflow and Python. They will be responsible for designing, developing, and maintaining large-scale data processing pipelines using Snowflake.Key Responsibilities:Design and develop complex data processing pipelines using Airflow and...

  • Data Engineering Expert

    3 days ago

    Jamnagar, Gujarat, India beBeeExpertise Full time ₹ 1,80,00,000 - ₹ 2,28,00,000

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and deploying large-scale data processing systems.Required Skills and QualificationsProven experience leading data engineering teams, including distributed teams across multiple...

  • Leading Data Engineer

    3 days ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,10,000

    As a Senior Data Engineer, you will lead the development of scalable data processing systems. Your expertise in cloud-based big data platforms and proficiency in programming languages like Python, Scala, and Spark will enable you to design and implement robust data pipelines.Key Responsibilities:Collaborate with cross-functional teams to integrate data...

  • Advanced Cloud Data Engineer

    24 hours ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineering LeadOverview:We are seeking a visionary and experienced Senior Data Engineering Lead to lead our data engineering team. This leadership role requires a strong focus on Databricks and cloud-based data engineering to design, develop, and manage scalable data infrastructure and pipelines.Main Responsibilities:Lead and manage a team...

  • Lead Data Engineering Expert

    21 hours ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL Developer Job DescriptionWe are seeking a highly experienced Senior ETL Developer to join our team.The ideal candidate will have a strong background in data engineering and experience working with big data technologies.Main Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical...

  • Senior Azure Data Engineering Quality Assurance Manager

    7 days ago

    Jamnagar, Gujarat, India beBeeTest Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Opportunity:This is a full-time remote role for a Senior Test Lead/Manager in Azure Data Engineering. The Senior Test Lead/Manager will be responsible for overseeing the entire testing lifecycle, developing test strategies, coordinating with various teams, managing test plans, and ensuring the quality of Azure Data solutions.Main...