Lead Data Engineering Professional

13 hours ago

Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 19,00,000 - ₹ 23,00,000

As a seasoned Data Engineering Professional, you will lead the development of a scalable data ingestion framework while ensuring high data quality and validation.

Key Responsibilities
  • Data Ingestion Framework:
    • Design, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
    • Utilize AWS services such as Glue, Lambda, EMR, ECS, EC2, and Step Functions to build highly scalable, resilient, and automated data pipelines.
  • Data Quality & Validation:
    • Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
    • Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
  • API Development:
    • Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
    • Create thorough API documentation and establish standards for API security, versioning, and performance optimization.

Required Qualifications:

  • At least 7 years of relevant experience in data engineering with a strong emphasis on analytical platform development.
  • Proficiency in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.
  • Extensive experience using AWS services including Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.
  • Familiarity with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.

  • Senior Data Engineering Lead

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a seasoned professional to lead our data engineering efforts. As a Senior Data Engineer, you will play a critical role in designing, building, and operating scalable data pipelines that support our AI-powered applications.This is a key position where you will create robust pipelines that process clinical encounter data, retrieve...

  • Data Engineering Professional

    13 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled professional to fill the role of Data Engineer.About the Position:Analyze business requirements and identify data needs.Design and model Power BI schema to meet business requirements.Transform data in Power BI, SQL, and Microsoft Fabric.Create DAX formulas, reports, and dashboards to visualize data...

  • Data Engineering Lead

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Data Engineering LeadershipAbout the OpportunityAs an expert data engineering leader, you will oversee a team of skilled engineers and collaborate with clients to identify their data needs.Key Responsibilities:Develop and implement effective architecture strategiesAddress complex data modeling challengesDesign and deliver high-quality featuresLead a...

  • Data Engineering Professional

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Databricks Data Engineer">We are seeking a highly skilled Data Engineering Professional to join our dynamic team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and...

  • Lead Data Engineering Specialist

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Senior Data Engineer to lead our data engineering efforts. As a Senior Data Engineer, you will be responsible for designing and building robust data pipelines for ingestion, transformation, and analytics using the best of modern data engineering tools and practices on Google Cloud (GCP).The ideal candidate will...

  • Senior Data Engineering Professional

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Role:A senior data engineering professional with 3-12 years of experience in designing and developing scalable data pipelines, data lakes, and data warehouses. The ideal candidate will have expertise in data patterns, Python, SQL, and Apache Spark (PySpark).

  • Leading Data Professional

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Title: Data EngineerThis role involves designing, developing and maintaining scalable data pipelines and infrastructure to support real-time and batch data processing.The ideal candidate will collaborate with cross-functional teams to deliver reliable, high-quality data systems that power analytics, insights and data-driven decision-making.

  • Data Engineering Team Lead

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    At Incedo, we are seeking a skilled Data Engineering Scrum Master to join our team. As a key member of our Wealth Management domain, you will be responsible for leading agile teams and ensuring the efficient delivery of data engineering projects.">Key Responsibilities:Apply Scrum methodology to drive project successDevelop and maintain high-quality technical...

  • Lead Data Engineer

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Azure Data EngineerKey responsibilities of this position include designing, building and maintaining robust data pipelines using Azure cloud services.To be successful in this role, you will need a strong background in data engineering, with expertise in Microsoft Azure. This includes experience with Azure Synapse Analytics, Azure Databricks, and Azure Data...

  • High-Impact Data Engineering Lead

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a highly skilled Data Applications Lead to join our team. This individual will own end-to-end delivery of data modules and platforms that power core business use cases across real-time bidding, reporting, and analytics.The successful candidate will lead a small team of engineers and work closely with data science, analytics, and...