Data Engineering Leadership Role

4 days ago

Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 17,00,000 - ₹ 23,00,000
Job Overview

We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.

Key Responsibilities:
  • Data Ingestion Framework: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Utilize AWS services such as AWS Glue, Lambda, EMR, ECS, EC2, and Step Functions to build highly scalable, resilient, and automated data pipelines.
Data Quality & Validation:
  • Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
API Development:
  • Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.
Required Qualifications:Experience & Technical Skills:
  • Professional Background: At least 5 years of relevant experience in data engineering with a strong emphasis on analytical platform development.
  • Programming Skills: Proficiency in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.
  • AWS Expertise: Extensive experience using AWS services including AWS Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.
  • Data Platforms: Familiarity with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.
  • API Development: Proven experience in designing and implementing RESTful APIs and integrating them with external and internal systems.
  • CI/CD & Agile: Hands-on experience with CI/CD pipelines (preferably with GitLab) and Agile development methodologies.

  • Data Engineering Leadership Opportunity

    2 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineering Leader">About Us:We're a leading online real estate company with a presence in three continents, looking for experienced technologists to join our team in India. Our new Tech Center is dedicated to accelerating our global technology delivery through innovation.The purpose of the Commercial Data team in Advertising is to develop...

  • Executive Leadership Role

    1 day ago

    Bhavnagar, Gujarat, India beBeeLeadership Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Client Relationship ManagerThis pivotal role demands exceptional leadership skills to drive growth during a transformative period.Talent Development: Manage direct reports, provide coaching, training, and evaluation to develop high-potential employees.Client Services: Oversee client team operations, manage interactions to maintain client...

  • Mechanical Leadership Role

    2 days ago

    Bhavnagar, Gujarat, India beBeeMechanical Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Title: Mechanical Leadership RoleSummary: We are seeking an experienced mechanical professional to join our organization. The ideal candidate will have a strong background in mechanical engineering and maintenance, with experience in troubleshooting and minimizing downtime.Key Responsibilities:Maintenance of rotary and static equipment is essential for...

  • Data Analytics Leadership Opportunities

    1 week ago

    Bhavnagar, Gujarat, India beBeeAnalytics Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Analytics LeaderAbout the Role:We seek an experienced leader in data and analytics to drive business growth through our delivery teams.The ideal candidate will have extensive knowledge of data management, cloud data migrations, data quality and governance, data engineering, ETL/ELT, data ops, BI and analytics, data science and machine...

  • Enterprise IT Leadership Role

    1 week ago

    Bhavnagar, Gujarat, India beBeeOptimization Full time US$ 9,00,000 - US$ 12,00,000

    About UsWe empower clients to drive their business transformation by leveraging our deep engineering expertise and collaborative approach.Our team is dedicated to delivering innovative solutions that help clients achieve their goals and unlock new growth opportunities.Job Title:CMDB Team LeadKey Responsibilities:Align capacity for the team, set performance...

  • Cloud Data Engineering Role

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 15,00,000

    Job Title: Cloud Data EngineerEstablish a data-driven culture by designing and implementing scalable data processing systems using Google Cloud Platform (GCP). As a key member of our engineering team, you will be responsible for developing innovative data pipelines, ensuring data quality, integrity, and security.Responsibilities include:Designing and...

  • Senior Data Engineer Role

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering ProfessionalWe are seeking a highly skilled Data Engineering professional to join our team. As a key member of the data engineering team, you will be responsible for developing and maintaining large-scale data processing systems that support business analytics initiatives.

  • Senior Data Engineer Role

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 10,00,000

    Job Title:Data Engineering Manager","Key Responsibilities:Develop scalable data pipelinesDesign and maintain robust ETL processesImplement medallion architecture for data organizationTroubleshoot data issues and optimize pipelines","Required Skills:10–15 years of experience in data engineeringHands-on expertise with Snowflake, Matillion, and...

  • Databricks Engineer Leadership Position

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Databricks Engineer LeadThe Databricks engineer will be responsible for designing, developing and maintaining data pipelines and ETL processes on the platform.Lead the architecture and implementation of scalable, secure and high-performance data solutions.Collaborate with business stakeholders, data scientists and analysts to gather requirements...

  • A Leading Role in Data Engineering

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title:Data Engineering ProfessionalExperience: 6 yearsDesign and develop data pipelines using Azure Data Factory. Write complex SQL queries and stored procedures for data transformation and validation.Integrate data from various sources including Azure Blob Storage, SQL Server, and on-premise systems.Monitor and troubleshoot data pipelines to ensure data...