Manager - Data Engineer

2 months ago

Gurugram, India Career Stone Consultant Full time

Manager Data Engineering


ABOUT THE JOB Role: Manager Data Engineering Reports to: AD - Data Engineering

Location: Gurgaon

Responsibilities

● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently extract raw data, ensuring its quality through robust validation techniques, and leveraging your extensive data expertise to guarantee accurate data ingestion across the pipeline. Your leadership will be instrumental in transforming raw data into formats that are compatible with downstream data sources.

● In this role, you will provide strategic oversight for the development of data tools that are critical for transforming, managing, and accessing data. You will also advise the team on best practices for writing and validating code to ensure the resilience and reliability of data storage platforms.

● You will lead the implementation of performance monitoring protocols across data pipelines, guiding the team in building effective visualisations and aggregations that monitor pipeline health. Additionally, you will coach the team on developing and implementing solutions and self-healing processes that minimize points of failure across various product features.

● Your expertise in data governance will be crucial as you help identify needs and oversee the design of data modelling and handling procedures that ensure compliance with relevant laws and policies. You will also ensure that data accessibility is maintained within your assigned pipelines.

● Collaboration with the Data Science team will be key as you work together on feature set requirements and prediction pipelines. You will prepare team members for meetings with key stakeholders, addressing concerns around data requirements and providing expert guidance on feature estimation. Additionally, you will assist in evaluating data costs, access, usage, dependencies across products, and availability for business or customer scenarios related to one or more product features. Required Knowledge and Skills:

● Data Engineering Tools: Proficiency in ETL/ELT processes, with experience in tools such as Apache Spark, Flink, Kafka, and Airflow.

● Programming Languages: Expertise in programming languages like Python, SQL, and Scala for data processing and analysis.

● Cloud Platforms: Strong experience with cloud-based data services such as AWS, Google Cloud Platform, or Azure.

● Data Warehousing: In-depth knowledge of data warehousing solutions like Snowflake, Redshift-Athena, or BigQuery.

● Visualisation Tools: Experience with data visualisation tools such as Tableau, Power BI, or Looker. ● Pipeline Monitoring: Knowledge of monitoring and alerting tools like Prometheus, Grafana, or Datadog.

● Lake house file formats: Knowledge and experience of working with various storage formats like AVRO, HUDI, parquet, orc and delta.

● API design and development: experience in designing, implementing, and optimising REST APIs, including hands-on expertise in developing robust, scalable, and secure API solutions like flask, Django or fastapi.

  • Manager - Data Engineer

    1 month ago

    gurugram, India Career Stone Consultant Full time

    Manager Data Engineering ABOUT THE JOB Role: Manager Data Engineering Reports to: AD - Data Engineering Location: Gurgaon Responsibilities ● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently...

  • Manager - Data Engineer

    2 months ago

    gurugram, India Career Stone Consultant Full time

    Manager Data Engineering ABOUT THE JOB Role: Manager Data Engineering Reports to: AD - Data Engineering Location: Gurgaon Responsibilities ● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to...

  • Data Engineering Manager

    2 months ago

    gurugram, India Deutsche Telekom Digital Labs Full time

    The Role As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...

  • Data Engineering Manager

    2 days ago

    Gurugram, India Deutsche Telekom Digital Labs Full time

    The Role As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...

  • Data Engineering Manager

    2 days ago

    Gurugram, India Deutsche Telekom Digital Labs Full time

    The Role As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...

  • Data Engineering Manager

    3 months ago

    Gurugram, India Deutsche Telekom Digital Labs Full time

    The Role As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...

  • Manager Data Engineer

    3 months ago

    Gurugram, India Zupee Full time

    Manager Data EngineeringZupee is India’s fastest growing Technology backed Behavioural Science company. We are innovating Skill-Based Gaming with a mission to become the most trusted and responsible entertainment company in the world. We have been constantly focussing on innovation of indigenous games to entertain the mass.Our strategy is to invest in our...

  • Manager Data Engineer

    2 months ago

    gurugram, India Zupee Full time

    Manager Data EngineeringZupee is India’s fastest growing Technology backed Behavioural Science company. We are innovating Skill-Based Gaming with a mission to become the most trusted and responsible entertainment company in the world. We have been constantly focussing on innovation of indigenous games to entertain the mass.Our strategy is to invest in our...

  • Manager Data Engineer

    3 months ago

    Gurugram, India Zupee Full time

    Manager Data EngineeringZupee is India’s fastest growing Technology backed Behavioural Science company. We are innovating Skill-Based Gaming with a mission to become the most trusted and responsible entertainment company in the world. We have been constantly focussing on innovation of indigenous games to entertain the mass.Our strategy is to invest in our...

  • Manager Data Engineer

    3 months ago

    Gurugram, India Zupee Full time

    Manager Data Engineering Zupee is India’s fastest growing Technology backed Behavioural Science company. We are innovating Skill-Based Gaming with a mission to become the most trusted and responsible entertainment company in the world. We have been constantly focussing on innovation of indigenous games to entertain the mass. Our strategy is to invest in...

  • Digital Engineering Engineer

    3 weeks ago

    Gurugram, India NTT DATA Services Full time

    Req ID: 295081 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Job Duties: Must have:...

  • Senior Engineering Manager

    1 month ago

    gurugram, India Real Time Data Services Full time

    AcefoneJOB DESCRIPTION OF ENGINEERING MANAGERWe are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead collaboration...

  • Engineering Manager

    1 month ago

    gurugram, India Real Time Data Services Full time

    Key Responsibilities:Team Leadership:Lead, mentor, and grow a team of software engineers.Provide regular feedback, performance reviews, and career development support.Project Management:Oversee the end-to-end execution of engineering projects.Collaborate with stakeholders to understand requirements, set priorities, and allocate resources.Ensure timely...

  • Senior Engineering Manager

    3 weeks ago

    gurugram, India Real Time Data Services Full time

    Acefone JOB DESCRIPTION OF ENGINEERING MANAGER We are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead...

  • Senior Engineering Manager

    1 month ago

    Gurugram, India Real Time Data Services Full time

    AcefoneJOB DESCRIPTION OF ENGINEERING MANAGERWe are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead collaboration...

  • Senior Engineering Manager

    1 month ago

    Gurugram, India Real Time Data Services Full time

    AcefoneJOB DESCRIPTION OF ENGINEERING MANAGERWe are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead collaboration...

  • Senior Engineering Manager

    1 month ago

    Gurugram, India Real Time Data Services Full time

    Acefone JOB DESCRIPTION OF ENGINEERING MANAGER We are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead...

  • Senior Engineering Manager

    4 weeks ago

    gurugram, India Real Time Data Services Full time

    Acefone JOB DESCRIPTION OF ENGINEERING MANAGER We are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead...

  • Senior Engineering Manager

    1 month ago

    gurugram, India Real Time Data Services Full time

    AcefoneJOB DESCRIPTION OF ENGINEERING MANAGERWe are seeking a talented and motivated Engineering Manager to join our dynamic engineering team. As an Engineering Manager, you will lead and grow our engineering team and help our customers build better connections by building the next generation of real time communication products! You will lead collaboration...

  • Chief Manager

    2 weeks ago

    Gurugram, India Max Life Insurance Company Limited Full time

    JOB SUMMARY:We are seeking a skilled AWS Big Data Engineer to join our dynamic team. In this role, will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on AWS cloud platform. The ideal candidate will have extensive experience with AWS services, particularly in the realm of big data processing and...