Senior Data Engineer

3 days ago


gurgaon, India A Client of Careerstone Full time
Role: Manager Data Engineering / Lead Data Engineer
Reports to: AD - Data Engineering
Location: Gurgaon
Responsibilities
● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently extract raw data, ensuring its quality through robust validation techniques, and leveraging your extensive data expertise to guarantee accurate data ingestion across the pipeline. Your leadership will be instrumental in transforming raw data into formats that are compatible with downstream data sources.
● In this role, you will provide strategic oversight for the development of data tools that are critical for transforming, managing, and accessing data. You will also advise the team on best practices for writing and validating code to ensure the resilience and reliability of data storage platforms.
● You will lead the implementation of performance monitoring protocols across data pipelines, guiding the team in building effective visualisations and aggregations that monitor pipeline health. Additionally, you will coach the team on developing and implementing solutions and self-healing processes that minimize points of failure across various product features.
● Your expertise in data governance will be crucial as you help identify needs and oversee the design of data modelling and handling procedures that ensure compliance with relevant laws and policies. You will also ensure that data accessibility is maintained within your assigned pipelines.
● Collaboration with the Data Science team will be key as you work together on feature set requirements and prediction pipelines. You will prepare team members for meetings with key stakeholders, addressing concerns around data requirements and providing expert guidance on feature estimation. Additionally, you will assist in evaluating data costs, access, usage, dependencies across products, and availability for business or customer scenarios related to one or more product features.
Required Knowledge and Skills:
● Data Engineering Tools: Proficiency in ETL/ELT processes, with experience in tools such as Apache Spark, Flink, Kafka, and Airflow.
● Programming Languages: Expertise in programming languages like Python, SQL, and Scala for data processing and analysis.
● Cloud Platforms: Strong experience with cloud-based data services such as AWS, Google Cloud Platform, or Azure.
● Data Warehousing: In-depth knowledge of data warehousing solutions like Snowflake, Redshift-Athena, or BigQuery.
● Visualisation Tools: Experience with data visualisation tools such as Tableau, Power BI, or Looker. ● Pipeline Monitoring: Knowledge of monitoring and alerting tools like Prometheus, Grafana, or Datadog.
● Lake house file formats: Knowledge and experience of working with various storage formats like AVRO, HUDI, parquet, orc and delta.
● API design and development: experience in designing, implementing, and optimising REST APIs, including hands-on expertise in developing robust, scalable, and secure API solutions like flask, Django or fastapi
  • Senior Data Engineer

    21 hours ago


    gurgaon, India INFONET Full time

    Company Description InfoNet provides customized software solutions for businesses of all sizes, from startups to Forbes 500 enterprises. Since 1996, we've been dedicated to helping companies streamline operations, enhance customer experiences, and drive growth with cutting-edge technology. Our team of developers, engineers, and consultants delivers tailored...

  • Senior Data Engineer

    2 weeks ago


    gurgaon, India True Tech Professionals Full time

    Job Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...

  • Senior Data Engineer

    20 hours ago


    gurgaon, India Coforge Full time

    Job Title: Data EngineerSkills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering ConceptsExperience:Location: GurugramMode of Work: HybridWe at Coforge are hiring Senior Data Engineers with the following skillset:Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).Built and maintained at least...


  • gurgaon, India Coforge Full time

    Job Title: Data EngineerSkills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering ConceptsExperience:Location: GurugramMode of Work: HybridWe at Coforge are hiring Senior Data Engineers with the following skillset:Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).Built and maintained at least...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, India Coforge Full time

    Job Title: Data Engineer Skills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering Concepts Experience: Location: Gurugram Mode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset: Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.). ...


  • gurgaon, India Real Time Data Services Full time

    We are seeking a talented and motivated Senior Software Development Engineer to join our dynamic engineering team. As a Senior Software Development Engineer, you will play a crucial role in the development of web applications and services using technologies & frameworks such as Node.js, React.js, Next.js, Nest.js, PHP, Mysql, MongoDB, Microservices pattern....


  • gurgaon, India MakeMyTrip Full time

    Position: Senior Data Engineer IIExperience: Must have 4+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip...


  • Gurgaon, India Real Time Data Services Full time

    We are seeking a talented and motivated Senior Software Development Engineer to join our dynamic engineering team. As a Senior Software Development Engineer, you will play a crucial role in the development of web applications and services using technologies & frameworks such as Node.js, React.js, Next.js, Nest.js, PHP, Mysql, MongoDB, Microservices pattern....


  • gurgaon, India Publicis Sapient Full time

    Company DescriptionPublicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering...

  • Senior Data Engineer

    2 weeks ago


    gurgaon, India TBO.COM Full time

    Senior Data EngineerTBO–( is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world. The proprietary technology platform aims to simplify the demands of the complex world of global travel by seamlessly connecting the highly distributed travel buyers and travel suppliers at scale.The TBO journey began...


  • gurgaon, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...

  • Senior Manager

    2 weeks ago


    gurgaon, India Marsh McLennan Full time

    Global Metric's Solutions Team is a dynamic team who builds and maintains operational transactional data warehouse for use by MI, Planning and Insight functionsMercer is seeking candidates for the following position based in the GurgaonSenior Manager - Data EngineeringWhat can you expect?This role is critical in enabling data driven decision making,...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, India TBO.COM Full time

    Senior Data Engineer TBO–( TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world. The proprietary technology platform aims to simplify the demands of the complex world of global travel by seamlessly connecting the highly distributed travel buyers and travel suppliers at scale. The TBO...

  • Senior Manager

    2 months ago


    Gurgaon, India Marsh McLennan Full time

    Global Metric's Solutions Teamis a dynamic team who builds and maintains operational transactional data warehouse for use by MI, Planning and Insight functionsMercer is seeking candidates for the following position based in the GurgaonSenior Manager - Data EngineeringWhat can you expect?This role is critical in enabling data driven decision making, ensuring...


  • gurgaon, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...

  • Senior Data Engineer

    15 hours ago


    gurgaon, India A Client of Careerstone Full time

    Role: Manager Data Engineering / Lead Data Engineer Reports to: AD - Data Engineering Location: Gurgaon Responsibilities ● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently extract raw...

  • Senior Data Engineer

    14 hours ago


    gurgaon, India A Client of Careerstone Full time

    Role: Manager Data Engineering / Lead Data EngineerReports to: AD - Data EngineeringLocation: GurgaonResponsibilities● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently extract raw data,...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, India Mrikal Full time

    We are looking for a talented Data Engineer to join our team and play a pivotal role in designing, building, and maintaining the cloud-based data infrastructure for our clients. In this role, you will collaborate closely with data architects, analysts, and cross-functional teams to develop robust and scalable data pipelines, ensuring the seamless flow of...


  • Gurgaon, India True Tech Professionals Full time

    Senior Quality Engineer (Data Validation, Automation Testing, ETL)Location: GurgaonPosition: Senior Quality EngineerExperience: 5+ yearsJob Overview:We are looking for a highly skilled Senior Quality Engineer with over 5 years of experience in data validation, ETL testing, automation, and manual testing for mobile applications. The ideal candidate will...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, India NAB Full time

    Essential Experience- 7+ years technical experience (within financial services industry preferred)- Technical Domain experience (Subject Matter Expertise in Technology or Tools) – particularly in core banking domain with ledger and product data models- Solid experience, knowledge and skills in Data Engineering, software development such as ELT/ETL, data...