Lead- Data Engineering

2 weeks ago

Gurugram, India FNP Full time

Job Title: Lead- Data Engineering

Department: CET

Location: Corporate Office, Gurgaon

Exp Range: 8 to 10 Years

Educational Qualification: Bachelor’s degree in computer science/information technology

Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS




Role Overview:


This position is for the Ecommerce division of FNP India, FNP UAE, FNP Singapore (fnp.com, fnp.ae & fnp.sg respectively). The hire in this position will be a part of the core technology team participating in the continuous evolution of FNP resulting in systems on the bleeding edge of technology. We are looking for a Data Engineering Leader with deep leadership skills and a vision to implement and try the latest cutting-edge technologies to find competitive edge in the market and bring operational efficiency within the organization. The candidate should be a highly creative and technically skilled individual responsible for crunching data to drive business analytics. The ideal candidate should be a master on MySQL, MongoDB, Big Query, Kafka, Metabase, Athena, EMR, Spark, S3 and DMS.



Key Responsibilities:


  • Migrating on-premises corporate applications and related data to the cloud.
  • Build and maintain data pipelines and maintain databases.
  • Design, build, test, and maintain data management systems.
  • Develop, implement and optimize process in the data migration process.
  • Performance data query focused delivery.
  • Experience in Data Architecture, Collect Data, Conduct Research, improve skills on his own based on requirements.
  • Should be able to analyze existing SQL platform data - stabilize and improve performance.
  • Develop Archival scripts, along with access to on demand for archived data.
  • Monitoring pipelines performance for potential bottlenecks and resolving performance issues.
  • Provide timely scheduled management reporting.
  • Report status, intimate any risks identified with the task delivery to Engineering Manager



Desired Skills and Experience:

  • Should have a working experience of 5+ years of experience on cloud data using technologies like MySQL, MongoDB, Big Query, Kafka, Metabase, Athena, EMR, Spark, S3.
  • 4+ years of experience as a SQL developer or similar role.
  • Fundamentals of distributed systems like Apache Hadoop, Apache Spark.
  • Should be experienced in data structures, data modeling, data lakes, data architecture.
  • Excellent understanding of SQL programming.
  • Business intelligence and analytics.
  • Visualization / big data analytics / dashboards like Metabase, Tableau.
  • Knowledge of working with connectors – REST, SOAP, FTP, HTTP, etc.
  • Should be experienced with operating systems like UNIX, Linux, etc.
  • Master in Migrating, Indexing, Performance, Partitioning, Archiving etc.
  • Familiarity with the practical application of NoSQL / NewSQL databases.
  • Sense of ownership and pride in your performance and its impact on the company’s success.
  • Good time-management skills.
  • Debugging query performance.
  • Ability to innovate, feasibility analysis, PoC execution and R&D. Ability to identify tools for future use.
  • Should be able to do effort estimations.
  • Strong mathematical, analytical and problem-solving techniques.
  • Confidence to liaise with application developers and senior technology managers.
  • Ability to work and thrive in a fast-paced environment, learn rapidly and master diverse database technologies.
  • Ability to multitask and work under pressure.
  • Must have experience in EMR, Spark, Big Query, MySQL, MongoDB, Kafka.
  • Experience in Hadoop, AWS Athena, s3, AWS DynamoDB, AWS DMS, Any graph DB, AWS Lambda, Pyscript and AWS Firehose are good to have


Functional/Leadership Competencies

  • Excellent Communication Skills both verbal and written.
  • Clarity of thought (Sequential/logical presentation explaining a subject matter).
  • Adaptability/Flexibility to change (New ideas/ new concepts).
  • Creativity (Initiatives for change/new ideas).
  • Excellent analytical and quantitative skills; ability to make decisions backed up by data and metrics.
  • Attention to detail with proven ability to manage multiple projects, competing for priorities simultaneously.
  • Positive, pro-active attitude with a willingness to anticipate and manage change in a highly dynamic environment.

  • Lead Data Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    4 days ago

    gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    5 days ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Eucloid - Data Engineer - Azure Databricks

    6 days ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Lead Data Engineer

    4 weeks ago

    gurugram, India United Airlines Full time

    Description United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose:...

  • Eucloid - Senior Data Engineer - Azure Databricks

    6 days ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Lead- Data Engineering

    2 weeks ago

    gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CET Location: Corporate Office, Gurgaon Exp Range: 8 to 10 Years Educational Qualification: Bachelor’s degree in computer science/information technology Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS Role Overview: This position...

  • Lead- Data Engineering

    2 weeks ago

    Gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CETLocation: Corporate Office, GurgaonExp Range: 8 to 10 YearsEducational Qualification: Bachelor’s degree in computer science/information technologyKey Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the...

  • Lead - Data Engineer

    6 days ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead - Data Engineer

    6 days ago

    gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only & Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center. As a Lead Data Enginee r, you will require a wide range of strengths and capabilities including :Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcome s.Play a key role in our...

  • Lead - Data Engineer

    6 days ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead Data Engineer

    5 days ago

    Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    22 hours ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    1 month ago

    Gurugram, India EXL Full time

    Location- Gurgaon/ BangaloreExperience- 7Yrs-8 YrsJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data...

  • Lead Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Lead Data Engineer

    5 days ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    1 month ago

    gurugram, India United Airlines Full time

    Description United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose:...