Senior Lead Data Engineer

3 weeks ago

GurgaonGurugram, IN Huquo Full time

Job Description :

Must-Have :

- 10+ years of experience in software development and delivery.

- 5 to 7 years of relevant work experience on large-scale Data applications

- Good aptitude, strong problem-solving abilities, and analytical skills

- Should have team handling experience , leading team of 6-7 members OR handle 2-3 smaller teams

- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.

Should have good working experience on :

- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)

- Spark - Batch Processing

- Setting ETL pipelines

- Python or Java programming language is mandatory.

- Worked in data Lake , Data warehousing Domain in Cloud Environment

- Exposure to Snowflake , Redshift or other Distributed Data Warehousing System

- Experience working in Agile Methodology

- Ability to learn and help the team learn new technologies quickly

- Take up the complete of the project with strong sense of ownership.

- Excellent communication and coordination skills

- Knowledgeable (and preferred hands-on) - UNIX environments, different CICD tools, Scheduling tools like Autosys , Airflow etc.

- Must be able to integrate quickly into the team and work independently towards team goals.

Nice to Have :

- Experience in any of the cloud (AWS/Azure/GCP) , preferred is AWS

- Good to have experience in Snowflake

Role & Responsibilities :

- Take the complete responsibility for the project execution

- Be accountable for the delivery of the project in the defined timelines with good quality

- Define and follow the processes for project execution and delivery.

- Drive and motivate the team to be agile and follow agile methodology

- Guide the team technically and give the team a direction on how to plan, design, implement and deliver the projects.

- Define the architecture and discuss the pros-cons of the same with the team

- Involve the team during the brainstorming sessions as appropriate.

- Work with other team leads to get the architecture reviewed.

- Work with the clients and counterparts (in the US) to drive the project execution.

- Keep all the stakeholders updated about the project status/risks/issues if there are any.

- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.

- Should be comfortable travel to Pune as and when required

Key Skills : Java / Python , Spark, Snowflake, AWS

Education : BE/B.Tech from a reputed institute.

(ref:hirist.tech)

  • Senior Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Python Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Lead Python Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • AWS Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • Lead/Senior Azure Data Engineer

    2 months ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead/Senior Azure Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • OfBusiness - Lead Engineer - Data Science

    3 weeks ago

    Gurgaon/Gurugram, IN OFB TECH Pvt Ltd Full time

    We are seeking a highly skilled and experienced AI/ML Lead to join our dynamic team. The ideal candidate should have an experience of 5-7 years in artificial intelligence and machine learning, with a proven track record of leading successful projects. As the AI/ML Lead, you will be responsible for driving the development and implementation of cutting-edge AI...

  • OfBusiness - Lead Engineer - Data Science

    3 weeks ago

    Gurgaon/Gurugram, IN OFB TECH Pvt Ltd Full time

    We are seeking a highly skilled and experienced AI/ML Lead to join our dynamic team. The ideal candidate should have an experience of 5-7 years in artificial intelligence and machine learning, with a proven track record of leading successful projects. As the AI/ML Lead, you will be responsible for driving the development and implementation of cutting-edge AI...

  • Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...

  • Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...

  • Coforge - Data Engineer - Data Pipeline

    3 weeks ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Coforge - Data Engineer - Data Pipeline

    2 months ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Lead Data Engineer

    6 days ago

    Gurgaon/Gurugram, IN Visionyle Solutions Full time

    Role : Lead Data EngineerExp : 7-10 YearsLocation : Gurgaon (Hybrid) - 3 days WFORequirements :- Have a strong technical background, including 8+ years of experience in designing and engineering large scale systems.- At least 3 years of experience working as lead in designing, development and deploying data integration and ETL solutions in a data warehousing...

  • Curate Data Analytics

    3 weeks ago

    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Curate Data Analytics

    2 months ago

    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...