Data Engineer

2 weeks ago


GurgaonGurugram, IN Upnotch Consulting Full time

Position Summary :

In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights.

Your Role Responsibilities and Duties :


- Monitor and troubleshoot operational or data issues in the data source/lake for updated version.


- Create and maintain optimal data pipelines and work very closely with all data engineers to build best practice pipelines.

- Maintain and automate delivery of all data pipelines from different sources for all the functions to measure their respective KPIs in an automated way.

- Monitor all schedule jobs to minimize errors to ensure 100% uptime of all reports share with different stakeholders.

- Streamline data pipelines using best industry practices to avoid redundancy in jobs running in analytics data warehouse.

- Performs ad-hoc analyses of data stored within the analytics data warehouse and writes SQL scripts, stored procedures, functions, and views.

- Use data to discover tasks that can be automated.

Required Skills and Qualifications :

General Requirement :

- A college degree or higher in Engineering and/or Science.

- 4+ years' experience in data analytics and data pipelines.

- Strong with SQL, ETL, Python

- Quick self-learner to understand the retail process and engineering mechanism.

- Excellent communication and customer-facing skills with the ability to explain technical approaches and rationale of findings in easy-to-understand terms to scientists, engineering, and business developers.

- Excellent team player

Data Engineer Specific Requirement :

- Expertise in development of ETL pipelines

- Experience in DWH Concepts

- Experience in GCP/AWS/Azure platform

- Experience in agile software engineering cycle.

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...


  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Data Engineer II

    2 weeks ago


    Gurgaon/Gurugram, IN PaddleLift Pvt Ltd Full time

    Responsibilities :- Collaborating closely with data scientists, data analysts, and software engineers to build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from diverse sources.- Designing, developing, and owning data pipelines that power analytics for business, research, and product teams.- Developing...

  • Data Engineer II

    2 weeks ago


    Gurgaon/Gurugram, IN PaddleLift Pvt Ltd Full time

    Responsibilities :- Collaborating closely with data scientists, data analysts, and software engineers to build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from diverse sources.- Designing, developing, and owning data pipelines that power analytics for business, research, and product teams.- Developing...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Data Engineer

    2 months ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Upnotch Consulting Full time

    Position Summary :In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...

  • Lead Python Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Lead Python Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Azure Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...

  • Azure Data Engineer

    2 months ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...


  • Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...


  • Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...

  • Diatoz Solutions

    2 weeks ago


    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Diatoz Solutions

    2 weeks ago


    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...