Data Engineer

2 weeks ago


GurgaonGurugram, IN Upnotch Consulting Full time

Position Summary :

In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights.

Your Role Responsibilities and Duties :


- Monitor and troubleshoot operational or data issues in the data source/lake for updated version.


- Create and maintain optimal data pipelines and work very closely with all data engineers to build best practice pipelines.

- Maintain and automate delivery of all data pipelines from different sources for all the functions to measure their respective KPIs in an automated way.

- Monitor all schedule jobs to minimize errors to ensure 100% uptime of all reports share with different stakeholders.

- Streamline data pipelines using best industry practices to avoid redundancy in jobs running in analytics data warehouse.

- Performs ad-hoc analyses of data stored within the analytics data warehouse and writes SQL scripts, stored procedures, functions, and views.

- Use data to discover tasks that can be automated.

Required Skills and Qualifications :

General Requirement :

- A college degree or higher in Engineering and/or Science.

- 4+ years' experience in data analytics and data pipelines.

- Strong with SQL, ETL, Python

- Quick self-learner to understand the retail process and engineering mechanism.

- Excellent communication and customer-facing skills with the ability to explain technical approaches and rationale of findings in easy-to-understand terms to scientists, engineering, and business developers.

- Excellent team player

Data Engineer Specific Requirement :

- Expertise in development of ETL pipelines

- Experience in DWH Concepts

- Experience in GCP/AWS/Azure platform

- Experience in agile software engineering cycle.

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Manager/Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk.This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business to...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...

  • Azure Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...


  • Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Data Engineer - SnowflakeLocation : Gurgaon (Hybrid)Summary :We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in developing governance dashboards using Snowflake, Snowpark, Snowflake stored procedures, and...


  • Gurgaon/Gurugram, IN CASHGRAIL PRIVATE LIMITED Full time

    Role & Responsibilities (KRAs) 1) Understand, implement and automate ETL and data pipelines with up-to-date industry standards 2) Hands-on involvement in the design, development and implementation of optimal and scalable data systems 3) Design, build and scale data projects independently and mentor junior data engineers Must - Have Skills: 1) Data Structure...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing...


  • Gurgaon/Gurugram, IN Saarthee Full time

    Position Summary : In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...

  • AWS Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...


  • Gurgaon/Gurugram, IN OFB TECH Pvt Ltd Full time

    Job Description : We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data :- Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize...

  • AWS Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...


  • Gurgaon/Gurugram, IN CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L Full time

    Role : Analytics and Data Engineer - SQL| Python| ETL, 6+ years, GurgaonWe are seeking an experienced Analytics & Data Engineering professional to join our team and spearhead data initiatives. As a key player in our organization, you will collaborate directly with client leadership to shape the vision and roadmap of their Data, Analytics & Insights team. If...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :We are looking for a go getter person who can define :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Huquo Full time

    Role and Responsibilities :- To work on Data Governance - Build a robust data quality validation framework, business rules to identify any data quality issues.- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the data- Build ETL & data pipelines to help feed the data into different business facing data products /...