Data Engineer

5 days ago


GurgaonGurugram, IN Mantra Labs Pvt Ltd Full time

About the Role :

We are seeking a talented Data Engineer to join our team and play a crucial role in developing and maintaining our data pipelines. You will be responsible for designing, implementing, and optimizing data processing pipelines using PySpark and other big data technologies.

You will also be responsible for ensuring data quality and integrity throughout the data lifecycle.

Responsibilities :

- Design, develop, and maintain scalable data processing pipelines using PySpark.

- Optimize data pipelines for performance and efficiency.

- Ensure data quality and integrity throughout the data lifecycle.

- Troubleshoot and debug data pipeline issues.

- Work closely with data analysts and data scientists to understand data requirements.

- Document data pipelines and processes.

Qualifications :

- 3-5 years of experience as a Data Engineer or in a related role.

- Proficiency in Python and PySpark.

- Familiarity with GCP cloud platforms and their big data services (BigQuery, Dataflow, Cloud Storage, etc.)

- Experience with the Hadoop ecosystem (HDFS, Hive, HBase) is a plus.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

- Ability to work independently and as part of a team

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Senior Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Data Engineer II

    1 month ago


    Gurgaon/Gurugram, IN PaddleLift Pvt Ltd Full time

    Responsibilities :- Collaborating closely with data scientists, data analysts, and software engineers to build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from diverse sources.- Designing, developing, and owning data pipelines that power analytics for business, research, and product teams.- Developing...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...


  • Gurgaon/Gurugram, IN Niine Pvt Ltd Full time

    Job Description :We are seeking a skilled and motivated Data Engineer to join our team. The Data Engineer will be responsible for designing, building, and maintaining the infrastructure and systems that allow for the extraction, transformation, and loading (ETL) of data from various sources. The ideal candidate will have a strong technical background,...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Upnotch Consulting Full time

    Position Summary :In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...

  • Lead Python Engineer

    1 month ago


    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Azure Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...


  • Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...

  • Diatoz Solutions

    1 month ago


    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...


  • Gurgaon/Gurugram, IN Skyleaf Full time

    We are looking for an experienced Azure Cloud and Data Engineering Manager to support our Enterprise Data Environment and provide strategic and technical direction to help deliver solutions using cloud-based : Manager - Azure Cloud and Data Engineering Manager Experience : 10-14 Years Location : Gurugram (Hybrid) Shift Timing : 2PM-11PM Key Responsibilities...


  • Gurgaon/Gurugram, IN CASHGRAIL PRIVATE LIMITED Full time

    Role & Responsibilities (KRAs) 1) Understand, implement and automate ETL and data pipelines with up-to-date industry standards 2) Hands-on involvement in the design, development and implementation of optimal and scalable data systems 3) Design, build and scale data projects independently and mentor junior data engineers Must - Have Skills: 1) Data Structure...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Huquo Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...

  • Lead Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...


  • Gurgaon/Gurugram, IN StatusNeo Technology Consulting Pvt. Ltd Full time

    Job Description : Role Purpose :In data engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights.Role Details : Key Responsibilities and Accountabilities:Data Pipeline ETL Development...

  • Data Engineer

    1 month ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing...

  • Diatoz Solutions

    1 month ago


    Gurgaon/Gurugram, IN DIATOZ Solutions Pvt ltd., Full time

    We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing :- Data Pipeline Development: Design, Develop, And Maintain...