![Mantra Labs Pvt Ltd](https://media.trabajo.org/img/noimg.jpg)
Data Engineer
5 days ago
About the Role :
We are seeking a talented Data Engineer to join our team and play a crucial role in developing and maintaining our data pipelines. You will be responsible for designing, implementing, and optimizing data processing pipelines using PySpark and other big data technologies.
You will also be responsible for ensuring data quality and integrity throughout the data lifecycle.
Responsibilities :
- Design, develop, and maintain scalable data processing pipelines using PySpark.
- Optimize data pipelines for performance and efficiency.
- Ensure data quality and integrity throughout the data lifecycle.
- Troubleshoot and debug data pipeline issues.
- Work closely with data analysts and data scientists to understand data requirements.
- Document data pipelines and processes.
Qualifications :
- 3-5 years of experience as a Data Engineer or in a related role.
- Proficiency in Python and PySpark.
- Familiarity with GCP cloud platforms and their big data services (BigQuery, Dataflow, Cloud Storage, etc.)
- Experience with the Hadoop ecosystem (HDFS, Hive, HBase) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team
-
OfBusiness - Data Engineer - Data Pipeline
1 month ago
Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full timeWe are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...
-
Coforge - Data Engineer - Data Pipeline
1 month ago
Gurgaon/Gurugram, IN COFORGE Full timeJob Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...
-
Senior Data Engineer
1 month ago
Gurgaon/Gurugram, IN Optivalue tek consulting Full timeCompany Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...
-
Data Engineer II
1 month ago
Gurgaon/Gurugram, IN PaddleLift Pvt Ltd Full timeResponsibilities :- Collaborating closely with data scientists, data analysts, and software engineers to build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from diverse sources.- Designing, developing, and owning data pipelines that power analytics for business, research, and product teams.- Developing...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeJob Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...
-
Niine - Data Engineer - ETL/Data Pipeline
2 weeks ago
Gurgaon/Gurugram, IN Niine Pvt Ltd Full timeJob Description :We are seeking a skilled and motivated Data Engineer to join our team. The Data Engineer will be responsible for designing, building, and maintaining the infrastructure and systems that allow for the extraction, transformation, and loading (ETL) of data from various sources. The ideal candidate will have a strong technical background,...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN Upnotch Consulting Full timePosition Summary :In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...
-
Lead Python Engineer
1 month ago
Gurgaon/Gurugram, IN IT Resource Hunter Full timeResponsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...
-
Azure Data Engineer
1 month ago
Gurgaon/Gurugram, IN Conneqtcorp Full timeRole - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...
-
Manager - Data Engineering
1 month ago
Gurgaon/Gurugram, IN Spectral Consultant Full timeSpectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...
-
Diatoz Solutions
1 month ago
Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full timeJob Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeRole & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...
-
Data Engineering Manager
2 weeks ago
Gurgaon/Gurugram, IN Skyleaf Full timeWe are looking for an experienced Azure Cloud and Data Engineering Manager to support our Enterprise Data Environment and provide strategic and technical direction to help deliver solutions using cloud-based : Manager - Azure Cloud and Data Engineering Manager Experience : 10-14 Years Location : Gurugram (Hybrid) Shift Timing : 2PM-11PM Key Responsibilities...
-
Zupee - Senior Data Engineer - ETL/Data Pipeline
1 month ago
Gurgaon/Gurugram, IN CASHGRAIL PRIVATE LIMITED Full timeRole & Responsibilities (KRAs) 1) Understand, implement and automate ETL and data pipelines with up-to-date industry standards 2) Hands-on involvement in the design, development and implementation of optimal and scalable data systems 3) Design, build and scale data projects independently and mentor junior data engineers Must - Have Skills: 1) Data Structure...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN Huquo Full timeAs Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN Huquo Consulting Full timeRole : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...
-
Lead Data Engineer
1 month ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeJob Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...
-
StatusNeo - Data Engineer - Python/PySpark
6 days ago
Gurgaon/Gurugram, IN StatusNeo Technology Consulting Pvt. Ltd Full timeJob Description : Role Purpose :In data engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights.Role Details : Key Responsibilities and Accountabilities:Data Pipeline ETL Development...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeMIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing...
-
Diatoz Solutions
1 month ago
Gurgaon/Gurugram, IN DIATOZ Solutions Pvt ltd., Full timeWe Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing :- Data Pipeline Development: Design, Develop, And Maintain...