Paisabazaar - Data Engineer - Big Data Technologies
2 months ago
Job Description :
Qualifications for Data Engineer :
- 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.
- 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.
- Strong analytic skills to understand and create solutions for business use cases.
- Ensure best practices to implement data governance principles, data quality checks on each data layer.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
They should also have experience using the following software/tool :
- Experience with big data tools: Hadoop, Hive, Spark, Kafka, Airflow.
- Experience with relational SQL and NoSQL databases: MySQL, Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS/Azure cloud services: EC2, EMR, RDS, Redshift, HDInsights, DataLake, DataBricks
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc.
(ref:hirist.tech)
-
Gurgaon/Gurugram, India Paisabazaar.com Full timeJob Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...
-
Diatoz Solutions
2 days ago
Gurugram, India Diatoz Solutions Private Limited Full timeJob Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...
-
Diatoz Solutions
2 days ago
gurugram, India Diatoz Solutions Private Limited Full timeJob Description : We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...
-
Big Data Engineer
1 week ago
Gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
1 week ago
gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Gurugram, India Impetus Technologies India Pvt. Ltd Full timeQualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...
-
gurugram, India Impetus Technologies India Pvt. Ltd Full timeQualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...
-
Diatoz Solutions
2 days ago
Gurgaon/Gurugram, India Diatoz Solutions Private Limited Full timeJob Description : We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...
-
Diatoz Solutions
27 minutes ago
Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full timeJob Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...
-
Big Data Engineer
5 days ago
Gurgaon/Gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
15 minutes ago
Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Gurgaon/Gurugram, India Impetus Technologies India Pvt. Ltd Full timeQualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...
-
Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full timeQualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...
-
Big Data Engineer
2 weeks ago
gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Big Data Engineer
3 weeks ago
Gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Big Data Engineer
23 hours ago
gurugram, India OmegaHires Full timeJob Title: Big Data Engineer Duration: Full-time on OmegaHires Payroll Location: Gurugram (Should be located near NCR to attend office for 3 days a week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...
-
Publicis Sapient
7 days ago
Gurugram, India Publicis Sapient Full timeJob Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...
-
Senior Data Engineer
1 week ago
gurugram, India Optivalue tek consulting Full timeCompany Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...
-
Publicis Sapient
5 days ago
Bangalore/Gurgaon/Gurugram, India Publicis Sapient Full timeJob Description : Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. -...
-
Publicis Sapient
20 minutes ago
Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full timeJob Description :Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. - Working...