Paisabazaar - Data Engineer - Big Data Technologies

2 months ago


gurugram, India Paisabazaar.com Full time

Job Description :


Qualifications for Data Engineer :

  • 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.
  • 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.
  • Strong analytic skills to understand and create solutions for business use cases.
  • Ensure best practices to implement data governance principles, data quality checks on each data layer.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
We are looking for a candidate with 4+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

They should also have experience using the following software/tool :
  • Experience with big data tools: Hadoop, Hive, Spark, Kafka, Airflow.
  • Experience with relational SQL and NoSQL databases: MySQL, Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/Azure cloud services: EC2, EMR, RDS, Redshift, HDInsights, DataLake, DataBricks
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc.

(ref:hirist.tech)

  • Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Diatoz Solutions

    2 days ago


    Gurugram, India Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Diatoz Solutions

    2 days ago


    gurugram, India Diatoz Solutions Private Limited Full time

    Job Description : We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Big Data Engineer

    1 week ago


    Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    1 week ago


    gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...


  • Gurugram, India Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...


  • gurugram, India Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Diatoz Solutions

    2 days ago


    Gurgaon/Gurugram, India Diatoz Solutions Private Limited Full time

    Job Description : We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Diatoz Solutions

    27 minutes ago


    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Big Data Engineer

    5 days ago


    Gurgaon/Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    15 minutes ago


    Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...


  • Gurgaon/Gurugram, India Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...


  • Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Big Data Engineer

    2 weeks ago


    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    3 weeks ago


    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    23 hours ago


    gurugram, India OmegaHires Full time

    Job Title: Big Data Engineer  Duration: Full-time on OmegaHires Payroll  Location: Gurugram (Should be located near NCR to attend office for 3 days a week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • Publicis Sapient

    7 days ago


    Gurugram, India Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...


  • gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Publicis Sapient

    5 days ago


    Bangalore/Gurgaon/Gurugram, India Publicis Sapient Full time

    Job Description : Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. -...

  • Publicis Sapient

    20 minutes ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. - Working...