Big Data Engineer

2 months ago

GurgaonGurugram, India HuQuo Consulting Pvt. Ltd. Full time

Big Data Engineer

Must-Have :

- 5+ years of experience in Software and IT industry

- 3 + years of relevant work experience in data engineering

- Hands on in Python/Scala data engineering application development

- Hands on in developing streaming application.

- Knowledge on Test automation and scripting

- Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)

- Good track record in system architecture and design

- Good aptitude, strong problem-solving abilities, and analytical skills, ability to take ownership as appropriate.

- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.

- Experience working in Agile Methodology

- Ability to learn and help the team learn new technologies quickly.

- Excellent communication and coordination skills

- Must be able to integrate quickly into the team and work independently towards team goals.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Nice to Have :

- Any prior experience in working on a migration project.

- Any experience with GCP or any cloud is preferred.

Role & Responsibilities:

- Build spark data pipelines from existing legacy pipelines.

- Build CI, CD pipelines.

- Take complete responsibility for the project execution.

- Be accountable for the delivery of the project within the defined timelines with good quality.

- Define and follow the processes for project execution and delivery.

- Drive and motivate the team to be agile and follow agile methodology.

- Help the team technically and give the team direction on how to plan, design, implement, and deliver the projects.

- Involve the team during the brainstorming sessions as appropriate.

- Work with the clients and counterparts (in the US) to drive the project execution.

- Keep all the stakeholders updated about the project status/risks/issues if there are any.

- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Key Skills : Spark, Scala, Hive, Map Reduce, Kafka, Python, Unix shell scripting, Spark streaming, Oracle PL/SQL, Store procedure, CI/CD Process and Tools, Airflow

Education : BE/B.Tech from a reputed institute.

Every individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow

(ref:hirist.tech)

  • Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India virtusa consulting services pvt. ltd. Full time

    Apply for Big Data Engineer, Career Progress Consultants in Gurgaon for 6 - 9 Year of Experience on

  • Big Data Engineer

    6 days ago

    Gurgaon, India virtusa consulting services pvt. ltd. Full time

    Apply for Big Data Engineer, Career Progress Consultants in Gurgaon for 6 - 9 Year of Experience on TimesJobs.com.

  • Paisabazaar - Data Engineer - Big Data Technologies

    2 months ago

    Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Paisabazaar - Data Engineer - Big Data Technologies

    2 weeks ago

    Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Big Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    3 weeks ago

    gurugram, India OmegaHires Full time

    Job Title: Big Data Engineer  Duration: Full-time on OmegaHires Payroll  Location: Gurugram (Should be located near NCR to attend office for 3 days a week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Publicis Sapient

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Publicis Sapient

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, India Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Engineer

    2 months ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core,...

  • Big Data Engineer

    1 month ago

    Gurgaon, India Chiselon Technologies Pvt Ltd Full time

    # Hiring Alert # We are looking for Immediate Joiners Skills: Big Data with GCP  GCP; Hive; PySpark; Python  GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization     "Join us and become an integral part of our success story. Apply today and let's achieve...

  • Diatoz Solutions

    2 weeks ago

    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...