Big Data Engineer

4 weeks ago


GurgaonGurugram, IN HuQuo Consulting Pvt. Ltd. Full time

Big Data Engineer

Must-Have :

- 5+ years of experience in Software and IT industry

- 3 + years of relevant work experience in data engineering

- Hands on in Python/Scala data engineering application development

- Hands on in developing streaming application.

- Knowledge on Test automation and scripting

- Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)

- Good track record in system architecture and design

- Good aptitude, strong problem-solving abilities, and analytical skills, ability to take ownership as appropriate.

- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.

- Experience working in Agile Methodology

- Ability to learn and help the team learn new technologies quickly.

- Excellent communication and coordination skills

- Must be able to integrate quickly into the team and work independently towards team goals.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Nice to Have :

- Any prior experience in working on a migration project.

- Any experience with GCP or any cloud is preferred.

Role & Responsibilities:

- Build spark data pipelines from existing legacy pipelines.

- Build CI, CD pipelines.

- Take complete responsibility for the project execution.

- Be accountable for the delivery of the project within the defined timelines with good quality.

- Define and follow the processes for project execution and delivery.

- Drive and motivate the team to be agile and follow agile methodology.

- Help the team technically and give the team direction on how to plan, design, implement, and deliver the projects.

- Involve the team during the brainstorming sessions as appropriate.

- Work with the clients and counterparts (in the US) to drive the project execution.

- Keep all the stakeholders updated about the project status/risks/issues if there are any.

- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Key Skills : Spark, Scala, Hive, Map Reduce, Kafka, Python, Unix shell scripting, Spark streaming, Oracle PL/SQL, Store procedure, CI/CD Process and Tools, Airflow

Education : BE/B.Tech from a reputed institute.

Every individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...


  • Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...


  • Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...


  • Gurgaon/Gurugram, IN Huquo Full time

    Job Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • Publicis Sapient

    4 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Job Description :4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies - Hadoop, Sqoop, Hive and Spark...

  • Solution Architect

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Big Data Developer

    4 weeks ago


    Bangalore/Hyderabad/Noida/Gurgaon/Gurugram/Indore, IN ARR Recruitment Solutions Full time

    Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...


  • Gurgaon/Gurugram, IN CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L Full time

    Role : Analytics and Data Engineer - SQL| Python| ETL, 6+ years, GurgaonWe are seeking an experienced Analytics & Data Engineering professional to join our team and spearhead data initiatives. As a key player in our organization, you will collaborate directly with client leadership to shape the vision and roadmap of their Data, Analytics & Insights team. If...


  • Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full time

    Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

  • Big Data Engineer

    4 weeks ago


    Pune/Gurgaon/Gurugram, IN Huquo Full time

    Must-Have : - 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)- Good...


  • Bangalore/Gurgaon/Gurugram, IN Huquo Full time

    Manager - Data EngineerJob Responsibilities :- Create and maintain optimal data pipeline architecture,- Assemble large, complex data sets that meet functional/non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Key Responsibilities & Skillsets :Common Skillsets :- 5+ years of experience in analytics, Oracle, ETL, Python and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala- Experience with AWS services - Glue, Lambda, EMR, Redshift, RDS- Excellent communication & presentation skills -...