Big Data/Scala Developer

2 weeks ago

GurgaonGurugram, India Waytogo Consultants Full time

Job Description :


In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark.

You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical solutions.

Responsibilities :

- Design, develop, and maintain big data processing pipelines using Scala and Apache Spark.

- Work closely with data engineers and data scientists to understand data requirements and translate them into effective technical solutions.

- Clean, transform, and aggregate large datasets using tools like Spark SQL and DataFrames.

- Develop unit tests for Spark jobs and ensure code quality is maintained.

- Implement best practices for data engineering, including code documentation and version control.

- Troubleshoot and debug complex big data issues to ensure smooth operations.

- Stay up-to-date on the latest advancements in big data technologies and contribute to the team's knowledge base.

Qualifications :

- Proven experience in designing, developing, and maintaining big data processing pipelines.

- Expertise in Scala and Apache Spark.

- Solid understanding of big data concepts, including distributed computing and data storage.

- Experience working with SQL and NoSQL databases.

- Familiarity with data cleaning, transformation, and aggregation techniques.

- Experience with unit testing frameworks for Scala.

- Strong understanding of software development best practices, including code documentation and version control.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

- A passion for big data and a desire to stay up-to-date on the latest advancements in the field.

(ref:hirist.tech)

  • Big Data/Scala Developer

    4 weeks ago

    Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    2 weeks ago

    Gurugram, India Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    1 month ago

    gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    1 month ago

    gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago

    gurgaon, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    3 weeks ago

    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    1 month ago

    Gurugram, India Impetus Full time

    Title: Big data Developer Type: Full-Time Location: Gurgaon Experience: 6-9 Years Preference - Immediate Joiners Qualifications: 3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Able to write Glue jobs. Hands-on experience with...

  • Big Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago

    Bangalore,Gurgaon,Gurugram,Pune,Chennai,Coimbatore,Mumbai,Cochin,Kochi,Noida, India SP Software Pvt. Ltd. Full time

    Job Description : - Should have hands on experience in Software development - Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering...

  • Big Data Developer

    4 weeks ago

    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Big Data Engineer

    2 weeks ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Engineer

    4 weeks ago

    gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Senior Business Analyst/Asst.Manager

    2 weeks ago

    Delhi/NCR/Gurgaon, India HuQuo Full time

    Job Description: We are seeking talented and passionate Big Data Developers with experience in Spark/Hadoop with a deep understanding of Object-Oriented design and extensive experience in Java, Big Data and Hadoop technologies. We are looking for expertise in Spark, HDFS, MapReduce, Pig and/or Hive with a focus on distributed, highly scalable and high...

  • Senior Business Analyst/Asst.Manager

    2 weeks ago

    Delhi/NCR/Gurgaon, India Huquo Full time

    Job Description: We are seeking talented and passionate Big Data Developers with experience in Spark/Hadoop with a deep understanding of Object-Oriented design and extensive experience in Java, Big Data and Hadoop technologies. We are looking for expertise in Spark, HDFS, MapReduce, Pig and/or Hive with a focus on distributed, highly scalable and high...