Big Data/Scala Developer

Found in: Talent IN 2A C2 - 3 weeks ago

Gurugram, India Waytogo Consultants Full time

Job Description :


In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark.

You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical solutions.

Responsibilities :

- Design, develop, and maintain big data processing pipelines using Scala and Apache Spark.

- Work closely with data engineers and data scientists to understand data requirements and translate them into effective technical solutions.

- Clean, transform, and aggregate large datasets using tools like Spark SQL and DataFrames.

- Develop unit tests for Spark jobs and ensure code quality is maintained.

- Implement best practices for data engineering, including code documentation and version control.

- Troubleshoot and debug complex big data issues to ensure smooth operations.

- Stay up-to-date on the latest advancements in big data technologies and contribute to the team's knowledge base.

Qualifications :

- Proven experience in designing, developing, and maintaining big data processing pipelines.

- Expertise in Scala and Apache Spark.

- Solid understanding of big data concepts, including distributed computing and data storage.

- Experience working with SQL and NoSQL databases.

- Familiarity with data cleaning, transformation, and aggregation techniques.

- Experience with unit testing frameworks for Scala.

- Strong understanding of software development best practices, including code documentation and version control.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

- A passion for big data and a desire to stay up-to-date on the latest advancements in the field.

(ref:hirist.tech)

  • Big Data/Scala Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Gurgaon,Gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    Found in: Whatjobs IN C2 - 3 days ago

    Gurgaon/Gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    Found in: Adzuna IN C2 - 2 weeks ago

    Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    Found in: Talent IN 2A C2 - 3 weeks ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    Found in: Talent IN 2A C2 - 4 days ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Gurgaon,Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 days ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Gurugram, India Impetus Full time

    Title: Big data Developer Type: Full-Time Location: Gurgaon Experience: 6-9 Years Preference - Immediate Joiners Qualifications: 3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Able to write Glue jobs. Hands-on experience with...

  • Big Data Developer

    Found in: Talent IN 2A C2 - 1 week ago

    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Engineer

    Found in: Talent IN 2A C2 - 3 weeks ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Consultant

    Found in: Talent IN C2 - 3 weeks ago

    Gurugram, India IQuest Management Consultants Full time

    JD and company profile Data Consultant - Spark Developer with AWS position Gurgaon location: Position Title : Data Consultant - Spark Developer with AWS Mandatory Skills: Experience working on Big Data Consultant with PySpark/Scala or Java, AWS Glue, EMR and Lambda, Cloudera Data Platform (CDP) Rest as per below JD. Exp 7 to 12 years ...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bangalore,Gurgaon,Gurugram,Pune,Chennai,Coimbatore,Mumbai,Cochin,Kochi,Noida, India SP Software Pvt. Ltd. Full time

    Job Description : - Should have hands on experience in Software development - Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago

    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Gurgaon,Gurugram,Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 days ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    gurugram, India LTIMindtree Full time

    PySpark Data Engineer with ML Ops Experience - 5 to 10 Years Location - Bangalore (Initial 3 months deputation in Gurgaon) / Rest of India (Initial 3 months deputation in Gurgaon) Primary - PySpark, Spark, Scala AWS S3, EMR Good in troubleshooting on Kubernetes/Docker Airflow, Jenkins Model Deployment Experience What you'll do: You will work in a...