Big Data/Scala Developer

Found in: Adzuna IN C2 - 2 weeks ago


GurgaonGurugram, IN Waytogo Consultants Full time

Job Description :


In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark.

You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical solutions.

Responsibilities :

- Design, develop, and maintain big data processing pipelines using Scala and Apache Spark.

- Work closely with data engineers and data scientists to understand data requirements and translate them into effective technical solutions.

- Clean, transform, and aggregate large datasets using tools like Spark SQL and DataFrames.

- Develop unit tests for Spark jobs and ensure code quality is maintained.

- Implement best practices for data engineering, including code documentation and version control.

- Troubleshoot and debug complex big data issues to ensure smooth operations.

- Stay up-to-date on the latest advancements in big data technologies and contribute to the team's knowledge base.

Qualifications :

- Proven experience in designing, developing, and maintaining big data processing pipelines.

- Expertise in Scala and Apache Spark.

- Solid understanding of big data concepts, including distributed computing and data storage.

- Experience working with SQL and NoSQL databases.

- Familiarity with data cleaning, transformation, and aggregation techniques.

- Experience with unit testing frameworks for Scala.

- Strong understanding of software development best practices, including code documentation and version control.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

- A passion for big data and a desire to stay up-to-date on the latest advancements in the field.

(ref:hirist.tech)
  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Paisabazaar - Data Engineer - Big Data Technologies

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Big Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Gurgaon/Gurugram, IN HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL...

  • Big Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Pune/Gurgaon/Gurugram, IN Huquo Full time

    Must-Have : - 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)- Good...

  • MakeMyTrip - Lead Data Engineer - Scala/Spark

    Found in: Adzuna IN C2 - 1 day ago


    Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full time

    Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

  • AWS Data Architect

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • Scala Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Pune/Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description :As part of your duties, you will be responsible for :- Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.- Perform performance tuning in Hadoop with a focus on optimizing...

  • Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN Www.Huquo.com Full time

    Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)- Good...

  • Lead GCP Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description Have :7+ years of experience in the Software and IT industry4 + years of relevant work experience in GCP cloud data engineeringHands on in one of the programming languages like Python / Scala/ JavaCollaborate with clients to understand business requirements and translate them into technical solutions on GCP.Experience in migrating existing...

  • Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...

  • Azure Data Engineer/Manager

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role : Azure Data Engineer, will be responsible for expanding and optimizing's data and pipeline architectures, and for optimizing's data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data...

  • AWS Data Engineer/Senior Manager

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN Huquo Full time

    Job Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...

  • Publicis Sapient

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Manager/Senior Manager

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)-...

  • Senior Data Analyst/Manager

    Found in: Adzuna IN C2 - 1 day ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Key Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for Internet of Things (IOT) using Spark streaming.Utilize Kafka expertise to design and...

  • Solution Architect

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...