Big Data/Scala Developer
Found in: Adzuna IN C2 - 2 weeks ago
Job Description :
In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark.
You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical solutions.
Responsibilities :
- Design, develop, and maintain big data processing pipelines using Scala and Apache Spark.
- Work closely with data engineers and data scientists to understand data requirements and translate them into effective technical solutions.
- Clean, transform, and aggregate large datasets using tools like Spark SQL and DataFrames.
- Develop unit tests for Spark jobs and ensure code quality is maintained.
- Implement best practices for data engineering, including code documentation and version control.
- Troubleshoot and debug complex big data issues to ensure smooth operations.
- Stay up-to-date on the latest advancements in big data technologies and contribute to the team's knowledge base.
Qualifications :
- Proven experience in designing, developing, and maintaining big data processing pipelines.
- Expertise in Scala and Apache Spark.
- Solid understanding of big data concepts, including distributed computing and data storage.
- Experience working with SQL and NoSQL databases.
- Familiarity with data cleaning, transformation, and aggregation techniques.
- Experience with unit testing frameworks for Scala.
- Strong understanding of software development best practices, including code documentation and version control.
- Excellent problem-solving and analytical skills.
- Effective communication and collaboration skills.
- A passion for big data and a desire to stay up-to-date on the latest advancements in the field.
-
Big Data Developer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN Rocket Consulting Full timeBig Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...
-
Big Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeBig Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...
-
Big Data Developer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram/Bangalore, IN Workassist.in Full timeOur hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...
-
Big Data Developer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full timeJob Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...
-
Paisabazaar - Data Engineer - Big Data Technologies
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN Paisabazaar.com Full timeJob Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...
-
Big Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Gurgaon/Gurugram, IN HR BIZ HUB Full timeJob Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL...
-
Big Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Gurgaon/Gurugram, IN Huquo Full timeMust-Have : - 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)- Good...
-
MakeMyTrip - Lead Data Engineer - Scala/Spark
Found in: Adzuna IN C2 - 1 day ago
Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full timeRequirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...
-
AWS Data Architect
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full timeRole Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...
-
Scala Developer
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full timeJob Description :As part of your duties, you will be responsible for :- Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.- Perform performance tuning in Hadoop with a focus on optimizing...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN Www.Huquo.com Full timeMust-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)- Good...
-
Lead GCP Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeJob Description Have :7+ years of experience in the Software and IT industry4 + years of relevant work experience in GCP cloud data engineeringHands on in one of the programming languages like Python / Scala/ JavaCollaborate with clients to understand business requirements and translate them into technical solutions on GCP.Experience in migrating existing...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN Huquo Consulting Full timeRole : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...
-
Azure Data Engineer/Manager
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeRole : Azure Data Engineer, will be responsible for expanding and optimizing's data and pipeline architectures, and for optimizing's data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data...
-
AWS Data Engineer/Senior Manager
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN Huquo Full timeJob Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...
-
Publicis Sapient
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full timeJob Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...
-
Manager/Senior Manager
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeJob Description :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)-...
-
Senior Data Analyst/Manager
Found in: Adzuna IN C2 - 1 day ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeKey Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for Internet of Things (IOT) using Spark streaming.Utilize Kafka expertise to design and...
-
Solution Architect
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full timeJob Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full timeAs Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...