
Data Engineer with Spark and Scala
4 days ago
Roles and Responsibilities
- Design, develop, test, deploy, and maintain large-scale data pipelines using Scala programming language.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.
- Develop complex SQL queries to extract insights from various databases (Oracle, Postgres) and transform them into actionable recommendations.
- Implement machine learning algorithms on top of big data platforms like Hadoop/Hive/Pyspark to drive business intelligence initiatives.
- Ensure scalability, reliability, and performance of all developed systems by monitoring their behavior under different loads.
-
Spark/Scala Developer
4 weeks ago
Chennai, Tamil Nadu, India HARP Technologies and Services Full timeNotice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...
-
Scala Spark Developer
2 days ago
Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per yearScala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...
-
Spark Scala Developer
1 week ago
Chennai, Tamil Nadu, India Infotel UK Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....
-
Spark Scala, Aws Kolkata&hyderabad
3 weeks ago
Chennai, Tamil Nadu, India Diverse Lynx Full timeHiring for Spark Scala AWS KOLKATA HYDERABAD Design and develop robust scalable data pipelines using Apache Spark Core SQL Streaming MLlib etc with Scala Write clean modular production-grade Scala code adhering to coding standards and best practices Optimize Spark jobs for performance reliability and cost-efficiency including tuning Spark...
-
Spark & Scala Developer
2 weeks ago
Chennai, Tamil Nadu, India Dinoxo IT Consulting Full timeResponsibilities :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage- At least 8+ years of experience in designing and developing large scale, distributed data processing...
-
Lead Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Ixceed Solutions Full timeAbout the Role :We are seeking a highly skilled and experienced Lead Data Engineer/Scala Developer with strong hands-on expertise in Scala programming, Apache Spark, Databricks, Python, and PySpark. The ideal candidate will lead the design, development, and deployment of scalable big data solutions, working closely with cross-functional teams to deliver...
-
Senior Data Engineer
4 hours ago
Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 40,00,000 per yearRole: Lead Data EngineerLocation: ChennaiMode: HybridType: PermanentJob Description:ob Description:We are looking for a Senior Data Engineer with strong expertise in Scala, Apache Spark, and PySpark to join our team for a high-impact project. The ideal candidate will play a leading role in developing and optimizing big data solutions on cloud-based platforms...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeRole Senior Spark /cloudera Engineer Required Technical Skill Set Databricks , Python , Delta Lake , Migration experience from cloudera to Apache Spark, Orchestration.EXP- 10 to 13 Location- Chennai.Must-Have**(Ideally should not be more than 3-5)Databricks Certified Associate Developer for Apache Spark (or equivalent)Strong Python/Scala for Spark...
-
Data engineer
3 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeRole Senior Spark /cloudera EngineerRequired Technical Skill Set Databricks , Python , Delta Lake , Migration experience from cloudera to Apache Spark, Orchestration.EXP- 10 to 13Location- Chennai.Must-Have**(Ideally should not be more than 3-5)Databricks Certified Associate Developer for Apache Spark (or equivalent)Strong Python/Scala for Spark...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Ixceed Solutions Full timeRole : Data Engineer Location : Chennai (Hybrid).Job Description : Key Responsibilities : - Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks). - Develop and maintain data processing workflows using PySpark and Python. - Collaborate with data scientists, analysts, and business...