Data Engineer with Spark and Scala

4 days ago


Chennai, Tamil Nadu, India KRG Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

Roles and Responsibilities

  • Design, develop, test, deploy, and maintain large-scale data pipelines using Scala programming language.
  • Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.
  • Develop complex SQL queries to extract insights from various databases (Oracle, Postgres) and transform them into actionable recommendations.
  • Implement machine learning algorithms on top of big data platforms like Hadoop/Hive/Pyspark to drive business intelligence initiatives.
  • Ensure scalability, reliability, and performance of all developed systems by monitoring their behavior under different loads.

  • Spark/Scala Developer

    4 weeks ago


    Chennai, Tamil Nadu, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...


  • Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...


  • Chennai, Tamil Nadu, India Infotel UK Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....


  • Chennai, Tamil Nadu, India Diverse Lynx Full time

    Hiring for Spark Scala AWS KOLKATA HYDERABAD Design and develop robust scalable data pipelines using Apache Spark Core SQL Streaming MLlib etc with Scala Write clean modular production-grade Scala code adhering to coding standards and best practices Optimize Spark jobs for performance reliability and cost-efficiency including tuning Spark...


  • Chennai, Tamil Nadu, India Dinoxo IT Consulting Full time

    Responsibilities :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage- At least 8+ years of experience in designing and developing large scale, distributed data processing...

  • Lead Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Ixceed Solutions Full time

    About the Role :We are seeking a highly skilled and experienced Lead Data Engineer/Scala Developer with strong hands-on expertise in Scala programming, Apache Spark, Databricks, Python, and PySpark. The ideal candidate will lead the design, development, and deployment of scalable big data solutions, working closely with cross-functional teams to deliver...

  • Senior Data Engineer

    4 hours ago


    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 40,00,000 per year

    Role: Lead Data EngineerLocation: ChennaiMode: HybridType: PermanentJob Description:ob Description:We are looking for a Senior Data Engineer with strong expertise in Scala, Apache Spark, and PySpark to join our team for a high-impact project. The ideal candidate will play a leading role in developing and optimizing big data solutions on cloud-based platforms...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Role Senior Spark /cloudera Engineer Required Technical Skill Set Databricks , Python , Delta Lake , Migration experience from cloudera to Apache Spark, Orchestration.EXP- 10 to 13 Location- Chennai.Must-Have**(Ideally should not be more than 3-5)Databricks Certified Associate Developer for Apache Spark (or equivalent)Strong Python/Scala for Spark...

  • Data engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Role Senior Spark /cloudera EngineerRequired Technical Skill Set Databricks , Python , Delta Lake , Migration experience from cloudera to Apache Spark, Orchestration.EXP- 10 to 13Location- Chennai.Must-Have**(Ideally should not be more than 3-5)Databricks Certified Associate Developer for Apache Spark (or equivalent)Strong Python/Scala for Spark...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Ixceed Solutions Full time

    Role : Data Engineer Location : Chennai (Hybrid).Job Description : Key Responsibilities : - Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks). - Develop and maintain data processing workflows using PySpark and Python. - Collaborate with data scientists, analysts, and business...