Scala Lead Engineer

1 day ago

Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Summary:

Skills: Lead Data Eng with Scala, Spark, Pyspark & Databricks

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks)

Location: Chennai

Responsibilities:

  • Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.
  • Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.
  • Optimize Spark applications for performance and cost-efficiency within the Databricks environment.
  • Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.
  • Implement data governance and security best practices within Databricks.
  • Troubleshoot and resolve data-related issues, ensuring data availability and reliability.
  • Stay updated with the latest advancements in Spark, Scala, Databricks, and related big data technologies.

Required Skills and Experience:

  • Proven experience as a Data Engineer with a strong focus on big data technologies.
  • Expertise in Scala programming language for data processing and Spark application development.
  • In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and Spark Core.
  • Proficiency in using Databricks platform features, including notebooks, jobs, workflows, and Unity Catalog.
  • Experience with Delta Lake and its capabilities for building data lakes.
  • Strong understanding of data warehousing concepts, data modeling, and relational databases.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
  • Experience with version control systems like Git.
  • Excellent problem-solving and analytical skills.
  • Ability to work independently and as part of a team.

Preferred Qualifications (Optional):

  • Experience with other big data technologies like Kafka, Flink, or Hadoop ecosystem components.
  • Knowledge of data visualization tools.
  • Understanding of DevOps principles and CI/CD pipelines for data engineering.
  • Relevant certifications in Spark or Databricks.

  • Scala Developer

    2 weeks ago

    Chennai, Tamil Nadu, India NoblQ Full time ₹ 13,57,901 per year

    Job Title: Scala DeveloperLocation: Chennai, IndiaAbout Propel At Propel, we don't just build software — we build intelligent, human-centered digital platforms that solve real-world problems. As a design-led technology firm, we combine deep engineering expertise with a passion for scalable, elegant solutions. Join a team where innovation, ownership, and...

  • Lead Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewAs a Lead Data Engineer, you will design, build, and maintain scalable backend and distributed systems that power real-time and data-intensive applications. You will have the autonomy to use your expertise in Java, Scala, or Pythoncrafting robust microservices, APIs, and integrating event-driven and streaming solutions. This role blends hands-on...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineer(Spark,Scala)Location: ChennaiExperience: 3–10 yearsMust-HaveBig Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, SparkScala is MandatoryData Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation...

  • Lead Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India Alans Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Role:As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization.Design and implement robust data pipelines for data ingestion and...

  • Lead Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionResourceTree Global Services Pvt Ltd. (ResourceTree) is a Talent Builder focused on offering careers in various industries, including Information & Technology, Manufacturing, Services, Banking, Agri-tech, Edu-tech, and others. The company collaborates with industry Leaders to fulfill their talent needs effectively. Over the past 7 years,...

  • Senior Spark/Scala Developer

    5 days ago

    Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)ResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...

  • Senior Technical Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    OverviewAs a Senior Technical Lead, you will design, build, and maintain scalable backend and distributed systems that power real-time and data-intensive applications. You will have the autonomy to use your expertise in Java, Scala, or Pythoncrafting robust microservices, APIs, and integrating event-driven and streaming solutions. This role blends hands-on...

  • Sr. Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Sr. Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...