SCALA Data Engineer

1 week ago

Bengaluru, India AKIRA Insights Full time

Job Title: Data Engineer (SCALA)


Location: Pune, India


Experience: 3-5 years


Company Description


Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.


Job Summary:


We are looking for a skilled Data Engineer with hands-on expertise in Databricks, Spark, and data transformation techniques. The ideal candidate will have a strong technical foundation in SQL , Python/Pyspark , and Spark Scala , with additional experience in Azure and data engineering tools preferred. This role involves building and optimizing scalable data pipelines, collaborating with stakeholders, and implementing best practices to enhance data processing performance and efficiency.


Key Responsibilities:


Data Pipeline Development:

  • Design, develop, and optimize scalable data processing pipelines using Databricks and Spark.
  • Build and maintain robust ETL workflows to handle large-scale data.


Data Optimization:

  • Implement advanced Spark and SQL optimization techniques to ensure high performance and scalability.
  • Utilize Databricks Delta Lake Architecture and Unity Catalog for effective data governance.


Data Transformation:

  • Use SQL and Pyspark functions to manipulate, transform, and enrich data according to business requirements.
  • Work with Spark Scala for additional data processing tasks as needed.


Collaboration and Communication:

  • Collaborate with stakeholders, data analysts, and other teams to gather and understand data requirements.
  • Effectively communicate technical concepts to non-technical stakeholders.


Required Skills:


  • Spark Scala: Expertise in Spark-based application development.
  • Databricks : Hands-on experience with Delta Lake Architecture and Unity Catalog.
  • SQL : Advanced data transformation skills.
  • Python/Pyspark : Proficiency in data manipulation and processing.
  • Excellent communication skills.


Good to Have:


  • Azure : Experience with Azure-based services and solutions.
  • ETL : Hands-on experience with ETL processes and tools.
  • Power BI : Experience in working with Power BI (preferred but optional).
  • Familiarity with IntelliJ and version control systems like GIT .


Day-to-Day Activities:


  • Develop, test, and deploy data pipelines and workflows using Spark and Databricks.
  • Optimize SQL and Spark jobs for better performance and efficiency.
  • Collaborate with stakeholders to gather data requirements and deliver solutions.
  • Implement data governance practices using Databricks Unity Catalog.


Preferred Qualifications:


  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Certification in Azure or Databricks is a plus.

  • Data engineer

    4 days ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4 Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    5 days ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    6 days ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 Years JD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    5 days ago

    Bengaluru, India Capco Full time

    Greetings from Capco... We are hiring for Data Engineer - Scala Professionals for Bangalore Location. Hands on experience in Scala is must atleast 2 Years CTC Max 30 LPA Notice period : Immediate to max 30 Days only Location : Bangalore Experience : 4Years to max 8 Years JD: Proven 4-8 years of experience as a Senior Data Engineer or similar role. •...

  • SCALA Data Engineer

    7 days ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • Scala data engineer

    6 days ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • SCALA Data Engineer

    1 week ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • SCALA Data Engineer

    1 week ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • Capco | Data Engineer

    5 days ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Scala Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Quantiphi Full time

    Role OverviewWe are seeking a highly skilled Scala Data Engineer to join our team at Quantiphi. In this role, you will be responsible for designing and developing data processing pipelines using Apache Spark 2.x.The ideal candidate will have a deep understanding of distributed systems, including the CAP theorem, partitioning, replication, consistency, and...

  • Data Engineering Expert with Scala Skills

    3 weeks ago

    Bengaluru, Karnataka, India Capco Full time

    Job Summary:Data Engineer (Scala) Position in Pune or Bangalore.Band M3/M4 (6 to 14 years) experience required.Notice Period: Immediate join expected.Role Description:About the Role:We are looking for a highly skilled Data Engineer with expertise in Scala programming language and experience with Big Data technologies. The successful candidate will be...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Sampoorna Consultants Pvt. Ltd Full time

    Knowledge/Qualifications/ Technical Competencies : Knowledge, Skills & Abilities : - Develop and maintain automated test suites, using Python/Scala/C# - Hands-on experience in writing scripts in Python/Scala/C# - Simulate E2E scenarios Data factory, Databricks and SQL Database - Experience in ETL Testing, Database Testing, Data Quality, System Testing, Test...

  • Data Engineer III

    2 months ago

    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

  • Data Scientist

    1 month ago

    Bengaluru, Karnataka, India Rigel networks Full time

    About the RoleWe are seeking a highly skilled Data Scientist - Big Data/Spark Scala to design, develop, and optimize data processing pipelines using Apache Spark and Scala. The ideal candidate will have a strong understanding of big data technologies and be proficient in Scala programming.Key Responsibilities• Design, develop, and maintain scalable and...

  • Data Engineering Expert with Scala and Spark Experience

    1 day ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    About the RoleWe are seeking a highly skilled Data Engineering Expert to join our team. As a key member, you will be responsible for designing and developing big data platforms using Scala and Spark.Job DescriptionThe ideal candidate will have a deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and other Hadoop...

  • Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Suitable.AI Full time

    Job Description :- (SCALA) 3+ YRS. Role Objective :Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow- and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys- optimizing data systems and building.The...

  • Xebia - Scala Data Engineer

    3 weeks ago

    Bengaluru, India Xebia IT Architects India Pvt Ltd Full time

    About the Company :Founded in 2001, Xebia pioneered Agile adoption in the Netherlands and has since evolved into a global digital consulting powerhouse. With over 5,000 professionals, Xebia excels in delivering comprehensive solutions across diverse fields like Agile, DevOps, Data and AI, Cloud, Software Technology, Security, Low Code, and Microsoft...

  • Senior Data Engineer

    1 week ago

    Bengaluru, India LITTLE ROBIN TECHNOLOGY PARTNERS PRIVATE LIMITED Full time

    Job Title : Senior Data Engineer - Spark, Scala, HiveLocation : BangaloreExperience : 4+ YearsJob Type : Full-Time Employee (FTE)Mode of Work : Hybrid (2-3 days from office)Job Description : We are looking for a Senior Data Engineer with strong expertise in Spark, Scala, and Hive to join our dynamic team. The ideal candidate will have hands-on experience in...

  • AKIRA Insights | SCALA Data Engineer | bangalore

    1 week ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer(SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • Azure/Scala Data Engineers

    4 months ago

    Bengaluru, India KPI Partners Full time

    Must-have7+ years overall experience and 5+ years of relevant experience in data engineering in a fast-paced learning environment.Strong programming skills, with experience in languages such as Python/Pyspark, Scala, and SQL.Strong hands on experience working with Azure Databricks and Delta Lake concepts.Take ownership from design of the feature through...