▷ [Only 24h Left] SCALA Data Engineer

2 weeks ago

Bengaluru, India AKIRA Insights Full time
Job Title: Data Engineer (SCALA)

Location: Pune, India

Experience: 3-5 years

Company Description

Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.

Job Summary:

We are looking for a skilled Data Engineer with hands-on expertise in Databricks, Spark, and data transformation techniques. The ideal candidate will have a strong technical foundation in SQL, Python/Pyspark, and Spark Scala, with additional experience in Azure and data engineering tools preferred. This role involves building and optimizing scalable data pipelines, collaborating with stakeholders, and implementing best practices to enhance data processing performance and efficiency.

Key Responsibilities:

Data Pipeline Development:

- Design, develop, and optimize scalable data processing pipelines using Databricks and Spark.- Build and maintain robust ETL workflows to handle large-scale data.

Data Optimization:

- Implement advanced Spark and SQL optimization techniques to ensure high performance and scalability.- Utilize Databricks Delta Lake Architecture and Unity Catalog for effective data governance.

Data Transformation:

- Use SQL and Pyspark functions to manipulate, transform, and enrich data according to business requirements.- Work with Spark Scala for additional data processing tasks as needed.

Collaboration and Communication:

- Collaborate with stakeholders, data analysts, and other teams to gather and understand data requirements.- Effectively communicate technical concepts to non-technical stakeholders.

Required Skills:

- Spark Scala: Expertise in Spark-based application development.- Databricks: Hands-on experience with Delta Lake Architecture and Unity Catalog.- SQL: Advanced data transformation skills.- Python/Pyspark: Proficiency in data manipulation and processing.- Excellent communication skills.

Good to Have:

- Azure: Experience with Azure-based services and solutions.- ETL: Hands-on experience with ETL processes and tools.- Power BI: Experience in working with Power BI (preferred but optional).- Familiarity with IntelliJ and version control systems like GIT.

Day-to-Day Activities:

- Develop, test, and deploy data pipelines and workflows using Spark and Databricks.- Optimize SQL and Spark jobs for better performance and efficiency.- Collaborate with stakeholders to gather data requirements and deliver solutions.- Implement data governance practices using Databricks Unity Catalog.

Preferred Qualifications:

- Bachelor’s degree in Computer Science, Engineering, or a related field.- Certification in Azure or Databricks is a plus.

  • Data engineer

    4 weeks ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4 Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Capco Full time

    Greetings from Capco... We are hiring for Data Engineer - Scala Professionals for Bangalore Location. Hands on experience in Scala is must atleast 2 Years CTC Max 30 LPA Notice period : Immediate to max 30 Days only Location : Bangalore Experience : 4Years to max 8 Years JD: Proven 4-8 years of experience as a Senior Data Engineer or similar role. •...

  • Capco | Data Engineer

    4 weeks ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capco Full time

    Job Title: Data Engineer - ScalaAbout Us“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 YearsJD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NetAnalytiks Technologies Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at NetAnalytiks Technologies. As a key member of our data engineering team, you will play a crucial role in designing and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Apache Spark and...

  • Data Engineering Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NetAnalytiks Technologies Full time

    Job Summary: We're looking for a talented Data Engineering Specialist to join our team at NetAnalytiks Technologies. As a key member of our data engineering team, you will design and implement large-scale data processing systems that drive business growth.Responsibilities:Develop and maintain high-performance data pipelines using Apache Spark and...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capco Full time

    Job Title: Data Engineer - ScalaAbout Us“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capco Full time

    Job Title: Data Engineer - ScalaAbout Us“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capco Full time

    Job Title: Data Engineer - Scala About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...

  • SCALA Data Engineer

    1 month ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • Scala data engineer

    1 month ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • Capco - Data Engineer - Scala

    2 weeks ago

    Bengaluru, India Capco Technologies Pvt Ltd Full time

    Job Title: Data Engineer Scala. About Us : "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • SCALA Data Engineer

    1 month ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • SCALA Data Engineer

    1 month ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • SCALA Data Engineer

    1 month ago

    Bengaluru, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA) Location: Pune, India Experience: 3-5 years Company Description Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data. Job Summary: We...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capco Full time

    Job Title: Data Engineer - ScalaAbout Us“Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...

  • Data Engineering Expert

    7 days ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Job Title: Data Engineering Expert - Scala Spark">About the Role:We are seeking an experienced Data Engineer with expertise in Scala and Spark to join our team at LTIMindtree. As a key member of our engineering team, you will design, develop, and maintain big data platforms using modern technologies such as Spark, HBase, Hive, and other Hadoop ecosystem...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer with expertise in Spark and Scala to join our team at Tata Consultancy Services.Job SummaryThis is a challenging opportunity for a talented engineer to design, develop, and implement big data solutions using Spark and Scala.ResponsibilitiesThe successful candidate will be responsible...

  • Data Engineer

    1 month ago

    Bengaluru, India Sampoorna Consultants Pvt. Ltd Full time

    Knowledge/Qualifications/ Technical Competencies : Knowledge, Skills & Abilities : - Develop and maintain automated test suites, using Python/Scala/C# - Hands-on experience in writing scripts in Python/Scala/C# - Simulate E2E scenarios Data factory, Databricks and SQL Database - Experience in ETL Testing, Database Testing, Data Quality, System Testing, Test...