AKIRA Insights | SCALA Data Engineer | bangalore

7 days ago

bangalore, India AKIRA Insights Full time

Job Title: Data Engineer (SCALA)


Location: Pune, India


Experience: 3-5 years


Company Description


Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.


Job Summary:


We are looking for a skilled Data Engineer with hands-on expertise in Databricks, Spark, and data transformation techniques. The ideal candidate will have a strong technical foundation in SQL, Python/Pyspark, and Spark Scala, with additional experience in Azure and data engineering tools preferred. This role involves building and optimizing scalable data pipelines, collaborating with stakeholders, and implementing best practices to enhance data processing performance and efficiency.


Key Responsibilities:


Data Pipeline Development:

  • Design, develop, and optimize scalable data processing pipelines using Databricks and Spark.
  • Build and maintain robust ETL workflows to handle large-scale data.


Data Optimization:

  • Implement advanced Spark and SQL optimization techniques to ensure high performance and scalability.
  • Utilize Databricks Delta Lake Architecture and Unity Catalog for effective data governance.


Data Transformation:

  • Use SQL and Pyspark functions to manipulate, transform, and enrich data according to business requirements.
  • Work with Spark Scala for additional data processing tasks as needed.


Collaboration and Communication:

  • Collaborate with stakeholders, data analysts, and other teams to gather and understand data requirements.
  • Effectively communicate technical concepts to non-technical stakeholders.


Required Skills:


  • Spark Scala: Expertise in Spark-based application development.
  • Databricks: Hands-on experience with Delta Lake Architecture and Unity Catalog.
  • SQL: Advanced data transformation skills.
  • Python/Pyspark: Proficiency in data manipulation and processing.
  • Excellent communication skills.


Good to Have:


  • Azure: Experience with Azure-based services and solutions.
  • ETL: Hands-on experience with ETL processes and tools.
  • Power BI: Experience in working with Power BI (preferred but optional).
  • Familiarity with IntelliJ and version control systems like GIT.


Day-to-Day Activities:


  • Develop, test, and deploy data pipelines and workflows using Spark and Databricks.
  • Optimize SQL and Spark jobs for better performance and efficiency.
  • Collaborate with stakeholders to gather data requirements and deliver solutions.
  • Implement data governance practices using Databricks Unity Catalog.


Preferred Qualifications:


  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Certification in Azure or Databricks is a plus.

  • AKIRA Insights | SCALA Data Engineer | bangalore

    6 days ago

    bangalore, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA)Location: Pune, IndiaExperience: 3-5 yearsCompany DescriptionAkira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.Job Summary:We are looking...

  • AKIRA Insights | SCALA Data Engineer | bangalore

    6 days ago

    bangalore, India AKIRA Insights Full time

    Job Title: Data Engineer (SCALA) Location: Pune, India Experience: 3-5 years Company Description Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data. Job Summary: We...

  • AKIRA Insights | Microsoft Power Platform Developer | bangalore

    6 days ago

    bangalore, India AKIRA Insights Full time

    Job Title: Microsoft Power Platform DeveloperJob Location: BangaloreAbout Akira Insights:Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.What we offer:Competitive Salary...

  • AKIRA Insights | Microsoft Power Platform Developer | bangalore

    7 days ago

    bangalore, India AKIRA Insights Full time

    Job Title: Microsoft Power Platform DeveloperJob Location: Bangalore About Akira Insights:Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data.What we offer:Competitive...

  • AKIRA Insights | Microsoft Power Platform Developer | bangalore

    6 days ago

    bangalore, India AKIRA Insights Full time

    Job Title: Microsoft Power Platform Developer Job Location: Bangalore About Akira Insights: Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data. What we offer: ...

  • Capco | Data Engineer

    3 days ago

    bangalore, India Capco Full time

    Greetings from Capco... We are hiring for Data Engineer - Scala Professionals for Bangalore Location. Hands on experience in Scala is must atleast 2 Years CTC Max 30 LPA Notice period : Immediate to max 30 Days only Location : Bangalore Experience : 4Years to max 8 Years JD: Proven 4-8 years of experience as a Senior Data Engineer or similar role. •...

  • Capco | Data Engineer

    4 days ago

    bangalore, India Capco Full time

    Greetings from Capco...We are hiring for Data Engineer - Scala Professionals for Bangalore Location.Hands on experience in Scala is must atleast 2 YearsCTC Max 30 LPANotice period : Immediate to max 30 Days onlyLocation : BangaloreExperience : 4Years to max 8 Years JD:Proven 4-8 years of experience as a Senior Data Engineer or similar role. • Experience...

  • Data Engineer

    6 days ago

    Delhi NCR/Bangalore/Hyderabad/Chennai, India ANLAGE Full time

    Job Overview : We are seeking a highly skilled and motivated Scala Data Engineer to join our team. In this role, you will design, build, and maintain large-scale data processing systems. The ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines....

  • HCLTech | Scala Developer | bangalore

    5 days ago

    bangalore, India HCLTech Full time

    Responsibilities: Develop and maintain Scala-based applications and services for data processing and analysis. Design and implement efficient and scalable Spark jobs for large-scale data processing tasks. Collaborate with cross-functional teams to integrate data pipelines with Google Big Query for backend connectivity. Optimize and tune Spark jobs for...

  • HCLTech | Scala Developer | bangalore

    6 days ago

    bangalore, India HCLTech Full time

    Responsibilities: Develop and maintain Scala-based applications and services for data processing and analysis.Design and implement efficient and scalable Spark jobs for large-scale data processing tasks.Collaborate with cross-functional teams to integrate data pipelines with Google Big Query for backend connectivity.Optimize and tune Spark jobs for...

  • Tata Consultancy Services | Spark Scala Developer | bangalore

    6 days ago

    bangalore, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 5-8 yearsLocation: Chennai, Bangalore, Kochi, BBSR & PuneMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at...

  • Bangalore Electronics | Network Engineer | bangalore

    4 weeks ago

    bangalore, India Bangalore Electronics Full time

    Company Description Distributors & System Integrator at Bangalore Electronics specialize in Electronics Components, Video Surveillance, Video Intercoms, Access Control Systems, Active & Passive Networking, and Data Centre Infrastructure. The company is located in Bengaluru, India, and offers diverse electronic solutions to cater to various industries and...

  • Quess IT Staffing | Scala Developer | bangalore

    2 weeks ago

    bangalore, India Quess IT Staffing Full time

    Company Name:- Quess IT Staffing Job Title- Scala Experience : 3+ Years Primary Skills: Scala with Akka Microservices Development Secondary Skills: Java, Kafka, PostgreSQL Good to have Skills: Azure Cloud, Kubernetes, Grafana Location : Bangalore/ Hyderabad( Hybrid) Notice Period:- Immediate to 15 Days

  • Spark/Scala Developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Role- Spark/Scala DeveloperRequired Technical Skill Set- Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQLDesired Experience Range- 5 to 12 yearsLocation of Requirement - Chennai, Bangalore, Gurgaon, Noida, PuneDesired Competencies (Technical/Behavioral Competency)Must-HaveGood work experience on Big Data Platforms like Hadoop,...

  • Quess IT Staffing | Scala Developer | bangalore

    2 weeks ago

    bangalore, India Quess IT Staffing Full time

    Company Name:- Quess IT StaffingJob Title- ScalaExperience : 3+ YearsPrimary Skills: Scala with Akka Microservices DevelopmentSecondary Skills: Java, Kafka, PostgreSQLGood to have Skills: Azure Cloud, Kubernetes, GrafanaLocation : Bangalore/ Hyderabad( Hybrid)Notice Period:- Immediate to 15 Days

  • Spark/Scala Developer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Role- Spark/Scala Developer Required Technical Skill Set- Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQL Desired Experience Range- 5 to 12 years Location of Requirement - Chennai, Bangalore, Gurgaon, Noida, Pune Desired Competencies (Technical/Behavioral Competency) Must-Have - Good work experience on Big Data Platforms...

  • Spark/Scala Developer

    3 months ago

    bangalore, India Tata Consultancy Services Full time

    Role- Spark/Scala Developer Required Technical Skill Set- Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQL Desired Experience Range- 5 to 12 years Location of Requirement - Chennai, Bangalore, Gurgaon, Noida, Pune Desired Competencies (Technical/Behavioral Competency) Must-Have Good work experience on Big Data Platforms like...

  • Spark/scala developer

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Role- Spark/Scala Developer Required Technical Skill Set- Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQL Desired Experience Range- 5 to 12 years Location of Requirement - Chennai, Bangalore, Gurgaon, Noida, Pune Desired Competencies (Technical/Behavioral Competency) Must-Have Good work experience on Big Data Platforms like...

  • Tatras Data | Data Analyst

    3 days ago

    bangalore, India Tatras Data Full time

    Tatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple data analysts. Location: Bangalore/Hyderabad (Hybrid – 3 days in office) Experience Required: 3+ relevant years of experience Educational Qualification: B.Tech, B.Sc., or Software Engineering Key Skills and Requirements: ● Programming Expertise:...

  • Tatras Data | Data Analyst

    3 days ago

    bangalore, India Tatras Data Full time

    Tatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple dataanalysts.Location: Bangalore/Hyderabad (Hybrid – 3 days in office)Experience Required: 3+ relevant years of experienceEducational Qualification: B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements:● Programming Expertise: Strong...