Spark and Scala Architect

4 days ago


Bengaluru, Karnataka, India LITTLE ROBIN TECHNOLOGY PARTNERS PRIVATE LIMITED Full time

About the Job

We are seeking a talented Spark and Scala Architect to join our team in Bangalore. The ideal candidate will have strong expertise in Spark, Scala, and Hive, with 4+ years of experience in designing and building scalable data pipelines.

Key Responsibilities

- Design, develop, and optimize scalable data pipelines using Spark, Scala, and Hive to process and manage large datasets.
- Implement efficient ETL workflows for extracting, transforming, and loading data from various sources into big data systems.
- Work on performance optimization, tuning, and troubleshooting of Spark jobs, ensuring high efficiency and reliability.
- Collaborate with data scientists, analysts, and other teams to understand data requirements and provide solutions that support analytics and business intelligence efforts.

Required Skills & Qualifications

- Experience: 4+ years of experience as a Data Engineer or in a similar role, with hands-on expertise in Spark, Scala, and Hive.
- Strong proficiency in Scala and Spark for distributed data processing.
- Solid experience in designing and building ETL pipelines, processing large datasets, and ensuring efficient data storage and retrieval.

Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum

Nice to Have

LITTLE ROBIN TECHNOLOGY PARTNERS PRIVATE LIMITED encourages candidates with experience in cloud platforms, messaging systems, data warehousing concepts, and containerization tools.

],
  • Data Scientist

    2 months ago


    Bengaluru, Karnataka, India Rigel networks Full time

    About the RoleWe are seeking a highly skilled Data Scientist - Big Data/Spark Scala to design, develop, and optimize data processing pipelines using Apache Spark and Scala. The ideal candidate will have a strong understanding of big data technologies and be proficient in Scala programming.Key Responsibilities• Design, develop, and maintain scalable and...

  • Big Data Engineer

    1 day ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer with expertise in Spark and Scala to join our team at Tata Consultancy Services.Job SummaryThis is a challenging opportunity for a talented engineer to design, develop, and implement big data solutions using Spark and Scala.ResponsibilitiesThe successful candidate will be responsible...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    About the RoleWe are seeking a highly skilled Data Engineering Expert to join our team. As a key member, you will be responsible for designing and developing big data platforms using Scala and Spark.Job DescriptionThe ideal candidate will have a deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and other Hadoop...


  • Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    About Talent21 Management and Shared Service Pvt LtdWe are a leading organization in the industry, seeking an experienced Principal Software Engineer to join our Epsilon Attribution/Forecasting Product Development team.Job Overview:The successful candidate will be responsible for designing, implementing, and optimizing data processing solutions using Scala,...

  • Data Architect

    1 week ago


    Bengaluru, Karnataka, India LITTLE ROBIN TECHNOLOGY PARTNERS PRIVATE LIMITED Full time

    At LITTLE ROBIN TECHNOLOGY PARTNERS PRIVATE LIMITED, we seek an experienced Data Engineer to join our team.About the Job:Develop scalable data pipelines using Spark, Scala, and Hive.Optimize performance, troubleshoot, and fine-tune Spark jobs.Ensure data integration, consistency, quality, and accuracy.Responsibilities:Collaborate with cross-functional teams...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Lifesight Technologies Pvt. Ltd. Full time

    Company Overview :Lifesight is a fast-growing SaaS company that empowers businesses to leverage data and AI for customer acquisition and retention. With a team of 130 professionals across 5 offices worldwide, we serve 300+ customers and are committed to making data-driven marketing accessible to non-technical marketers.Position Overview :We are seeking a...


  • Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    At Talent21 Management and Shared Service Pvt Ltd, we are seeking an exceptional Senior Data Architect to lead our team in designing and implementing scalable data processing solutions.We offer a competitive salary of $120,000 - $180,000 per annum, depending on experience, along with a comprehensive benefits package and opportunities for career growth.In...


  • Bengaluru, Karnataka, India Société Générale Assurances Full time

    Société Générale Assurances: A Global Leader in Insurance ServicesWe are committed to creating a diverse environment and are proud to be an equal opportunity employer.About the RoleAs a Specialist Software Engineer - SPARK, you will play a key role in shaping our software development process, driving innovation, and ensuring the delivery of high-quality...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Summary:Tata Consultancy Services is seeking a highly skilled Senior Data Engineer - Spark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable data processing systems using Apache Spark.About the Role:The ideal candidate will have a strong background in programming...

  • Senior Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India Madhees Techno Consulting Pvt. Ltd Full time

    About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at Madhees Techno Consulting Pvt. Ltd. The ideal candidate will have a strong foundation in big data engineering, Spark, Scala, and other relevant frameworks.Key ResponsibilitiesDesign, develop, and implement scalable and efficient big data solutions using Spark, Scala, and...


  • Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    Job OverviewWe are seeking an experienced Data Architect to join our Epsilon Attribution/Forecasting Product Development team at Talent21 Management and Shared Service Pvt Ltd. As a Principal Software Engineer, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.About the RoleThe ideal candidate will have strong...

  • Senior Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India IBCScorp Full time

    Job TitleSr. Data Architect at IBCScorp.An exciting opportunity has arisen for a Senior Data Architect to join our team at IBCScorp. Based in Bangalore, this role offers a unique chance to work with cutting-edge technologies and drive innovation in data-driven solutions.The ideal candidate will have a strong background in big data processing, NoSQL...


  • Bengaluru, Karnataka, India NetAnalytiks Technologies Full time

    About the Role: As a Spark Developer Lead at NetAnalytiks Technologies, you will lead a team of developers to design and implement large-scale data processing systems that drive business growth. You will be responsible for developing and maintaining high-performance data pipelines using Apache Spark and Scala.Responsibilities:Leverage expertise in big data...


  • Bengaluru, Karnataka, India Freelance Full time

    About FreelanceWe are a forward-thinking organization dedicated to providing cutting-edge data solutions. Our team is passionate about harnessing the power of big data to drive innovation and growth.Job OverviewEstimated Salary: $150,000 - $220,000 per yearThis role requires a highly skilled Data Architect to design, develop, and maintain large-scale data...


  • Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    About the RoleTalent21 Management and Shared Service Pvt Ltd is seeking an experienced Senior Software Architect to join our Epsilon Attribution/Forecasting Product Development team. As a key member of this team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.Key Responsibilities:Design, implement, and...


  • Bengaluru, Karnataka, India Talpro Full time

    Job OverviewTalpro is seeking an experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Main Responsibilities- Develop and maintain data pipelines for processing large data sets using...


  • Bengaluru, Karnataka, India ZoomInfo Full time

    Senior Data Engineer Job DescriptionZoomInfo is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Scala/Java and Spark EMR to move data into our consolidated data lake.About the RoleThis is an excellent opportunity...

  • Scala Expert

    4 weeks ago


    Bengaluru, Karnataka, India Pan Asia HR Solution Full time

    About the OpportunityWe are seeking a skilled Scala Developer to join our Service organization as a permanent team member.This role is ideal for professionals with 5+ years of software development experience, focusing on Scala and the JVM ecosystem.Key Responsibilities:Design and implement scalable applications using Scala, object-oriented, and functional...

  • Scala Developer

    1 week ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleTata Consultancy Services is seeking a highly skilled Scala Developer to join our team. As a key member of our big data processing group, you will be responsible for designing, developing, and implementing scalable data processing solutions using Scala, Spark, Hive, and MapReduce.The ideal candidate will have a strong background in big data...

  • Senior Data Architect

    2 months ago


    Bengaluru, Karnataka, India KrtrimaIQ Cognitive Solution Full time

    Job Description :We are looking for a highly skilled Data Architect with extensive experience in designing and implementing robust data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Key Responsibilities: Main Responsibilities :- Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and...