Capco - Senior Data Engineer - Spark/Scala

7 days ago


Hyderabad, Telangana, India Capco Technologies Pvt Ltd Full time

Job Title : Senior Data Engineer

Experience : 7+ years of experience only

Location : Pune/Hyderabad (Hybrid)

Notice Period : Immediate to 30 Days

Must Haves :

Data Engineering :


- Hands-on experience with Spark, Scala, Hadoop, and scheduling services like Apache Airflow.

DevOps :


- Practical experience or understanding of DevOps practices related to Jenkins CI/CD.

Microservices :


- Hands-on experience in building microservices using Java/SpringBoot stack.

Software Development :


- Expertise in software development with a focus on promoting development standards, conducting code reviews, mentoring, and fostering knowledge sharing within the team.

Good to have skills:

Cloud Experience :


- Experience working with cloud applications and infrastructure.

Python :


- Proficiency in Python and familiarity with applications/services built using Python.

Responsibilities :

- Design, develop, and maintain scalable data pipelines and workflows using Spark, Scala, and other relevant technologies.

- Implement and manage data integration processes, ensuring data availability, reliability, and accessibility.

- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.

- Utilize DevOps principles to automate processes, deploy applications, and manage infrastructure efficiently.

- Build and maintain microservices using Java and SpringBoot, ensuring robustness, scalability, and performance.

- Establish and promote best practices in software development, including code quality, testing, and documentation.

- Conduct code reviews, provide technical guidance, and mentor junior team members.

- Stay updated with industry trends and technologies, continuously improving skills and knowledge.

Requirements :

- 7+ years of experience in data engineering roles, with a strong focus on Spark, Scala, and Hadoop.

- Proven experience with scheduling services like Apache Airflow for orchestrating data workflows.

- Solid understanding of DevOps practices, particularly in CI/CD pipelines using Jenkins.

- Hands-on experience in designing and building microservices using Java and SpringBoot.

- Expertise in software development with a commitment to promoting development standards and conducting code reviews.

- Familiarity with cloud platforms and infrastructure, enhancing data engineering capabilities.

- Proficiency in Python is a plus, along with experience in developing Python-based applications and services

(ref:hirist.tech)

  • Hyderabad, Telangana, India REVRR TECHNOLOGIES PRIVATE LIMITED Full time

    Company : Revrr TechnologiesEmployment Type : Full-TimeRole : Software Development EngineerPosition : Developer, Senior Developer, and Lead DeveloperProject : Maps and Advertising Platforms ProductExperience: SrSDE:4-8 YearsKey Skills : Spark Core/Streaming with Any programming language Scala/ Java/ Python, Good Understanding of Data Structures, Algorithms,...


  • Hyderabad, Telangana, India LTIMindtree Full time

    Primary Skill – Scala Spark Total Exp – 5.2 Years to 13 Years Notice Period – ONLY 0 to 60 Days Joiners Job Location – Pune, Mumbai, Chennai, Hyderabad, Bangalore, Kolkata, Coimbatore, Delhi Job Description:Job Description: JD: Spark + scala Tech Lead Job Description We are looking for a Spark Scala Tech Lead with 5+ Years experience who knows how to...

  • Software Engineer

    4 weeks ago


    Hyderabad, Telangana, India Whitefield Careers Full time

    Notice Period : Max 30 daysWe are searching for a talented Software Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing applications using Scala and Spark. You will work closely with data scientists and engineers to develop solutions that transform raw data into...

  • Software Engineer

    4 weeks ago


    Hyderabad, Telangana, India Whitefield Careers Full time

    Notice Period : Max 30 daysWe are searching for a talented Software Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing applications using Scala and Spark. You will work closely with data scientists and engineers to develop solutions that transform raw data into...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Capco Full time

    Data EngineerExperience ; 7+ years of experience onlyLocation : Pune/Hyderabad (Hybrid)Notice Period : Immediate to 30 DaysMust Haves:Hands-on experience with Data Engineering (Spark, Scala, Hadoop and scheduling services like Apache Airflow).Hands on experience or understanding on DevOps related to Jenkins CI/CD.Hands on experience in building microservices...

  • Spark Scala Engineer

    2 weeks ago


    Hyderabad, Telangana, India NucleusTeq Full time

    We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for:Experience- 5+ YrsLocationHyderabad & IndoreResponsibilities:Implementing the large scale Spark applications and finetune at runtimeDesign and implement high volume and cardinality data using IcebergImplement and optimize pipelines using AirflowExperience...


  • Hyderabad, Telangana, India Brillius Full time

    Role name:Data Engineer with ScalaRole Description:Data Engineer with Scala Exceptional skills in Scala and Spark Hands on experience with data processing technologies, ETL processes and feature engineering A track record of developing scalable pipelines and delivering data promptly in a collaborative team environmentAdditional Nice to Haves: Experience...

  • Spark Scala Engineer

    2 weeks ago


    Hyderabad, Telangana, India NucleusTeq Full time

    We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for: Experience- 5+ Yrs Location- Hyderabad & Indore Responsibilities:Implementing the large scale Spark applications and finetune at runtimeDesign and implement high volume and cardinality data using IcebergImplement and optimize pipelines using...

  • Scala/Spark Developer

    2 weeks ago


    Hyderabad, Telangana, India Matrix Global Full time

    Job Summary We want to hire a hands-on senior developer responsible for designing and delivering technology solutions for transaction monitoring, customer activity review, screening, risk ranking, and optimization of scenarios. The candidate will collaborate with senior stakeholders and architecture teams to define and influence the strategy for our...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India programming.com Full time

    Job Description :Role Overview :As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity, accessibility, and usability. Your expertise in SQL, Python or Scala, Spark, Hadoop,...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India programming.com Full time

    Job Description :Role Overview :As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity, accessibility, and usability. Your expertise in SQL, Python or Scala, Spark, Hadoop,...

  • Hadoop Developer

    2 months ago


    Hyderabad, Telangana, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...


  • Hyderabad, Telangana, India Telstra Full time

    Employment Type Permanent Closing Date 30 Dec :59pm Job Title Data Engineering Senior Specialist - Python & Pyspark Job Summary As a Data Platform Engineer Senior Specialist, you bridge the hardware-software boundary. You create, optimise and maintain data storages and platforms so that our users can access high quality and reliable data assets and...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Warner Bros. Discovery Full time

    Role : Senior Data Engineer 5+ Years, Description :What You Will Do : - Design and develop the data platform to efficiently and cost effectively address various data needs across the business.- Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Warner Bros. Discovery Full time

    Role : Senior Data Engineer 5+ Years, Description :What You Will Do : - Design and develop the data platform to efficiently and cost effectively address various data needs across the business.- Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration...

  • Scala Developer

    1 month ago


    Hyderabad, Telangana, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Scala Developer

    4 weeks ago


    Hyderabad, Telangana, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Scala Developer

    2 weeks ago


    Hyderabad, Telangana, India Trinity Infotech INC Full time

    Job Description : 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...


  • Hyderabad, Telangana, India Selsoft Full time

    Role : Java Spark DeveloperLocation : HyderabadJob Description :Skill : Spark Java Developer-Java, AWS, GCP development, Spark- Proficient in Apache Spark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for...

  • Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Promaynaov Advisory Services Pvt Ltd Full time

    Role : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process Software design, Scala & Spark development,...