Spark Data Engineer

1 day ago

Bengaluru Hyderabad Pune, India KPI Partners Full time US$ 80,000 - US$ 1,50,000 per year

KPI Partners is a leading provider of analytics and data solutions that help businesses leverage their data for strategic decision-making. We are committed to delivering innovative solutions and exceptional service to our clients.

Job Summary:

We are seeking a skilled Spark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, particularly Apache Spark, and will be responsible for designing, developing, and maintaining data processing frameworks to support our analytics initiatives.

Key Responsibilities:

- Design and implement data processing solutions using Apache Spark for large-scale data processing tasks.

- Optimize data pipelines for performance and efficiency.

- Collaborate with data architects and analysts to understand data requirements and ensure data quality.

- Develop and maintain ETL processes for data ingestion from various sources.

- Monitor and troubleshoot data processing jobs to ensure timely delivery of data.

- Participate in code reviews and contribute to best practices in data engineering.

- Document processes, workflows, and technical specifications.

- Stay up-to-date with emerging technologies and industry trends in big data and data engineering.

Qualifications:

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience as a Data Engineer or in a similar role, with expertise in Apache Spark.

- Proficiency in programming languages such as Java, Scala, or Python.

- Experience with big data technologies such as Hadoop, Hive, or Kafka is a plus.

- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud is desirable.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

Why Join KPI Partners?

At KPI Partners, we value innovation, teamwork, and professional growth. You will have the opportunity to work with cutting-edge technologies and be part of a collaborative environment that fosters creativity and learning. We offer competitive compensation and benefits, along with opportunities for career advancement.

If you are passionate about data engineering and looking to make an impact in a thriving organization, we encourage you to apply

  • Data Engineer – Scala + Spark

    2 weeks ago

    Bengaluru, Karnataka, India Axheleon IT Services Private Limited Full time

    Job DescriptionJob Title: Data Engineer Scala + SparkLocation: Bangalore (Hybrid/On-site)Experience: 5 to 8 Years (Minimum 4 Years of Relevant Experience in Scala & Spark)Budget: Up to 25 LPANotice Period: Immediate to 30 Days MaxAbout the Role:We are looking for a skilled and experienced Data Engineer with strong expertise in Scala, Apache Spark, and SQL to...

  • Senior Data Engineer

    3 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Engineer

    7 hours ago

    Hyderabad, India MANOJAVAM TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title : Data Engineer Scala with Play OR SparkLocation : HyderabadExperience : 4 to 7 YearsEmployment Type : Full-TimeAbout the Role :We are looking for an exceptional Backend Engineer who thrives in solving complex challenges and building scalable, distributed, and high-performance systems. If you are passionate about functional programming,...

  • Data Engineer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer ( Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.Big Data Hadoop - Hive and Spark/Scala solid experienceSQL advance knowledge - Been able to test changes and...

  • Data engineer

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.Big Data Hadoop - Hive and Spark/Scala solid experienceSQL advance knowledge - Been able to test changes and...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Varite Full time

    About The Job : - Develops technical tools and programming to cleanse, organize and transform data and to maintain, protect and update data structures and integrity on an automated basis.- Applies data extraction, transformation, and loading techniques in order to tie together large data sets from a variety of sources.- Partners with both internal & external...

  • SPARK Data Onboarding Engineer

    4 weeks ago

    Pune, Maharashtra, India PHOTON Full time

    Job DescriptionWe are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate...

  • Big Data Engineer

    7 days ago

    Pune, India Leinex Consulting Full time

    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders- Design, develop, and maintain highly scalable data processing applications- Write efficient, reusable and well documented code- Deliver big data projects using Spark, Scala , Python, SQL- Maintain and tune existing Spark...

  • Data Engineer

    7 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and...

  • Data Engineer

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and...