Spark Data Engineer

1 day ago

Bengaluru Hyderabad Pune, India KPI Partners Full time US$ 80,000 - US$ 1,50,000 per year

KPI Partners is a leading provider of analytics and data solutions that help businesses leverage their data for strategic decision-making. We are committed to delivering innovative solutions and exceptional service to our clients.

Job Summary:

We are seeking a skilled Spark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, particularly Apache Spark, and will be responsible for designing, developing, and maintaining data processing frameworks to support our analytics initiatives.

Key Responsibilities:

- Design and implement data processing solutions using Apache Spark for large-scale data processing tasks.

- Optimize data pipelines for performance and efficiency.

- Collaborate with data architects and analysts to understand data requirements and ensure data quality.

- Develop and maintain ETL processes for data ingestion from various sources.

- Monitor and troubleshoot data processing jobs to ensure timely delivery of data.

- Participate in code reviews and contribute to best practices in data engineering.

- Document processes, workflows, and technical specifications.

- Stay up-to-date with emerging technologies and industry trends in big data and data engineering.

Qualifications:

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience as a Data Engineer or in a similar role, with expertise in Apache Spark.

- Proficiency in programming languages such as Java, Scala, or Python.

- Experience with big data technologies such as Hadoop, Hive, or Kafka is a plus.

- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud is desirable.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

Why Join KPI Partners?

At KPI Partners, we value innovation, teamwork, and professional growth. You will have the opportunity to work with cutting-edge technologies and be part of a collaborative environment that fosters creativity and learning. We offer competitive compensation and benefits, along with opportunities for career advancement.

If you are passionate about data engineering and looking to make an impact in a thriving organization, we encourage you to apply

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineer (Spark & PySpark)About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Python.Your primary focus will be on developing and...

  • Data engineer With Spark

    4 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client:Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation....

  • Data engineer With Spark

    2 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data engineer With Spark

    2 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Senior Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • SPARK Data Onboarding Engineer

    7 days ago

    Pune, Maharashtra, India PHOTON Full time

    Job DescriptionWe are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate...

  • Senior Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Bigdata -Pyspark /Scala Spark- Data Engineer

    1 day ago

    Pune, Maharashtra, India LTIMindtree Full time US$ 1,50,000 - US$ 2,00,000 per year

    30 days to immediate3+ expJob description:Myrefers Big Data PySpark Scala Spark Java Sparkp3PuneWe are seeking a highly skilled and experienced Big Data Engineer to join our data engineering team The ideal candidate will have a strong background in Hadoop ecosystem tools Apache Spark including SparkSQL and Python programming You will be responsible for...

  • Databricks Scala/Spark Data Engineer

    6 days ago

    Pune, Mumbai, Bengaluru / Bangalore, India beBeeDataEngineer Full time ₹ 80,000 - ₹ 2,00,000

    Job Title: Databricks Scala/Spark DeveloperJob Description: As a Databricks Scala/Spark developer, you will be responsible for designing and implementing scalable data processing systems using Spark and Scala. The ideal candidate will have strong programming skills and experience with complex objects and datasets.Required Skills:Strong knowledge of Spark and...