Apache spark with cloud Professional

1 week ago


Bengaluru Chennai Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.

Roles and Responsibility

  • Design, develop, and implement scalable data processing pipelines using Apache Spark.
  • Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS.
  • Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake.
  • Implement data engineering tools and technologies to optimize data processing workflows.
  • Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure.
  • Participate in code reviews and contribute to improving the overall quality of the codebase.

Job Requirements

  • Strong proficiency in Python, Java, or Scala programming languages.
  • Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
  • Knowledge of cloud computing platforms including Azure, AWS, and GCP.
  • Familiarity with containerization using Docker and Kubernetes.
  • Understanding of data modeling concepts and database design principles.
  • Excellent problem-solving skills and attention to detail.
  • Skills: Pyspark, Spark SQL programming, Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault or equivalent knowledge in AWS/GCP cloud/Snowflake, Airflow scheduling, Data Engineering tools and technologies, Scripting.
  • Notice Period: 0-30 days.
  • Education: BE.B.TECH, ME.M.TECH/BCA.
  • Location: Bangalore/Hyderabad/Pune / Chennai / Coimbatore / Noida.


  • Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...

  • Apache Spark E0

    3 days ago


    Bengaluru, India Teamware Solutions Full time

    Job Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...

  • Apache Spark

    6 days ago


    Bengaluru, India Coppergate Consultancy Pvt.Ltd Full time

    Process Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size. No of Openings 3 Gender male/female About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very...

  • Apache Spark

    3 days ago


    Bengaluru, India Teamware Solutions Full time

    Job Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments -...

  • Spark/Scala Developer

    2 weeks ago


    Bengaluru, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...

  • Data Engineer

    1 day ago


    Bengaluru, India Ixceed Solutions Full time

    Responsibilities :- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.- Optimize Spark applications for performance and cost-efficiency within the Databricks...


  • Bengaluru, India Bharat Head Hunters Full time

    Job Title : Support Engineer Apache Spark with Druid/Trino (L1 Support)Location : Bangalore, Chennai, HyderabadExperience : 4 to 11 YearsEmployment Type : Full-time We are seeking a dedicated Support Engineer with strong experience in Apache Spark along with Druid or Trino to provide Level 1 production support in a high-performance big data environment. In...


  • Bengaluru, Karnataka, India Relanto Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position - Senior Apache Spark ExpertExperience:6 + yearsLocation:Bangalore (WFO only)Qualification:Bachelor's degree in computer science, Engineering, or a related field (preferred)Immediate joiners onlyJob DescriptionStrong knowledge of Spark architecture, able to set up, manage and admin Spark cluster with Kubernetes, Strong on Scala, build efficient ETL...

  • Sr Backline Engineer

    3 weeks ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...

  • Sr Backline Engineer

    3 weeks ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...