Apache spark with cloud Professional

7 days ago

Bengaluru Chennai Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.

Roles and Responsibility

  • Design, develop, and implement scalable data processing pipelines using Apache Spark.
  • Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS.
  • Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake.
  • Implement data engineering tools and technologies to optimize data processing workflows.
  • Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure.
  • Participate in code reviews and contribute to improving the overall quality of the codebase.

Job Requirements

  • Strong proficiency in Python, Java, or Scala programming languages.
  • Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
  • Knowledge of cloud computing platforms including Azure, AWS, and GCP.
  • Familiarity with containerization using Docker and Kubernetes.
  • Understanding of data modeling concepts and database design principles.
  • Excellent problem-solving skills and attention to detail.
  • Skills: Pyspark, Spark SQL programming, Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault or equivalent knowledge in AWS/GCP cloud/Snowflake, Airflow scheduling, Data Engineering tools and technologies, Scripting.
  • Notice Period: 0-30 days.
  • Education: BE.B.TECH, ME.M.TECH/BCA.
  • Location: Bangalore/Hyderabad/Pune / Chennai / Coimbatore / Noida.

  • Apache Spark Professional

    2 weeks ago

    Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...

  • Apache Spark

    1 week ago

    Bengaluru/bangalore Chennai Gurgaon Hyderabad/secunderabad Pune, India ICS Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements Must have Skills : Apache Spark  Good to Have Skills :  Microsoft SQL Server,Unix to Linux Migration,Data Warehouse ETL Testing,Amazon Web Service  Job Requirements :    Key...

  • Apache scala spark

    4 days ago

    Bengaluru, Chennai, India Athena Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    email-client -MNCApache ,spark ,SCALA requirementlocation -Chennai and Bangalorenotice period - immediate joining - joining 1 decexperience -6-9 years and 9+ years- Grade B2 and B3Mandatory skill Apache Spark and Scala (Python not reqd)

  • Apache Spark

    1 week ago

    Bengaluru/bangalore Chennai Hyderabad/secunderabad Kolkata Noida, India ICS Consultancy Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Description:Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements Must Have Skills : Apache Spark  Good To Have Skills :   Job Requirements : Key Responsibilities: AStrong  experience in creating ScalaSpark jobs for data transformation and...

  • Apache Spark

    1 week ago

    Bengaluru/bangalore Gurgaon Kolkata Mumbai Pune, India ICS Consultancy Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description:Role : Application Developer  Role Description : Design, build and configure applications to meet business process and application requirements Must have Skills : Apache Spark Good To Have Skills : Python Programming Language Job Requirements :  Key Responsibilities: a Lead the team and contribute to the design and build of code / recipes...

  • Apache Spark E0

    4 weeks ago

    Bengaluru, India Teamware Solutions Full time

    Job Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...

  • Apache Spark

    4 days ago

    Bengaluru/bangalore Gurgaon Kolkata Noida Pune, India ICS Consultancy Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Description:Project Role : Application Developer  Project Role Description : Design, build and configure applications to meet business process and application requirements.  Must have Skills : Apache Spark  Good to Have Skills :  Hadoop,  Job Requirements :    Key Responsibilities :   A: Create scala/spark jobs for data transformation and...

  • Apache Spark

    2 hours ago

    Bengaluru, India Coppergate Consultancy Pvt.Ltd Full time

    Process Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size. No of Openings 3 Gender male/female About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very...

  • Apache Spark

    4 weeks ago

    Bengaluru, India Teamware Solutions Full time

    Job Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments -...

  • Data Engineer

    24 hours ago

    Bengaluru, India Wroots Global Private Limited Full time

    About the Role :We are looking for an experienced Data Engineer with strong hands-on expertise in building, optimizing, and maintaining large-scale data processing systems. The ideal candidate will have deep technical knowledge in Apache Spark, data lakehouse technologies, and streaming platforms, along with solid programming experience and exposure to...