Apache spark with cloud Professional

4 days ago

Bengaluru Chennai Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.

Roles and Responsibility

  • Design, develop, and implement scalable data processing pipelines using Apache Spark.
  • Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS.
  • Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake.
  • Implement data engineering tools and technologies to optimize data processing workflows.
  • Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure.
  • Participate in code reviews and contribute to improving the overall quality of the codebase.

Job Requirements

  • Strong proficiency in Python, Java, or Scala programming languages.
  • Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
  • Knowledge of cloud computing platforms including Azure, AWS, and GCP.
  • Familiarity with containerization using Docker and Kubernetes.
  • Understanding of data modeling concepts and database design principles.
  • Excellent problem-solving skills and attention to detail.
  • Skills: Pyspark, Spark SQL programming, Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault or equivalent knowledge in AWS/GCP cloud/Snowflake, Airflow scheduling, Data Engineering tools and technologies, Scripting.
  • Notice Period: 0-30 days.
  • Education: BE.B.TECH, ME.M.TECH/BCA.
  • Location: Bangalore/Hyderabad/Pune / Chennai / Coimbatore / Noida.

  • Apache Spark Professional

    6 days ago

    Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...

  • Apache Spark

    2 days ago

    Bengaluru, Chennai, Hyderabad, India Advent Global Solutions Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    *Please read complete JD if matching only apply and #Whatsappme *Must have skills : Apache SparkGood to have skills : NAMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary: As an Application Developer, you will be involved in designing, building, and configuring applications to meet business process and...

  • Apache Spark/Trino Support Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Bharat Head Hunters Full time

    Job Title : Support Engineer Apache Spark with Druid/Trino (L1 Support)Location : Bangalore, Chennai, HyderabadExperience : 4 to 11 YearsEmployment Type : Full-time We are seeking a dedicated Support Engineer with strong experience in Apache Spark along with Druid or Trino to provide Level 1 production support in a high-performance big data environment....

  • Dataproc Lead, Spark, OSS Technologies, Cloud

    1 week ago

    Bengaluru, Karnataka, India Google Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages, and with data structures/algorithms.Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed...

  • Dataproc Lead, Spark, OSS Technologies, Cloud

    2 weeks ago

    Bengaluru, India Google Full time

    Minimum qualifications: Bachelor's degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages, and with data structures/algorithms. Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed...

  • Dataproc Lead, Spark, OSS Technologies, Cloud

    2 days ago

    Bengaluru, Karnataka, India Google Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages, and with data structures/algorithms.Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed...

  • Dataproc Lead, Spark, OSS Technologies, Google Cloud

    4 weeks ago

    Bengaluru, Karnataka, India Google Inc Full time

    Job DescriptionMinimum qualifications:- Bachelor's degree or equivalent practical experience.- 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.- Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with...

  • Data Engineer

    2 weeks ago

    Bengaluru, India IOWeb3 Technologies Full time

    Job Description :Responsibilities :- Lead the design, development, and implementation of high-performance, scalable, and resilient data pipelines for both batch and real-time (stream) data processing.- Utilize your strong expertise in Apache Spark with Python to build efficient data transformation and processing jobs.- Ensure data pipeline solutions are...

  • Spark Scala Developer

    1 week ago

    Chennai, Tamil Nadu, India Infotel UK Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....

  • Spark + Scala Professional

    4 days ago

    Chennai, Noida, Pune, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Spark and Scala to join our team. The ideal candidate will have 4 to 10 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Spark and Scala.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop...