Apache spark with cloud Professional
1 week ago
We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.
Roles and Responsibility
- Design, develop, and implement scalable data processing pipelines using Apache Spark.
- Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS.
- Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake.
- Implement data engineering tools and technologies to optimize data processing workflows.
- Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure.
- Participate in code reviews and contribute to improving the overall quality of the codebase.
Job Requirements
- Strong proficiency in Python, Java, or Scala programming languages.
- Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Knowledge of cloud computing platforms including Azure, AWS, and GCP.
- Familiarity with containerization using Docker and Kubernetes.
- Understanding of data modeling concepts and database design principles.
- Excellent problem-solving skills and attention to detail.
- Skills: Pyspark, Spark SQL programming, Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault or equivalent knowledge in AWS/GCP cloud/Snowflake, Airflow scheduling, Data Engineering tools and technologies, Scripting.
- Notice Period: 0-30 days.
- Education: BE.B.TECH, ME.M.TECH/BCA.
- Location: Bangalore/Hyderabad/Pune / Chennai / Coimbatore / Noida.
-
Apache Spark Professional
2 weeks ago
Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...
-
Apache Spark E0
3 days ago
Bengaluru, India Teamware Solutions Full timeJob Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...
-
Apache Spark
6 days ago
Bengaluru, India Coppergate Consultancy Pvt.Ltd Full timeProcess Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size. No of Openings 3 Gender male/female About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very...
-
Apache Spark
3 days ago
Bengaluru, India Teamware Solutions Full timeJob Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments -...
-
Spark/Scala Developer
2 weeks ago
Bengaluru, India HARP Technologies and Services Full timeNotice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...
-
Data Engineer
1 day ago
Bengaluru, India Ixceed Solutions Full timeResponsibilities :- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.- Optimize Spark applications for performance and cost-efficiency within the Databricks...
-
Apache Spark/Trino Support Engineer
2 weeks ago
Bengaluru, India Bharat Head Hunters Full timeJob Title : Support Engineer Apache Spark with Druid/Trino (L1 Support)Location : Bangalore, Chennai, HyderabadExperience : 4 to 11 YearsEmployment Type : Full-time We are seeking a dedicated Support Engineer with strong experience in Apache Spark along with Druid or Trino to provide Level 1 production support in a high-performance big data environment. In...
-
Senior Apache Spark Expert
2 weeks ago
Bengaluru, Karnataka, India Relanto Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition - Senior Apache Spark ExpertExperience:6 + yearsLocation:Bangalore (WFO only)Qualification:Bachelor's degree in computer science, Engineering, or a related field (preferred)Immediate joiners onlyJob DescriptionStrong knowledge of Spark architecture, able to set up, manage and admin Spark cluster with Kubernetes, Strong on Scala, build efficient ETL...
-
Sr Backline Engineer
3 weeks ago
Bengaluru, India Databricks Full timeMission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...
-
Sr Backline Engineer
3 weeks ago
Bengaluru, India Databricks Full timeMission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...