Pyspark Lead
2 days ago
Position Overview
We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.
Required Skills and Qualifications
- Experience: 7+ years of professional experience in PySpark development.
- Technical Skills:
- Strong proficiency in PySpark
- Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
- Proven experience in building and optimizing complex ETL pipeline using PySpark
Experience with various spark components
Expertise in Spark Batch for large-scale data processing and analytics.
- Experience with Spark Streaming for real-time data processing and streaming pipelines.
- Familiarity with distributed computing concepts and big data frameworks.
Mandatory Skills: PySpark.Experience: 5-8 Years.
-
Pyspark Architect
1 week ago
Pune, Maharashtra, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...
-
pyspark developer
1 week ago
Pune, Maharashtra, India Capgemini Engineering Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
pyspark developer
1 week ago
Pune, Maharashtra, India Capgemini Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Pyspark Developer
1 week ago
Pune, Maharashtra, India Capgemini Full time ₹ 5,00,000 - ₹ 12,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Python Developer Lead
1 week ago
Pune, Maharashtra, India Spectrum Talent Management Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a seasoned Lead Data Python Engineer to lead the design and development of scalable data applications and pipelines. You will leverage Python with Django or Flask frameworks, cloud technologies (GCP or AWS), Redis caching, SQL databases, and big data processing using PySpark to drive our data infrastructure and products forward.Key...
-
Technology Lead
2 weeks ago
Pune, Maharashtra, India Bitwise Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearTechnology Lead ETL & Data Engineering (Fandango)Location: Pune / HybridExperience: 10 to 15 YearsEmployment Type: Full-TimeJob SummaryWe are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data...
-
Databricks Lead
8 hours ago
Pune, Maharashtra, India Bitwise Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearBitwise id hiring for Expert Databricks Engineer for Pune Location.PFB JD for your reference. Relevant candidate please share resume on Email ID- Noted - We are looking for candidate who can join in 30 Days Only.Mandatory skills needed:1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development2) Experience using...
-
lead data Engineer
2 weeks ago
Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe're Hiring: Lead Data Engineer (FTE)Location:Pune / CoimbatoreExperience:5 to 12 yearsBudget:As per experienceNotice Period:Immediate joiners onlyWe're looking for aLead Data Engineerwith strong technical and leadership skills to join our growing team.Key Skills:PythonPySparkAWSDatabricksJava platform experience (desirable)Proven leadership and team...
-
PySpark Hive Data Engineer
7 hours ago
Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThe RoleThe Data Engineer is accountable for developing high quality data products to support the Bank's regulatory requirements and data driven decision making. A Data Engineer will serve as an example to other team members, work closely with customers, and remove or escalate roadblocks. By applying their knowledge of data architecture standards, data...
-
Azure tech Lead
17 hours ago
Pune, Maharashtra, India Qualmission LLC Full time ₹ 20,00,000 - ₹ 25,00,000 per yearlooking for 10+ Years Azure Tech LeadExperience and Qualifications8+ years in data engineering with substantial leadership and architectural responsibilities.Proven track record creating and responding to RFPs for data-centric projects and crafting HLDs that effectively guide development.Deep expertise in the Azure stack—Data Factory, Databricks, Synapse,...