
Pyspark Lead
2 days ago
Position Overview
We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.
Required Skills and Qualifications
- Experience: 7+ years of professional experience in PySpark development.
- Technical Skills:
- Strong proficiency in PySpark
- Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
- Proven experience in building and optimizing complex ETL pipeline using PySpark
Experience with various spark components
Expertise in Spark Batch for large-scale data processing and analytics.
- Experience with Spark Streaming for real-time data processing and streaming pipelines.
- Familiarity with distributed computing concepts and big data frameworks.
Mandatory Skills: PySpark.Experience: 5-8 Years.
-
Pune, Maharashtra, India Exusia Full timeSr Data Engineers Tech Leads - Python Pyspark DatabricksDepartment Sales and Delivery Team - EmpowerIndustry Information Technology Services Computer Software Management ConsultingLocation WFH India RemoteExperience Range 6 - 10 yearsBasic Qualification Bachelor of Engineering or EquivalentTravel Requirements Not requiredWebsite Exusia a...
-
Python Developer Lead
7 days ago
Pune, Maharashtra, India Spectrum Talent Management Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a seasoned Lead Data Python Engineer to lead the design and development of scalable data applications and pipelines. You will leverage Python with Django or Flask frameworks, cloud technologies (GCP or AWS), Redis caching, SQL databases, and big data processing using PySpark to drive our data infrastructure and products forward.Key...
-
Technology Lead
2 weeks ago
Pune, Maharashtra, India Bitwise Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearTechnology Lead ETL & Data Engineering (Fandango)Location: Pune / HybridExperience: 10 to 15 YearsEmployment Type: Full-TimeJob SummaryWe are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data...
-
Lead Backend Developer
3 weeks ago
Pune, Maharashtra, India Alphanext Technology Solutions Full timeDjango Backend Lead DeveloperLocation : Pune / IndoreExperience : 8+ Years Employment Type : Full-Time | Overview :Join us as a Django Backend Lead Developer where you'll architect scalable and secure backend systems, drive big data solutions using Azure Databricks, and lead a team of passionate engineers. This role blends leadership, deep technical...
-
Lead Data Engineer –Azure
7 hours ago
Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per yearUrgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...
-
Lead Python Engineer
4 weeks ago
Pune, Maharashtra, India 91HR Full timeJob Description :We are seeking a highly skilled and experienced Python Lead to join our team. The ideal candidate will have strong expertise in Python coding and development, along with good-to-have skills in cloud technologies, SQL, and data analysis.Key Responsibilities :- Lead the development of high-quality, scalable, and robust Python applications.-...
-
Databricks Lead
4 hours ago
Pune, Maharashtra, India Bitwise Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearBitwise id hiring for Expert Databricks Engineer for Pune Location.PFB JD for your reference. Relevant candidate please share resume on Email ID- Noted - We are looking for candidate who can join in 30 Days Only.Mandatory skills needed:1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development2) Experience using...
-
lead data Engineer
2 weeks ago
Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe're Hiring: Lead Data Engineer (FTE)Location:Pune / CoimbatoreExperience:5 to 12 yearsBudget:As per experienceNotice Period:Immediate joiners onlyWe're looking for aLead Data Engineerwith strong technical and leadership skills to join our growing team.Key Skills:PythonPySparkAWSDatabricksJava platform experience (desirable)Proven leadership and team...
-
Tech Lead
3 weeks ago
Pune, Maharashtra, India Next Pathway Full timeNextpathway | The Automated Cloud Migration Company Next Pathway is a technology services company providing clients a pathway from existing to emerging technologies. Our automation technology helps our customers accelerate the migration of complex applications and workloads to the cloud. About the Role: Next Pathway is seeking an experienced and...
-
Technical Lead
4 weeks ago
Pune, Maharashtra, India Impetus Full timePosition Summary: We are looking for candidates with hands on experience in Big Data or Cloud Technologies. Qualifications: 7 to 10 Years of experience Expertise and hands-on experience on Spark Data Frame, and Hadoop echo system components – Must Have Good and hand-on experience* of any of the Cloud (AWS/Azure/GCP) – Must Have Good knowledge of PySpark...