Lead Data Engineer
15 hours ago
Role Description
Key Responsibilities:
- Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.
- Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.
- PySpark Development: Develop and implement efficient ETL processes using PySpark to extract, transform, and load large datasets.
- Performance Optimization: Optimize PySpark applications for better performance, scalability, and resource management.
Qualifications
- Proven experience as a Big Data Engineer with a strong focus on PySpark.
- Deep understanding of Big Data processing frameworks and technologies.
- Strong proficiency in PySpark for developing and optimizing ETL processes and data transformations.
- Experience with distributed computing and parallel processing.
- Ability to collaborate in a fast-paced, innovative environment.
Skills
Big Data, Pyspark
-
Lead Data Engineer
4 days ago
Cochin, Kerala, India Careersteer services private limited Full time ₹ 10,00,000 - ₹ 23,00,000 per yearWe are seeking a highly skilled Lead Data Engineer with strong hands-on experience in AWS, Python, and PySpark. The ideal candidate will design, develop, and manage scalable data pipelines and architectures, lead a team of data engineers, and ensure data availability, reliability, and performance to support analytics, reporting, and business intelligence...
-
Lead Data Engineer
1 week ago
Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title:Lead Data EngineerLocation:Kochi / TrivandrumExperience:10+ yearsNotice Period:Immediate to 15 daysBudget:Up to ₹23 LPAPrimary SkillsCore: AWS, PythonJob OverviewSeeking an experiencedSenior/Lead Data Engineerto design and implement scalabledata ingestion frameworks, ensuredata quality and validation, and buildrobust APIsfor seamless data...
-
Lead Data Engineer
1 week ago
Cochin, Kerala, India Tothr Full time ₹ 6,00,000 - ₹ 18,00,000 per year7+ years of hands-on experience in data engineering roles 3+ years in a technical leadership position, managing data engineering Proven track record of building and maintaining BI/analytics platforms • Experience with Databricks and Delta Lake
-
Senior Data Engineer
2 weeks ago
Cochin, Kerala, India Milestone Technologies, Inc. Full timeRole Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...
-
Data Engineer
1 week ago
Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...
-
Data Engineer
2 weeks ago
Cochin, Kerala, India Pumex Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per yearWe are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions.Job Title: Data...
-
Data Engineer
1 week ago
Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 10,80,000 - ₹ 60,00,000 per yearJob Title: Data Engineer (Contract – 6 Months)Location: RemoteDuration: 6 MonthsCompensation: ₹90,000 per monthAbout the Role:We are looking for an experienced Data Engineer (4–6 years) to join on a 6-month contract. The role involves building and maintaining ETL pipelines, working with SQL Server 2019/2022 and SSIS, and integrating data from systems...
-
Senior Data Engineer
2 weeks ago
Cochin, Kerala, India Milestone Technologies Full timeCompany OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...
-
Data Team Lead
2 weeks ago
Cochin, Kerala, India IQVIA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob OverviewManage end-to-end delivery of data management services for single/multi-service projects with minimal guidance, ensuring quality deliverables on time and within budget, to customer satisfaction. Provide comprehensive data management expertise to Clinical Data Management (CDM) team to provide high quality data management products that meet...
-
Data Engineer
17 hours ago
Cochin, Kerala, India Fingent Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAt Fingent, we believe that what we build touches lives around us. We use technology to create a better and smarter environment. We nurture thought leaders and encourage them to be the seeds of change through smart software development and consulting services. Our commitment to quality and integrity helps us to use technology and create a better and smarter...