Lead Data Engineer

3 weeks ago

Mumbai, Maharashtra, India Jobtravia Pvt. Ltd. Full time

Job Title : Lead Data Engineer.

Location : Navi Mumbai / Mumbai.

Reporting To : Project Manager.

Education : Bachelor's degree in Engineering (CS, IT, EXTC, or equivalent).

Experience Required : 6-8 years.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and analytical solutions using PySpark and Spark SQL.

- Write efficient, clean, and reusable Python code for data transformation, cleaning, and processing.

- Work with structured, semi-structured, and unstructured data to deliver business-ready datasets.

- Collaborate with Data Analysts and BI Developers to ensure delivery of clean, processed, and optimized data.

- Build and manage ETL processes and data integration workflows.

- Optimize complex SQL queries, functions, views, and indexing strategies for performance.

- Perform exploratory data analysis (EDA) and support data ingestion from various sources.

- Communicate with stakeholders to gather requirements and deliver effective data engineering solutions.

- Ensure adherence to best coding practices, documentation, and version control standards.

- Coordinate with cross-functional engineering and development teams for end-to-end solution delivery.

Required Skills :

- Strong experience with Apache Spark, PySpark, and Spark SQL.

- Proficient in Python and commonly used Python libraries for data processing.

- Deep understanding of SQL, query optimization, and data modeling.

- Experience with Big Data technologies and handling large datasets.

- Familiarity with any ETL tools is a plus.

- Strong analytical thinking and problem-solving skills.

- Excellent communication and collaboration abilities.

(ref:hirist.tech)

  • Lead Data Engineer

    2 days ago

    Mumbai, Maharashtra, India Burns Mcdonnell Full time

    Job DescriptionWe are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a critical role in strengthening our data infrastructure, mentoring junior...

  • Leading Data Engineer

    5 hours ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines that integrate with our cloud-based infrastructure. You will work closely with cross-functional teams to identify business requirements and develop technical solutions that meet those needs.Job Responsibilities:Design and develop...

  • Electrical Engineering Innovation Lead

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Electrical Engineering Innovation Lead

    2 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Lead Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India JobTravia Pvt. Ltd. Full time

    Job Title Lead Data Engineer Education Bachelor's degree in engineering (CS, IT, EXTC or equivalent) Experience: 6-8 years In depth understanding of spark framework and experience working with Spark SQL and Pyspark. Expert in Python programming language and common python libraries Strong analytical experience with database in writing complex queries,...

  • Data Engineer Lead Specialist

    1 day ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

    Job Title: Data Engineer Lead SpecialistOverview of the Position:The company is seeking a highly skilled Data Engineer Lead Specialist to join its Knowledge Services team. This role will focus on driving analytics for impactful business outcomes by gathering, analyzing, and modeling data.Key Responsibilities:Collaborate with international stakeholders to...

  • Lead Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Novo Tree Minds Consulting Full time

    Job Description :- Advanced Data Pipeline Development : Develop, and optimize complex ETL/ELT processes and real-time data streaming solutions to ingest, cleanse, transform, and deliver large-scale datasets from diverse on-premise and cloud sources into data warehouses, data lakes, and analytical platforms.- Performance Engineering : Proactively identify and...

  • Data Engineering Systems Lead

    2 days ago

    Mumbai, Maharashtra, India beBeeTechnicalLead Full time ₹ 19,50,000 - ₹ 25,50,000

    Job Opportunity:This role requires a highly skilled professional to lead and implement large-scale data processing systems, ensuring seamless integration with existing infrastructure.About the Position:We are seeking an experienced technical expert to develop and implement ETL processes using T-SQL scripting and queryingThe ideal candidate will design and...

  • Lead Data Engineer

    4 weeks ago

    Navi Mumbai, Maharashtra, India CrossTab IT Consulting Full time

    Experience: 6-8 yearsIn depth understanding of spark framework and experience working with Spark SQL and Pyspark.Expert in Python programming language and common python librariesStrong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.Good Problem-Solving skillsDesign,...

  • Lead Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India CrossTab IT Consulting Full time

    Experience: 6-8 years In depth understanding of spark framework and experience working with Spark SQL and Pyspark. Expert in Python programming language and common python libraries Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. Good Problem-Solving skills...