Lead Data Engineer

4 weeks ago


Navi Mumbai, Maharashtra, India CrossTab IT Consulting Full time
  • Experience: 6-8 years
  • In depth understanding of spark framework and experience working with Spark SQL and Pyspark.
  • Expert in Python programming language and common python libraries
  • Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
  • Good Problem-Solving skills
  • Design, implement and maintain efficient data models and pipelines.
  • Experience working with Big-Data technologies.

Experience working with any ETL tool is good to have

  • Responsibilities: Work on project to deliver/review/design pyspark, spark SQL based data engineering analytics solution.
  • Write clean, efficient, reusable, testable, and scalable logic in python to create analytical solution.
  • Build solutions focusing on data cleaning, data scrapping, EDA such that data can be utilized by any BI tool.
  • Co-ordinate with Data Analysts/BI developers to provide clean and processed data.
  • Design data processing pipelines using ETL.
  • Developing and delivering complex requirements to accomplish business goals.
  • Work on unstructured, structured and semi-structured data and respective databases.
  • Coordinate with internal engineering and development teams to understand requirements and develop solutions.
  • Communicate with stakeholders to understand business logic and providing best data engineering solution and presenting the same.

Ensure best coding practices and standards are followed.



  • Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...


  • Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Lead Data Engineer

    2 weeks ago


    Navi Mumbai, Maharashtra, India JobTravia Pvt. Ltd. Full time

    Job Title Lead Data Engineer Education Bachelor's degree in engineering (CS, IT, EXTC or equivalent) Experience: 6-8 years In depth understanding of spark framework and experience working with Spark SQL and Pyspark. Expert in Python programming language and common python libraries Strong analytical experience with database in writing complex queries,...


  • Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Lead Data Engineer

    2 days ago


    Mumbai, Maharashtra, India Burns Mcdonnell Full time

    Job DescriptionWe are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a critical role in strengthening our data infrastructure, mentoring junior...


  • Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...


  • Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Leading Data Engineer

    11 hours ago


    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines that integrate with our cloud-based infrastructure. You will work closely with cross-functional teams to identify business requirements and develop technical solutions that meet those needs.Job Responsibilities:Design and develop...

  • Lead Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India Jobtravia Pvt. Ltd. Full time

    Job Title : Lead Data Engineer. Location : Navi Mumbai / Mumbai. Reporting To : Project Manager. Education : Bachelor's degree in Engineering (CS, IT, EXTC, or equivalent). Experience Required : 6-8 years. Key Responsibilities : - Design, develop, and maintain scalable data pipelines and analytical solutions using PySpark and Spark SQL.- Write efficient,...


  • Navi Mumbai, Maharashtra, India beBeeDataWarehousing Full time ₹ 9,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking an experienced Data Warehousing Professional to lead our team. As a DWH Tech Lead, you will be responsible for designing and implementing data warehousing solutions.Responsibilities:Design and implement ETL processes using ODI/Informatica/Data Stage/Pentaho and other real-time replication tools like Golden Gate.Develop and...