Lead Data Engineer

2 weeks ago

Navi Mumbai, Maharashtra, India JobTravia Pvt. Ltd. Full time

Job Title Lead Data Engineer

Education Bachelor's degree in engineering (CS, IT, EXTC or equivalent)

Experience: 6-8 years

In depth understanding of spark framework and experience working

with Spark SQL and Pyspark.

Expert in Python programming language and common python libraries

Strong analytical experience with database in writing complex queries,

query optimization, debugging, user defined functions, views, indexes

etc.

Good Problem-Solving skills

Design, implement and maintain efficient data models and pipelines.

Experience working with Big-Data technologies.

Experience working with any ETL tool is good to have.

Responsibilities

Work on project to deliver/review/design pyspark, spark SQL based

data engineering analytics solution.

Write clean, efficient, reusable, testable, and scalable logic in python to

create analytical solution.

Build solutions focusing on data cleaning, data scrapping, EDA such

that data can be utilized by any BI tool.

Co-ordinate with Data Analysts/BI developers to provide clean and

processed data.

Design data processing pipelines using ETL.

Developing and delivering complex requirements to accomplish

business goals.

Work on unstructured, structured and semi-structured data and

respective databases.

Coordinate with internal engineering and development teams to

understand requirements and develop solutions.

Communicate with stakeholders to understand business logic and

providing best data engineering solution and presenting the same.

Ensure best coding practices and standards are followed.

  • Electrical Engineering Lead

    9 hours ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. # Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades and...

  • Electrical Engineering Innovation Lead

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Electrical Engineering Innovation Lead

    2 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Key Deliverables To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades...

  • Lead Data Engineer

    4 weeks ago

    Navi Mumbai, Maharashtra, India CrossTab IT Consulting Full time

    Experience: 6-8 yearsIn depth understanding of spark framework and experience working with Spark SQL and Pyspark.Expert in Python programming language and common python librariesStrong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.Good Problem-Solving skillsDesign,...

  • Lead Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India CrossTab IT Consulting Full time

    Experience: 6-8 years In depth understanding of spark framework and experience working with Spark SQL and Pyspark. Expert in Python programming language and common python libraries Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. Good Problem-Solving skills...

  • Mechanical Design Engineer

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Lead Data Engineer

    3 days ago

    Mumbai, Maharashtra, India Burns Mcdonnell Full time

    Job DescriptionWe are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a critical role in strengthening our data infrastructure, mentoring junior...

  • Mechanical Design Engineer

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Mechanical Design Engineer

    4 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Leading Data Engineer

    19 hours ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines that integrate with our cloud-based infrastructure. You will work closely with cross-functional teams to identify business requirements and develop technical solutions that meet those needs.Job Responsibilities:Design and develop...