Lead Data Engineer

4 weeks ago


Navi Mumbai Mumbai India CrossTab IT Consulting Full time

Job Description - Experience: 6-8 years - In depth understanding of spark framework and experience working with Spark SQL and Pyspark. - Expert in Python programming language and common python libraries - Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. - Good Problem-Solving skills - Design, implement and maintain efficient data models and pipelines. - Experience working with Big-Data technologies. Experience working with any ETL tool is good to have - Responsibilities: Work on project to deliver/review/design pyspark, spark SQL based data engineering analytics solution. - Write clean, efficient, reusable, testable, and scalable logic in python to create analytical solution. - Build solutions focusing on data cleaning, data scrapping, EDA such that data can be utilized by any BI tool. - Co-ordinate with Data Analysts/BI developers to provide clean and processed data. - Design data processing pipelines using ETL. - Developing and delivering complex requirements to accomplish business goals. - Work on unstructured, structured and semi-structured data and respective databases. - Coordinate with internal engineering and development teams to understand requirements and develop solutions. - Communicate with stakeholders to understand business logic and providing best data engineering solution and presenting the same. Ensure best coding practices and standards are followed.



  • Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Mid Data Science

    4 weeks ago


    Mumbai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India...

  • Lead Data Engineer

    2 weeks ago


    Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Role Overview:The Lead Data Engineer is a senior technical leader responsible for architecting end -to -end data flow solutions and guiding the engineering team to deliver complex data projects. In this role, you will design data flow architectures that solve complex business problems, ensuring that all components (ingestion, processing, storage, and access)...


  • Navi Mumbai, Mumbai, India BDx Data Centers Full time

    Job Description Lead / Senior Manager Controls Design SME Company Overview BDx is Asia's fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth marketsincluding Indonesia, Hong Kong, Singapore, and TaiwanBDx...

  • Data Engineer

    6 days ago


    Mumbai, India NTT DATA Services Full time

    Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: · Design...


  • Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts 110+ MW of contracted capacity,...


  • Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts 110+ MW of contracted capacity,...


  • mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts 110+ MW of contracted capacity,...


  • Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW BDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts 110+ MW of contracted capacity,...


  • Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts 110+ MW of contracted capacity,...