Senior Data Engineer

3 weeks ago


Noida, India Celebal Technologies Full time

Description:

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing performance on Databricks Spark, and orchestrating workflows using various tools.


Key Responsibilities:

• Data engineering and analytics project delivery experience – Min. 2+ years

• Min. 2 project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)

• Hands on with Advanced SQL and Pyspark and/or Scala Spark

• Min 3 project done in past on Databricks where performance optimization activity was done

• Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache Spark.

• Implement and optimize performance on Databricks Spark, ensuring efficient data processing and management.

• Develop and validate data formulation and data delivery for Big Data projects.

• Collaborate with cross-functional teams to define, design, and implement data solutions that meet business requirements.

• Conduct performance tuning and optimization of complex queries and data models.

• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, and/or AWS Glue.

• Maintain and ensure data security, quality, and governance throughout the data lifecycle.


Technical Skills:

• Extensive experience with PySpark and Scala-Spark.

• Advanced SQL skills for complex data manipulation and querying.

• Proven experience in performance optimization on Databricks Spark across at least three projects.

• Hands-on experience with data formulation and data delivery validation in Big Data projects.

• Experience in data orchestration using at least two of the following: Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, AWS Glue.


Preferred Qualifications:

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

• Familiarity with data governance and data security best practices.

• Experience with other Big Data technologies and frameworks is a plus.



  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Senior Desktop Engineering ProfessionalJob Summary:We are seeking a highly skilled Senior Desktop Engineering Professional to join our team at NTT DATA. The ideal candidate will have extensive experience in desktop engineering, SCCM, and Intune operations.Key Responsibilities:Technical engineer supporting EPM desktop engineering SCCM/Intune...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Summary:We are seeking a skilled Senior Network Engineer to join our team at NTT DATA Services. This role is responsible for managing critical network projects, identifying and resolving problems of moderate scope and complexity. The successful candidate will have a deep understanding of network administration, advanced knowledge of network performance,...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: DevOps Senior Software EngineerJob Summary: We are seeking a skilled DevOps Senior Software Engineer to join our team.Responsibilities:Design and implement build pipelines in Bamboo and Gitlab.Troubleshoot build and deployment failures.Manage releases and ensure smooth deployment.Collaborate with the DevOps team to improve processes.Communicate...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior Desktop Engineering SpecialistWe are seeking a Senior Desktop Engineering Specialist to support our EPM Desktop Engineering SCCM/Intune operations. The ideal candidate will have 5+ years of relevant experience and a strong understanding of deployment of security patches, applications, and settings using SCCM Configuration Manager.Key...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior DevOps EngineerWe are seeking a Senior DevOps Engineer to lead and manage cloud migration projects from on-premise to cloud environments, focusing on Azure.Key Responsibilities:Design and implement DevOps processes and frameworks tailored to client business needs, ensuring alignment with customer objectives.Develop and maintain...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior Desktop Engineering SpecialistJob Summary:We are seeking a highly skilled Senior Desktop Engineering Specialist to join our team at NTT DATA Services. The ideal candidate will have a strong background in desktop engineering, with expertise in SCCM/Intune operations, technical engineering, and deployment of security patches, applications,...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    About the RoleWe are seeking a Senior Desktop Engineering Specialist to join our Noida, Uttar Pradesh team.The ideal candidate will have 5+ years of experience in EPM Desktop Engineering SCCM/Intune operations and a strong understanding of configuration management principles and best practices.Key responsibilities include technical engineering support,...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    About the RoleWe are seeking a Senior Network Architect to join our team at NTT DATA. This is a challenging role that requires a deep understanding of network administration and a strong working knowledge of NTT DATA's business needs.Key ResponsibilitiesCreates and shares roadmap and technical support to determine network business needs throughout the...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job DescriptionReq ID: 301082NTT DATA seeks a talented individual to fill the role of Senior Desktop Engineering SCCM Specialist.As a key member of our team, you will be responsible for supporting EPM Desktop Engineering SCCM/Intune operations, ensuring the smooth deployment of security patches, applications, and settings utilizing SCCM Configuration...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    About the RoleNTT DATA is seeking an experienced Senior Desktop Engineer to join our team in Noida, India. This role will be responsible for leading the implementation of desktop engineering solutions using SCCM/Intune.The ideal candidate will have a strong background in IT infrastructure management, with at least 5 years of experience in implementing and...


  • Noida, India NTT DATA Full time

    Job Description Req ID: 301078 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior - Desktop Engineering sccm to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).At NTT...


  • Noida, India NTT DATA Full time

    Job Description Req ID: 301082 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Desktop Engineering SCCM to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).At NTT...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    About the JobNTT DATA is seeking a skilled DevOps Senior Engineer to join our team. This is a key role that involves creating and managing build pipelines in Bamboo and Gitlab, as well as troubleshooting build and deployment failures. The ideal candidate will have experience working within a DevOps team and possess excellent communication skills to...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior Desktop Engineering SpecialistReq ID: 301078We are seeking a Senior Desktop Engineering Specialist to join our team at NTT DATA Services. This role is responsible for supporting EPM Desktop Engineering SCCM/Intune operations.The ideal candidate will have 5+ years of relevant experience or equivalent combination of education and work...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Senior Desktop Engineering SpecialistJob Summary:NTT DATA is seeking a seasoned Desktop Engineering Specialist to join our team in India. This role will focus on supporting EPM Desktop Engineering SCCM/Intune operations, requiring a strong understanding of deployment of security patches, applications, and settings utilizing SCCM Configuration...


  • Noida, India NTT DATA Full time

    Job Description Req ID: 299406 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Active Directory Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Active Directory Engineering Senior SpecialistJob OverviewNTT DATA is seeking a skilled Active Directory Engineering Senior Specialist to join our team in India. As a member of our dedicated security team, you will be responsible for supporting, troubleshooting, and upgrading Active Directory, Azure AD, and related identity technologies.About the...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior Desktop Engineering SCCM SpecialistAbout the Role:We are seeking a highly skilled Senior Desktop Engineering SCCM Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for supporting EPM Desktop Engineering SCCM/Intune operations, ensuring the smooth deployment of security patches,...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job DescriptionWe are seeking a skilled Senior Network Security Engineer to join our team at NTT DATA. This role will focus on designing and implementing secure network architectures, ensuring the highest level of security and data protection for our clients.Key ResponsibilitiesDesign and implement secure network architectures, incorporating best practices...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    Job Title: Senior DevOps EngineerJob Summary:We are seeking a highly skilled Senior DevOps Engineer to join our team at NTT DATA Services. As a Senior DevOps Engineer, you will be responsible for leading and managing cloud migration projects from on-premise to cloud environments, with a focus on Azure.Key Responsibilities:Design and implement DevOps...