Senior Data Engineer

2 months ago

Noida, India Celebal Technologies Full time

Description:

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing performance on Databricks Spark, and orchestrating workflows using various tools.


Key Responsibilities:

• Data engineering and analytics project delivery experience – Min. 2+ years

• Min. 2 project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)

• Hands on with Advanced SQL and Pyspark and/or Scala Spark

• Min 3 project done in past on Databricks where performance optimization activity was done

• Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache Spark.

• Implement and optimize performance on Databricks Spark, ensuring efficient data processing and management.

• Develop and validate data formulation and data delivery for Big Data projects.

• Collaborate with cross-functional teams to define, design, and implement data solutions that meet business requirements.

• Conduct performance tuning and optimization of complex queries and data models.

• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, and/or AWS Glue.

• Maintain and ensure data security, quality, and governance throughout the data lifecycle.


Technical Skills:

• Extensive experience with PySpark and Scala-Spark.

• Advanced SQL skills for complex data manipulation and querying.

• Proven experience in performance optimization on Databricks Spark across at least three projects.

• Hands-on experience with data formulation and data delivery validation in Big Data projects.

• Experience in data orchestration using at least two of the following: Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, AWS Glue.


Preferred Qualifications:

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

• Familiarity with data governance and data security best practices.

• Experience with other Big Data technologies and frameworks is a plus.

  • Senior Java Software Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job OverviewNTT DATA Services is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We have an exciting opportunity for a Senior Java Software Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).About the...

  • Senior Data Migration Expert

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Senior Data Migration ExpertEstimated Salary: $120,000 - $180,000 per yearAt NTT DATA, we are seeking an experienced Data Migration Expert to join our team. This is a fantastic opportunity to work with cutting-edge technologies and innovative solutions in a collaborative environment.About the Role:We're looking for a skilled professional who can...

  • Senior Data Engineer

    4 weeks ago

    Noida, India Coforge Full time

    Role: Senior Data EngineerSkills: ADF, Databricks, and Spark Streaming DeveloperExperience:5-8+ YearsLocation: Noida, Gurugram,Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.Implement real-time data processing solutions using Spark Streaming.Collaborate with data engineers, data scientists, and...

  • Senior Data Engineer Position

    2 weeks ago

    Noida, Uttar Pradesh, India Ztek Consulting Full time

    Hi,We are seeking an experienced Senior Data Engineer to join our team at Ztek Consulting Inc.Type of Hire : Full timeMode of interview : WebEx / TeamsJob Title :Senior Data Engineer PositionZtek Consulting is a leading provider of innovative data solutions, and we are looking for a talented individual to help us drive business growth through data...

  • Senior data engineer

    2 months ago

    Noida, India Celebal Technologies Full time

    Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, Py Spark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing...

  • Senior Data Engineer

    3 weeks ago

    Noida, India Coforge Full time

    Role: Senior Data EngineerSkills: ADF, Databricks, and Spark Streaming DeveloperExperience: 5-8+ YearsLocation: Noida, Gurugram, Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.Implement real-time data processing solutions using Spark Streaming.Collaborate with data engineers, data scientists, and...

  • Senior Data Engineer

    4 weeks ago

    Noida, India Coforge Full time

    Role: Senior Data EngineerSkills: ADF, Databricks, and Spark Streaming DeveloperExperience: 5-8+ YearsLocation: Noida, Gurugram, Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.Implement real-time data processing solutions using Spark Streaming.Collaborate with data engineers, data scientists, and...

  • Senior Data Engineer

    4 weeks ago

    Noida, India Coforge Full time

    Role: Senior Data Engineer Skills: ADF, Databricks, and Spark Streaming Developer Experience: 5-8+ Years Location: Noida, Gurugram, Responsibilities: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks. Implement real-time data processing solutions using Spark Streaming. Collaborate with data engineers, data...

  • Senior Data Engineer

    2 months ago

    noida, India Celebal Technologies Full time

    Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing...

  • Senior Data Engineer

    2 months ago

    Noida, India Celebal Technologies Full time

    Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing...

  • Senior Data Engineer

    2 months ago

    noida, India Celebal Technologies Full time

    Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing...

  • Senior Data Engineer

    2 months ago

    Noida, India Celebal Technologies Full time

    Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing...

  • Senior Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Freelance Full time

    Job Title: Senior Data Engineer - Big DataAbout Us: As a captive IT office of the US parent group, Care Connectors Medical Group, we are looking for a skilled PySpark developer to join our team. Located in Noida, Sec 62, at the Stellar IT Park, this role offers the opportunity to work from an office environment.Estimated Salary: ₹1,200,000 - ₹2,400,000...

  • Senior Data Engineer

    7 months ago

    Noida, India RateGain Full time

    About the Organization: RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel properties globally by providing 240 billion rate and availability updates & powering...

  • Senior Data Engineer

    1 week ago

    Noida, India InfoStride Full time

    As a Senior Data Engineer , you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with solution...

  • Senior Data Engineer

    1 week ago

    Noida, India InfoStride Full time

    As aSenior Data Engineer , you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with solution...

  • Senior Data Engineer

    1 week ago

    Noida, India InfoStride Full time

    As a Senior Data Engineer , you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with solution...

  • Senior Data Engineer

    1 week ago

    Noida, India InfoStride Full time

    As a Senior Data Engineer, you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with solution...

  • Senior Data Engineer

    23 hours ago

    Noida, India InfoStride Full time

    As a Senior Data Engineer, you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with solution...

  • Senior Cloud Data Engineer

    1 month ago

    Noida, Uttar Pradesh, India Genpact Full time

    Job Title: Senior Cloud Data EngineerGenpact is seeking a highly skilled Senior Cloud Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms like AWS or Azure.About the JobThis full-time position is based in India-Noida and requires a Bachelor's degree in a...