See more Collapse

Data Engineer

1 month ago

noida, India Coforge Full time

Job Description

Position: Data Engineer (6-8 Years)

Location: Gr. Noida

Duration: Full Time

MUST HAVE SKILLS:

1: Azure DataBricks (ADB)

2: Python

3: Pyspark

4: ETL and SQL Queries

JOB RESPONSIBILITIES:

Design, develop, and implement data pipelines using Azure Databricks and Python for data ingestion, transformation, and loading (ETL). Utilize Spark for large-scale data processing and manipulation. Write clean, maintainable, and well-documented SQL queries to extract, transform, and load data. Design and implement data quality checks and ensure data integrity throughout the pipeline. Monitor and troubleshoot data pipelines to identify and resolve issues promptly. Stay up to date with the latest advancements in Azure Databricks, Spark, and data engineering best practices.

QUALIFICATIONS:

Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent experience). Minimum of 6 years of experience in data engineering Strong proficiency in Python and experience with Apache Spark. Expertise in writing complex SQL queries for data manipulation and analysis. Integration experience of API based sources Excellent problem-solving, analytical, and debugging skills. Strong communication and collaboration skills. Posted On

Position: Data Engineer (6-8 Years)

Location: Gr. Noida

Duration: Full Time

 

MUST HAVE SKILLS:

1: Azure DataBricks (ADB)

2: Python

3: Pyspark

4: ETL and SQL Queries

 

JOB RESPONSIBILITIES:

  • Design, develop, and implement data pipelines using Azure Databricks and Python for data ingestion, transformation, and loading (ETL).
  • Utilize Spark for large-scale data processing and manipulation.
  • Write clean, maintainable, and well-documented SQL queries to extract, transform, and load data.
  • Design and implement data quality checks and ensure data integrity throughout the pipeline.
  • Monitor and troubleshoot data pipelines to identify and resolve issues promptly.
  • Stay up to date with the latest advancements in Azure Databricks, Spark, and data engineering best practices.

 

QUALIFICATIONS:

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent experience).
  • Minimum of 6 years of experience in data engineering Strong proficiency in Python and experience with Apache Spark.
  • Expertise in writing complex SQL queries for data manipulation and analysis.
  • Integration experience of API based sources Excellent problem-solving, analytical, and debugging skills.
  • Strong communication and collaboration skills.
Skills Required

PYTHON

Posted On PYTHON Location

Greater Noida

Posted On Greater Noida Desirable Skills

AZURE DATA BRICKS

Posted On AZURE DATA BRICKS

We have other current jobs related to this field that you can find below

  • Data Cloud

    1 month ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Cloud / Airflow Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)."Requirements : • Must...

  • Data Cloud

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Cloud / Airflow Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)."Requirements : • Must...

  • Data Cloud

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Cloud / Airflow Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)."Requirements : • Must...

  • Digital Engineering Staff Engineer

    2 weeks ago

    noida, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. An all-rounder in terms of technical skills with a focus on good experience of Cloud Services (Azure) We are currently seeking a Sr...

  • Digital Engineering Staff Engineer

    5 days ago

    Noida, India NTT DATA Full time

    Job DescriptionNTT DATA Services strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. An all-rounder in terms of technical skills with a focus on good experience of Cloud Services (Azure)We are currently seeking a Sr Azure...

  • Lead Data Engineer

    4 days ago

    Noida, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred*We are hiring for a UK based clientExperience: 6 to 10 yearsLocation: Noida (Hybrid)Your main duties & responsibilities:Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics.Input into High level design and responsibility for low level...

  • Lead Data Engineer

    4 days ago

    Noida, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred*We are hiring for a UK based clientExperience: 6 to 10 yearsLocation: Noida (Hybrid)Your main duties & responsibilities:Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics.Input into High level design and responsibility for low level...

  • Network Engineering Advisor

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Engineer...

  • Network Security Engineer

    2 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 273031 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Security Engineer to join our team in remote, Uttar Pradesh (IN-UP), India (IN).1....

  • Network Security Engineer

    2 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  273031  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Security Engineer to join our team in remote, Uttar Pradesh (IN-UP), India...

  • Digital Engineering Staff Engineer

    4 days ago

    noida, India NTT DATA Services Full time

    Req ID:  268061  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Job...

  • Digital Engineering Staff Engineer

    4 days ago

    Noida, India NTT DATA Services Full time

    Req ID: 268061  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Digital Engineering Staff Engineer

    4 days ago

    Noida, India NTT DATA Services Full time

    Req ID: 268061 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Job...

  • Sr Cloud Engineer Advisor

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Description: We are looking for a talented Sr Cloud Engineer Advisor - GCP to join our team in Noida, Uttar Pradesh, India. If you are enthusiastic about cloud computing and want to work with cutting-edge technologies, this might be the perfect opportunity for you. Key Responsibilities: Solid knowledge of cloud computing, networking, and storage...

  • Network Engineering Advisor

    1 month ago

    noida, India NTT DATA Full time

    Job Description Req ID:  281874  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Advisor

    1 month ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282401 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Advisor

    1 month ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 281874 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Advisor

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Network DC...

  • Network Engineering Advisor

    4 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282401 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Advisor

    4 weeks ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282401  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India...