Senior Data Engineer

2 weeks ago

Greater Noida, India Coforge Full time

Job Description

Position: Senior Data Engineer (7-10 Years)

Location: Gr. Noida

Duration: Full Time

MUST HAVE SKILLS:

1: Python

2: Spark

3: SQL

4: Azure Cloud (Databricks)

5: AI (GPT-4, OpenAI Codex)

RESPONSIBILITIES:

Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability. Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions. Optimize data pipelines for performance, scalability, and security. Document data models, schemas, and data flows.

REQUIREMENTS:

Bachelor's degree in computer science, engineering, or a related field. At least 5 years of experience in data engineering or a similar role. Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure). Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.). Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus. Strong communication, problem-solving, and analytical skills. Posted On

Position: Senior Data Engineer (7-10 Years)

Location: Gr. Noida

Duration: Full Time

 

MUST HAVE SKILLS:

1: Python

2: Spark

3: SQL

4: Azure Cloud (Databricks)

5: AI (GPT-4, OpenAI Codex)

 

RESPONSIBILITIES:

  • Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats.
  • Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
  • Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions.
  • Optimize data pipelines for performance, scalability, and security.
  • Document data models, schemas, and data flows.

 

REQUIREMENTS:

  • Bachelor's degree in computer science, engineering, or a related field.
  • At least 5 years of experience in data engineering or a similar role.
  • Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g. Azure).
  • Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
  • Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus.
  • Strong communication, problem-solving, and analytical skills.
Skills Required

PYTHON

Posted On PYTHON Location

Greater Noida

Posted On Greater Noida Desirable Skills

SQL SERVER

Posted On SQL SERVER

  • Senior Data Engineer

    1 week ago

    Greater Noida, India Publicis Sapient Full time

    Publicis Sapient Overview : We at Publicis Sapient, enable our clients to thrive in Next and to create business value through expert strategies, customer-centric experience design, and world-class product engineering.The future of business is disruptive, transformative and becoming digital to the core.In our 20 + years in IT, never before have we seen such a...

  • Data Engineer

    1 week ago

    Noida, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • Network Engineering Senior Specialist

    5 days ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282407 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Senior Specialist

    5 days ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh...

  • Network Engineering Senior Specialist

    1 day ago

    noida, India NTT DATA Full time

    Job Description Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh...

  • Network Engineering Senior Specialist

    4 days ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 282407 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Senior QA Engineer

    1 day ago

    Noida, India NTT DATA Full time

    Job Description Req ID: 283833 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Once You Are...

  • Data Engineer

    4 weeks ago

    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...

  • Data Engineer

    4 weeks ago

    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...

  • Data Engineer

    4 weeks ago

    noida, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • Senior Data Engineer

    5 days ago

    Noida, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    5 days ago

    noida, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    5 days ago

    Noida, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    5 days ago

    noida, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    5 days ago

    noida, India RateGain Full time

    About the Organization: RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel properties globally by providing 240 billion rate and availability updates & powering...

  • Senior Data Engineer

    5 days ago

    Noida, India RateGain Full time

    About the Organization: RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel properties globally by providing 240 billion rate and availability updates & powering...

  • Senior Lead Engineer

    6 hours ago

    Noida, India NTT DATA Services Full time

    Req ID: 276862 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN).Once You Are Here, You Will:...

  • Network Engineering Senior Specialist

    5 days ago

    noida, India NTT DATA Services Full time

    Req ID:  282407  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)....

  • Senior QA Engineer

    1 day ago

    noida, India NTT DATA Services Full time

    Req ID:  283833  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QA Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).   Once You Are Here, You...

  • Senior Data Engineer

    1 month ago

    Greater Kolkata Area, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...