Current jobs related to Data Engineer with Hadoop--PD - India - Programming

  • Principal PD Engineer

    4 months ago

    india Microsoft Full time

    Overview Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing,...

  • Big Data

    3 days ago

    india Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...

  • AWS Data Engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Hadoop/big Data

    4 months ago

    India Sage IT India Full time

    Overall 8 Years of IT experience Minimum 6 Years of Hadoop/Big data experience : Specifically strong hands on development experience in Python, Py-Spark, Unix scripting, Hive HQL with S3 / HDFS (With Data storge on Hive and S3)

  • Lead Hadoop Administrator

    2 weeks ago

    India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical Support Role Big Data Infrastructure Implementation and Support Experience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration. Education: BE (IT/Computers), B.Tech, M.Tech, MCA Work Location : Riyadh, Saudi Arabia Certifications: Apache Hadoop...

  • IICL - Hadoop & Greenplum Developer - Data Migration

    3 months ago

    india INTELLIGENCE INDIA.COM LIMITED Full time

    Skills : Hadoop, Greenplum & ClouderaLocation : Onsite Nigeria, LagosDuration : 1 Year Extendable Job Description : - Experience in installing, configuring, supporting and Managing Hadoop clusters using Cloudera & Horton works Hadoop distributions.- Experience in Migrating data from Greenplum to Hadoop.- Installing, Configuring, Upgrading and Maintaining...

  • Data Engineer

    3 days ago

    India krtrimaIQ Cognitive Solutions Full time

    Job Title: Data EngineerLocation: Bangalore (Hybrid)Experience: 5+ yearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using PySpark, SQL, Hive, and Hadoop.Collaborate with cross-functional teams to understand data requirements and deliver solutions.Optimize and troubleshoot data workflows to ensure high performance and...

  • SDET Engineer

    2 weeks ago

    India Programming.com Full time

    Job Description: Position ; SDET Engineer (Backend)--PD Location : Bangalore Experience : 3.5 - 6 Years Notice Period : Immediate to 15 days Job Role Introduction: We’re looking for an SDET 2 (Backend) to join our Bangalore team. In this role, you’ll ensure the performance and reliability of scalable backend systems using Java,...

  • Senior Data Engineer--PD

    3 days ago

    india Programming.com Full time

    Job Description: Position: Senior Data EngineerBudget – 17 lpaLocation – BangaloreNotice period – Immediate joiner As a Senior Data Engineer at, you will:► Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements► Develop systems that...

  • Senior Data Engineer--PD

    2 days ago

    india Programming.com Full time

    Job Description: Position : Senior Data Engineer Budget – 17 lpa Location – Bangalore Notice period – Immediate joiner As a Senior Data Engineer at, you will: ► Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements ► Develop...

  • Azure Data Engineer

    2 weeks ago

    India Mumba Technologies, Inc. Full time

    Job Title: Data Engineer / Cloud Data Engineer Job Type: Full Time Job Location: 100% Remote Exp- 5+ Years Work Timing: 5:00 PM To 2:00 AM ISTJob Description: Data migration of priority data sets also, execution of top priority business use cases Would like to look at profiles CVs we might offer Ingestion and migration of SQL, Hadoop, and Epic data to...

  • Azure Data Engineer

    2 weeks ago

    India Mumba Technologies, Inc. Full time

    Job Title: Data Engineer / Cloud Data Engineer Job Type: Full Time Job Location: 100% Remote Exp- 5+ Years Work Timing: 5:00 PM To 2:00 AM IST Job Description: Data migration of priority data sets also, execution of top priority business use cases Would like to look at profiles CVs we might offer Ingestion and migration of SQL , Hadoop , and...

  • Azure Data Engineer

    3 days ago

    india Mumba Technologies, Inc. Full time

    Job Title: Data Engineer / Cloud Data Engineer Job Type: Full Time Job Location: 100% Remote Exp- 5+ Years Work Timing: 5:00 PM To 2:00 AM IST Job Description: Data migration of priority data sets also, execution of top priority business use cases Would like to look at profiles CVs we might offer Ingestion and migration of SQL , Hadoop , and...

  • Data Engineer

    2 weeks ago

    India hrtech Full time

    Role : Data Engineer GCP Build Job type : Long term contract ( 3 Years) Work Place type : Hybrid Data Engineer : You will be responsible for designing, building, and maintaining our data infrastructure, ensuring data quality, and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data...

  • Data Engineer

    2 weeks ago

    India hrtech Full time

    Role : Data Engineer GCP BuildJob type : Long term contract ( 3 Years)Work Place type : HybridData Engineer :You will be responsible for designing, building, and maintaining our data infrastructure, ensuring data quality, and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data engineering,...

  • Senior Physical Design Engineer

    3 days ago

    india Microsoft Full time

    Overview Microsoft’s Cloud Compute Development Organization (CCDO) is seeking passionate, driven and intellectually curious engineers to join our silicon hardware physical design team, covering RTL to GDS methodology, design convergence, and design quality for our projects. We are responsible for delivering cutting-edge, custom IP and SOC designs...

  • Big Data Engineer

    3 days ago

    india Quess IT Staffing Full time

    Role: Big Data EngineerExp: 4 to 8 YearsNp: Immediate JoinersJd:Experience as a Data Engineer with strong track record of designing and implementing data solutions. Experience in programming language as Python or Java, with experience in building data pipelines and workflows. Experience with cloud data warehousing technologies, such as Snowflake and...

  • Data Engineer

    1 month ago

    India Insight Global Full time

    Job Title: Remote GCP Data engineerCompany: Insight GlobalLocation: Remote (Anywhere in India)Compensation: Total compensation ranges from 22 to 25 lakhs per annum, based on experience.Duration: This is a contract position. Only apply if you are comfortable with contract work. The position is approved for full-time work up to a year and is likely to...

Data Engineer with Hadoop--PD

3 months ago

India Programming Full time

Job Description: Data Engineer with Hadoop

Position : Data Engineer with Hadoop

Experience : 5+ years

Notice Period: I mmediate to 15 days

Job Overview:

We are seeking a highly skilled Lead Data Engineer with a strong background in on-premises data engineering. The ideal candidate will have extensive experience in SQL, Python or Scala, Spark, Hadoop, Hive, and HDFS. This role requires a hands-on technical leader who can manage data pipelines, optimize large-scale data processing, and drive our data infrastructure forward.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines and architectures.

Implement data solutions using SQL, Python/Scala, Spark, Hadoop, Hive, and HDFS.

Optimize and enhance existing data pipelines and workflows to improve performance and reliability.

Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability.

Lead and mentor a team of data engineers, providing technical guidance and support.

Monitor and troubleshoot data pipeline issues, ensuring data integrity and availability.

Stay updated with the latest industry trends and best practices in data engineering and implement them as needed.

Required Technical Skills:

SQL: Proficiency in writing and optimizing complex queries.

Python/Scala: Experience in using either Python or Scala for data engineering tasks.

Spark: Hands-on experience with Apache Spark for large-scale data processing.

Hadoop: Knowledge of Hadoop ecosystem components and their applications.

Hive: Expertise in using Hive for data warehousing solutions.

HDFS: Proficient in working with Hadoop Distributed File System.

Desired Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Proven track record of leading data engineering projects and teams.

Strong problem-solving skills and the ability to think critically and creatively.

Excellent communication and interpersonal skills.

Additional Information:

Opportunity to work with a dynamic team on cutting-edge data projects.

Flexible working environment.

Technical Skills:

SQL, Python/Scala, Spark, Hadoop, Hive, HDFS