Data Engineer

3 months ago

Chennai, India SM IT SERVICES Full time

Company : MNC

Location : Chennai

Exp : 4 - 10 yrs

Position Overview :

We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python, BigQuery, Dataflow/Airflow, and Dataproc. As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the efficient processing and storage of large datasets.

Key Responsibilities :

- Design, develop, and maintain scalable and robust data pipelines using GCP services.

- Work with BigQuery to design and optimize data warehouses and analytical solutions.

- Develop data processing workflows using Dataflow and/or Apache Beam.

- Implement and manage ETL processes and data orchestration with Airflow.

- Leverage Dataproc for big data processing tasks using Hadoop, Spark, and other technologies.

- Write efficient SQL queries for data extraction, transformation, and loading (ETL).

- Utilize Python for data manipulation, automation, and integration tasks.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

- Ensure data quality, integrity, and security across all data platforms.

- Monitor, troubleshoot, and optimize data processing workflows for performance and reliability.

- Stay up-to-date with the latest trends and best practices in data engineering and GCP services.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience as a Data Engineer with a focus on GCP.

- Proficiency in SQL and experience with relational databases.

- Strong programming skills in Python.

- Hands-on experience with BigQuery for data warehousing and analytics.

- Experience with data processing frameworks such as Dataflow and/or Apache Beam.

- Knowledge of Airflow for data pipeline orchestration.

- Familiarity with Dataproc and big data technologies like Hadoop and Spark.

- Understanding of data modeling, ETL processes, and data warehousing concepts.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

Preferred Skills :

- Experience with other GCP services such as Cloud Storage, Pub/Sub, and Cloud Functions.

- Knowledge of data security and compliance best practices.

- Familiarity with machine learning workflows and tools on GCP.

- Experience with version control systems like Git.

(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Director of Data Engineering

    4 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals....

  • Director of Data Engineering

    4 weeks ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...

  • Data Engineering Leader

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Senior Data Engineer

    3 weeks ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 week ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...