Data Engineer

2 months ago


Chennai, Tamil Nadu, India SM IT SERVICES Full time

Company Type : : 5-10 yrs


Location : Mode : Overview :


We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python, BigQuery, Dataflow/Airflow, and Dataproc. As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the efficient processing and storage of large datasets.


Key Responsibilities :

- Design, develop, and maintain scalable and robust data pipelines using GCP services.

- Work with BigQuery to design and optimize data warehouses and analytical solutions.

- Develop data processing workflows using Dataflow and/or Apache Beam.

- Implement and manage ETL processes and data orchestration with Airflow.

- Leverage Dataproc for big data processing tasks using Hadoop, Spark, and other technologies.

- Write efficient SQL queries for data extraction, transformation, and loading (ETL).

- Utilize Python for data manipulation, automation, and integration tasks.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

- Ensure data quality, integrity, and security across all data platforms.

- Monitor, troubleshoot, and optimize data processing workflows for performance and reliability.

- Stay up-to-date with the latest trends and best practices in data engineering and GCP services.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience as a Data Engineer with a focus on GCP.

- Proficiency in SQL and experience with relational databases.

- Strong programming skills in Python.

- Hands-on experience with BigQuery for data warehousing and analytics.

- Experience with data processing frameworks such as Dataflow and/or Apache Beam.

- Knowledge of Airflow for data pipeline orchestration.

- Familiarity with Dataproc and big data technologies like Hadoop and Spark.

- Understanding of data modeling, ETL processes, and data warehousing concepts.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

Preferred Skills :

- Experience with other GCP services such as Cloud Storage, Pub/Sub, and Cloud Functions.

- Knowledge of data security and compliance best practices.

- Familiarity with machine learning workflows and tools on GCP.

- Experience with version control systems like Git.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Role SummaryWe are seeking a highly skilled Cloud Data Management Engineer to join our team at NTT DATA Services. This role will focus on designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms. The ideal candidate will have extensive experience in AWS DevOps Engineering, including EC2, S3, ECS, Lambda, and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a difference with NTT DATANTT DATA is a leading provider of digital and AI infrastructure, committed to helping clients innovate and transform for long-term success.Your day at NTT DATAThe Security Managed Services Engineer is responsible for providing proactive support to clients to ensure their Firewall infrastructure remains...

  • Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Data ArchitectJob Summary:We are seeking a skilled Data Architect to design and implement cloud data management and advanced analytics platforms. This role will work closely with data services, data analysts, and data scientists to build secure, scalable, fault-tolerant, and high-performing cloud-based architectures.Key Responsibilities:Design and...

  • AWS Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to lead our data infrastructure team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure....


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an Impact at NTT DATANTT DATA is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe role of Critical Facilities Operations and Maintenance Engineer is a seasoned subject matter expert...

  • Technical Specialist

    3 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleNTT DATA is seeking a skilled and experienced MS Engineer (L3) to join our team. As a MS Engineer (L3), you will be responsible for providing technical support to clients and ensuring a high level of service delivery.Key ResponsibilitiesProvide technical support to clients and resolve complex technical issues.Manage tickets and conduct advanced...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Critical Facilities Operations and Maintenance EngineerAbout the RoleThis seasoned subject matter expert is responsible for working with all major systems within a facility or building, such as electrical and HVAC systems, and performs regular maintenance on all systems. The role designs, plans, installs, and/or maintains mechanical, electrical,...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job SummaryWe are seeking an experienced Senior AWS Data Engineer to lead our data engineering team at Wavicle Data Solutions. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS.Key ResponsibilitiesDesign and develop robust ETL pipelines on AWS using services like Glue,...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Summary Principal Digital Engineering ArchitectNTT DATA is seeking a Principal Digital Engineering Architect to lead the design and development of cutting-edge digital solutions. The ideal candidate will have a strong background in machine learning and software engineering, with experience in designing and implementing scalable data-driven systems.Key...

  • Security Engineer

    1 month ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Security Managed Services Engineer to join our team at NTT DATA. As a key member of our security team, you will be responsible for providing proactive technical support to our clients, ensuring the security and integrity of their infrastructure.Key ResponsibilitiesProactively identify and resolve technical...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Job Title: Senior Engineering LeaderAbout the Role:We are seeking a highly skilled Senior Engineering Leader to join our team at Crayon Data. As a key member of our engineering team, you will be responsible for leading complex initiatives with long-term, strategic value.Key Responsibilities:Lead complex initiatives with long-term, strategic valueOwned...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    About the RoleCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a highly skilled Senior Engineering Director to lead our engineering team and drive the development of our flagship platform.The ideal candidate will have a strong background in cloud...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionNTT DATA is seeking a skilled Network Services Engineer to join our team. As a Network Services Engineer, you will be responsible for providing managed services to clients, ensuring the smooth operation of their IT infrastructure and systems.The primary objective of this role is to proactively review client requests or tickets and apply...

  • Technical Lead

    3 weeks ago


    Chennai, Tamil Nadu, India Crayon Data Full time

    Crayon Data Engineering Manager Role OverviewCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We're seeking an experienced Engineering Manager to lead our software development team in delivering high-quality, scalable, and secure platforms.Key...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a lasting impact with NTT DATAAs a trusted global innovator of business and technology services, we are committed to helping clients innovate, optimize and transform for long-term success.Your day at NTT DATAThe Data Centre Operations Manager, Critical Facilities Operations and Maintenance is a management role, ensuring the day-to-day...