Data Engineer

1 month ago


Chennai, Tamil Nadu, India SM IT SERVICES Full time

Job Summary :

We are seeking a highly skilled Cloud Data Engineer to join our team at SM IT SERVICES. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python, BigQuery, Dataflow/Airflow, and Dataproc. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the efficient processing and storage of large datasets.

Key Responsibilities :

- Design, develop, and maintain scalable and robust data pipelines using GCP services.

- Work with BigQuery to design and optimize data warehouses and analytical solutions.

- Develop data processing workflows using Dataflow and/or Apache Beam.

- Implement and manage ETL processes and data orchestration with Airflow.

- Leverage Dataproc for big data processing tasks using Hadoop, Spark, and other technologies.

- Write efficient SQL queries for data extraction, transformation, and loading (ETL).

- Utilize Python for data manipulation, automation, and integration tasks.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

- Ensure data quality, integrity, and security across all data platforms.

- Monitor, troubleshoot, and optimize data processing workflows for performance and reliability.

- Stay up-to-date with the latest trends and best practices in data engineering and GCP services.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience as a Data Engineer with a focus on GCP.

- Proficiency in SQL and experience with relational databases.

- Strong programming skills in Python.

- Hands-on experience with BigQuery for data warehousing and analytics.

- Experience with data processing frameworks such as Dataflow and/or Apache Beam.

- Knowledge of Airflow for data pipeline orchestration.

- Familiarity with Dataproc and big data technologies like Hadoop and Spark.

- Understanding of data modeling, ETL processes, and data warehousing concepts.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

Preferred Skills :

- Experience with other GCP services such as Cloud Storage, Pub/Sub, and Cloud Functions.

- Knowledge of data security and compliance best practices.

- Familiarity with machine learning workflows and tools on GCP.

- Experience with version control systems like Git.


  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Role SummaryWe are seeking a highly skilled Cloud Data Management Engineer to join our team at NTT DATA Services. This role will focus on designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms. The ideal candidate will have extensive experience in AWS DevOps Engineering, including EC2, S3, ECS, Lambda, and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a difference with NTT DATANTT DATA is a leading provider of digital and AI infrastructure, committed to helping clients innovate and transform for long-term success.Your day at NTT DATAThe Security Managed Services Engineer is responsible for providing proactive support to clients to ensure their Firewall infrastructure remains...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Are you a seasoned AI expert looking to make a significant impact at a leading global innovator in business and technology services?We are seeking a highly skilled Artificial Intelligence Engineer to join our team at NTT DATA. This role offers the opportunity to design, develop, and test software systems, modules, or applications for software enhancements...

  • Data Architect

    3 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Data ArchitectJob Summary:We are seeking a skilled Data Architect to design and implement cloud data management and advanced analytics platforms. This role will work closely with data services, data analysts, and data scientists to build secure, scalable, fault-tolerant, and high-performing cloud-based architectures.Key Responsibilities:Design and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an Impact at NTT DATANTT DATA is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe role of Critical Facilities Operations and Maintenance Engineer is a seasoned subject matter expert...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Critical Facilities Operations and Maintenance EngineerAbout the RoleThis seasoned subject matter expert is responsible for working with all major systems within a facility or building, such as electrical and HVAC systems, and performs regular maintenance on all systems. The role designs, plans, installs, and/or maintains mechanical, electrical,...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job SummaryWe are seeking an experienced Senior AWS Data Engineer to lead our data engineering team at Wavicle Data Solutions. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS.Key ResponsibilitiesDesign and develop robust ETL pipelines on AWS using services like Glue,...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Summary Principal Digital Engineering ArchitectNTT DATA is seeking a Principal Digital Engineering Architect to lead the design and development of cutting-edge digital solutions. The ideal candidate will have a strong background in machine learning and software engineering, with experience in designing and implementing scalable data-driven systems.Key...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job SummaryWe are seeking an experienced Data Science Strategist to join our team at NTT DATA Services.About the RoleThe ideal candidate will have a strong background in designing and implementing machine learning systems, as well as researching and developing new algorithms and tools. The successful candidate will be responsible for selecting appropriate...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job OverviewNTT DATA is a leading global technology services company. We are seeking a highly skilled Security Managed Services Engineer to join our team.We provide innovative solutions for clients worldwide, and this role will be responsible for ensuring the security of their infrastructure and systems.


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionNTT DATA is seeking a skilled Network Services Engineer to join our team. As a Network Services Engineer, you will be responsible for providing managed services to clients, ensuring the smooth operation of their IT infrastructure and systems.The primary objective of this role is to proactively review client requests or tickets and apply...

  • Technical Lead

    4 weeks ago


    Chennai, Tamil Nadu, India Crayon Data Full time

    Crayon Data Engineering Manager Role OverviewCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We're seeking an experienced Engineering Manager to lead our software development team in delivering high-quality, scalable, and secure platforms.Key...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionA career-defining opportunity awaits a skilled Cybersecurity Engineer to join NTT DATA's team. As a key member of our infrastructure support team, you will play a pivotal role in ensuring the security and reliability of our clients' IT systems.Responsibilities include:Providing proactive monitoring and incident response services to identify...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Role OverviewThe Security Firewall Engineer will be responsible for managing and maintaining our clients' firewall infrastructure, ensuring that it remains operational and secure. This role involves proactively identifying and investigating potential security incidents and routing them to the correct resolver group.Main ResponsibilitiesProvide a managed...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a Difference with NTT DATA's Cybersecurity SolutionsNTT DATA is a leading provider of digital and AI infrastructure solutions. We are seeking an experienced Cybersecurity Engineer - Network Security to join our team. As a Network Security Engineer, you will be responsible for designing, implementing, and maintaining secure network...


  • Chennai, Tamil Nadu, India Merit Data and Technology Full time

    Job DescriptionWe are seeking an experienced Machine Learning Engineer to join our team at Merit Data and Technology. As a key member of our organization, you will be responsible for designing and developing machine learning systems that drive business growth and improvement.With a strong background in Python and experience working with MLAI, Deep Learning,...