Cloud Engineer for Large-Scale Data Solutions

3 days ago


Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

We are seeking a talented Cloud Engineer to join our team at Mastech InfoTrellis. As a Cloud Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (GCP) using PySpark for processing and analysis.

Job Description

The successful candidate will have expertise in GCP services, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage. You will work closely with cross-functional teams to understand data requirements and translate them into technical solutions.

  • Design, develop, and maintain data pipelines on GCP using PySpark for data processing, transformation, and analysis.
  • Optimize and tune data pipelines for performance, scalability, and reliability.
  • Implement best practices for data governance, security, and compliance.
  • Collaborate with Data Scientists and Analysts to support their data needs and ensure data availability and quality.

The ideal candidate will have hands-on experience with PySpark for data processing and analysis, as well as a solid understanding of distributed computing principles and experience with large-scale data processing frameworks.

Mastech InfoTrellis offers a competitive salary range of $120,000 - $180,000 per year, depending on experience and qualifications.

Requirements
  • Proven experience as a Data Engineer familiar with Databricks and GCP services.
  • Strong proficiency in Google Cloud Platform (GCP) services, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Hands-on experience with PySpark for data processing and analysis.
  • Solid understanding of distributed computing principles and experience with large-scale data processing frameworks.
About Us

Mastech InfoTrellis is a service-based company that values innovation and excellence. We offer a dynamic and fast-paced work environment that encourages collaboration and growth.



  • Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Company Overview">Crayon Data is a pioneering firm in the field of artificial intelligence-led revenue acceleration solutions. With headquarters in Singapore and local presence in India and the UAE, the company has been transforming the world's choices since its inception in 2012.Their flagship platform, maya.ai, empowers enterprises across Banking,...

  • Senior Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tredence Analytics Solutions Private Limited Full time

    Job OverviewTredence Analytics Solutions Private Limited is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, implementing, and managing large-scale data pipelines using Google Cloud Platform.Key ResponsibilitiesDevelop and maintain complex data pipelines using Apache Beam, Google...

  • Senior Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India American Express Full time

    Data Engineer I Job DescriptionCompany OverviewAmerican Express is a global leader in the financial services industry, providing innovative payment solutions to customers around the world. Our company values diversity, equity, and inclusion, and we strive to create an environment where every colleague feels valued and empowered to succeed.Estimated Salary...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Summary:We are seeking a skilled Cloud Infrastructure Architect to join our team at Wavicle Data Solutions. As a key member of our engineering team, you will be responsible for designing and implementing scalable, secure, and reliable cloud infrastructure environments.About the Role:You will work closely with our development, operations, and security...


  • Chennai, Tamil Nadu, India Tredence Analytics Solutions Private Limited Full time

    Job OverviewTredence Analytics Solutions Private Limited is seeking an experienced Cloud Data Engineer to lead the development and implementation of scalable data solutions on Google Cloud Platform.About UsTredence is a global data science solutions provider with a focus on solving the last-mile problem in AI. We have 2200+ employees across offices in San...

  • Senior Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India Aditi Consulting Full time

    Job Overview">We are seeking a highly skilled Senior Backend Software Engineer to join our team at Aditi Consulting. In this role, you will be responsible for designing and developing large-scale applications using Java and Spring Boot.">About You">">Bachelor's degree in computer science or related field">3+ years of experience developing large-scale...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Software Engineer with experience in Springboot development to join our team at Tata Consultancy Services.The ideal candidate will have a strong background in Java, JEE, and RESTful Web Services, as well as proficiency in building modular code and working on large-scale projects.ResponsibilitiesDevelop...


  • Chennai, Tamil Nadu, India Intelsat Full time

    About the Role:We are seeking a highly skilled Data Engineering Lead to join our team at Intelsat. This is an exceptional opportunity to lead the design and development of large-scale data systems, working closely with cross-functional teams to deliver high-quality solutions.Key Responsibilities:Design and develop scalable data pipelines and solutions within...

  • Cloud Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    About the RoleMastech InfoTrellis is seeking a talented Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines on Google Cloud Platform (GCP) using PySpark for processing and analysis.ResponsibilitiesDesign, develop, and maintain data pipelines on GCP...


  • Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    Job Summary: We are seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP) to join our team at Mastech InfoTrellis.About the Role:This is a challenging and exciting opportunity to design, implement, and maintain scalable data pipelines and solutions on GCP using PySpark for processing and analysis. As a Data Engineer,...


  • Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    Mastech InfoTrellis seeks a seasoned Data Engineer to design and implement large-scale data pipelines on Google Cloud Platform (GCP).Estimated Salary: $120,000 - $180,000 per year.About the Role:We are looking for an experienced professional with expertise in GCP services, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage. The ideal candidate will...


  • Chennai, Tamil Nadu, India Unison Consulting Pte Ltd Full time

    As a key player in our team, you will be responsible for the successful migration of data from SAS to PySpark.We are seeking a highly skilled Data Integration Specialist to join our Unison Consulting Pte Ltd team. This is an exciting opportunity to work on a large-scale data migration project and take advantage of your expertise in data integration, ETL, and...


  • Chennai, Tamil Nadu, India Saaki Argus & Averil Consulting Full time

    About Saaki Argus & Averil Consulting:A pioneering company in the electric vehicle (EV) industry, specializing in delivering sustainable mobility solutions for commercial transportation.Estimated Salary: ₹ 35-55 lakhs per annum.Job Role: Cloud Data EngineerLocation: ChennaiExperience: 7 to 12 yearsKey Responsibilities:Data Engineering: Design, develop, and...

  • Senior Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India UPS India Full time

    Explore innovative possibilities and experience our rewarding culture at UPS India. We're seeking a Senior Data Engineer to support batch and real-time data pipelines utilizing various data analytics processing frameworks in support of data science practices for Marketing and Finance business units.Key Responsibilities: Develop and deliver data engineering...


  • Chennai, Tamil Nadu, India Visionyle Solutions Full time

    Job OverviewWe are seeking a highly motivated Data Engineering Solutions Specialist to join our team at Visionyle Solutions. This role offers an exciting opportunity to work with cutting-edge technologies in a fast-paced, dynamic environment.About the RoleIn this position, you will design, implement, and optimize data solutions using Google Cloud Platform...


  • Chennai, Tamil Nadu, India Visionyle Solutions Full time

    Job Title: Chief Data Engineering SpecialistA visionary data engineer is sought after by Visionyle Solutions to spearhead the design, development, and optimization of large-scale data pipelines. As a key member of our data engineering team, you will leverage your expertise in cloud technologies, particularly Google Cloud Platform (GCP), to craft innovative...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS Hiring Experienced Spring Boot DevelopersWe are looking for highly skilled and motivated Senior Java Developers to join our team in Chennai.Our ideal candidate should have a strong background in building modular code using Java 8, JEE, and RESTful Web Services. With a minimum of 4 years of experience in Springboot, you will be responsible for designing...


  • Chennai, Tamil Nadu, India NielsenIQ Full time

    At NielsenIQ, we are seeking a highly skilled Senior Frontend Engineer to join our expanding core technology team. Our company is the world's leading consumer intelligence company, delivering unparalleled global reach and comprehensive consumer insights.We offer a competitive salary range of $120,000 - $180,000 per year, depending on experience. As a key...