gcp data engineer lead

4 weeks ago


Chennai, Tamil Nadu, India Mastech Digital Full time

Position: GCP Data Engineer Lead

Location: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)

Duration: Full Time

Notice Period: 15-30 days(Non negotiable)

Service based Company: Mastech InfoTrellis and Mastech Digital

Company Name: Mastech Digital and Mastech InfoTrellis

Company Link-

Job Description:

We are seeking a talented and motivated Data Engineer LeAD with expertise in Google Cloud Platform (GCP) and PySpark to join our team. As a Data Engineer, you will be responsible for designing,

implementing, and maintaining scalable data pipelines and solutions on GCP using PySpark for processing and analysis.

Responsibilities:


• Design, develop, and maintain data pipelines on GCP using PySpark for data processing, transformation, and analysis.


• Work closely with cross functional teams to understand data requirements and translate them into technical solutions.


• Optimize and tune data pipelines for performance, scalability, and reliability.


• Implement best practices for data governance, security, and compliance.


• Collaborate with Data Scientists and Analysts to support their data needs and ensure data availability and quality.


• Troubleshoot and debug data pipeline issues in production environments.


• Stay up to date with the latest trends and technologies in data engineering and cloud computing.


• Contribute to the continuous improvement of our data engineering practices and processes.

Required Skills:


• Proven experience as a Data Engineer familiar with Databricks and GCP services.


• Strong proficiency in Google Cloud Platform (GCP) services, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage.


• Strong experience designing, implementing, and optimizing data pipelines using Databricks in GCP.


• Hands-on experience with PySpark for data processing and analysis.


• Solid understanding of distributed computing principles and experience with large-scale data processing frameworks.


• Experience with SQL and NoSQL databases.


• Familiarity with data modelling, ETL, and data warehousing concepts.


• Excellent problem-solving and communication skills.


• Ability to work effectively in a fast-paced, dynamic environment.

Preferred Skills & Qualifications:


• Bachelor's or Master's degree in Computer Science & Engineering, or a related field.


• Google Cloud Platform (GCP) certification.


• Experience with other big data technologies such as Hadoop, Spark, or Apache Beam.


• Knowledge of machine learning concepts and tools.


• Experience with containerization technologies like Docker and Kubernetes.


  • GCP Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Covenant Consultants Full time

    Company OverviewCovenant Consultants is a leading Executive Search and Recruitment Firm with vast expertise across diverse industry practices. With over 350 full-time specialists, the firm is renowned for headhunting excellence, swift turnaround, cost-effectiveness, and unwavering service quality. Headquartered in Chennai, Tamilnadu, Covenant Consultants is...

  • GCP Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Greetings from Colan InfotechWe are hiring GCP Data EngineerJob Location - Chennai Role: GCP Data EngineerExperience: 5-10YearsRequirements:- Proven experience working as a data engineer, specifically with GCP.- Strong proficiency in SQL and experience with database technologies.- Hands-on experience with BigQuery, Cloud Storage, Dataform, and other GCP data...

  • Gcp data engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Raah Techservices Full time

    Company OverviewWelcome to Raah Tech Services We provide innovative IT solutions. With a customer-centric approach and a vast industry experience, we maximize your online presence and achieve unparalleled success. Partner with us to unlock your business's full potential in today's competitive landscape. Our headquarters are located in Chennai & Tirupattur...


  • Chennai, Tamil Nadu, India Incedo Inc. Full time

    About Incedo Inc.Incedo Inc. is a leading provider of cutting-edge technology solutions that drive business growth and innovation. Our team of experts works collaboratively to deliver high-quality services that meet the evolving needs of our clients.We are committed to fostering a culture of excellence, innovation, and continuous learning. Our goal is to...

  • GCP Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Yogy HR Solutions Full time

    GCP DATA ENGINEERCTC : 18LPA No of years of Experience : 5+Work Location : Pune, Bengaluru, Chennai, New Mumbai, NoidaMode : Hybrid (3days a week)Key Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes to support various business needs. - Build and manage data workflows using the Databricks, GCP stack, including...

  • GCP Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India HCLTech Full time

    HCL Tech is Hiring forGCP Data Engineerfor one of the leading product based client. "Come join us in reshaping the future"Exp required : 6 to 9 yrs.Job Location: Pune, Hyd, Bangalore & ChennaiKey Skills Required:Good hands on Experience in GCP, Python.Expertise with SQL & Bigquery.Interested candidates can share their resumes...

  • GCP Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Limited Full time

    Job DescriptionRole - GCP Data EngineerJob DescriptionMust Have Skills:- 6+ Experience in GCP as Senior Data Engineer- Should have 3+ experience in Google Big Query, Pub/ Sub, Dataflow, Composer DAGs and Air flow- Strong SQL knowledge able to translate complex scenarios into queries- 6-8 years exp- Experience with Data modeling and mapping.

  • GCP Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Saaki Argus & Averil Consulting Full time

    About the Client: A key player in the electric vehicle (EV) industry, this company specializes in delivering sustainable mobility solutions for the commercial transportation sector Job Role: GCP Data Engineer Location: Chennai Experience: 7 to 12 years Key Responsibilities:Design, develop, and maintain data pipelines on Google Cloud Platform (GCP)....

  • GCP Data Engineer

    3 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: GCP Engineer We are seeking an experienced GCP Engineer to join our team at Tata Consultancy Services. Location: Chennai, Bhubaneshwar, Hyderabad Experience: 3 to 10 years of experience in data engineering and programming languages such as Python. Responsibilities: Designing, developing, and maintaining ETL (Extract, Transform, Load) processes...

  • GCP Data Engineer

    1 day ago


    Chennai, Tamil Nadu, India Incedo Inc. Full time

    Job : GCP Data Engineer Location: Chennai Experience: 5+ years Role and responsibilities: Responsible for implementation and ongoing administration of GCP cloud. Looking for a Spark developer who knows how to fully exploit the potential of our Spark cluster. Write Python doc-style documentation with all code. Good to have Teradata development Knowledge....

  • Gcp data engineer

    2 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS Hiring for GCP Engineer RoleTCS is conducting an In-Person Drive at Multiple LocationsJob Title: GCP EngineerLocation: Chennai, Bhubaneshwar, HyderabadExperience Range: 3 to 10 yrsWalk-In Date- 22nd-March-25Walk-In Time- 9:30 AM-1:00 PMVenue- TCS Chennai- Tata Consultancy Services, Kumaran Nagar, 415/21-24, TNHB Main Rd, Old Mahabalipuram Road, Chennai,...

  • GCP Data Engineer

    14 hours ago


    Chennai, Tamil Nadu, India Saaki Argus and Averil Consulting Full time

    Role: GCP Data engineerExperience: 4-8 yearsLocation: Chennai, Hyderabad, BengaluruWork mode: Work from OfficeSkills & Qualifications:Strong proficiency in Python and SQL/ Teradata/ Java & Dataflow.Hands-on experience with GCP services , including BigQuery, Cloud Composer (Airflow), Dataproc, and GCS.Knowledge of ETL/ELT workflows and data modeling...

  • GCP Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Saaki Argus and Averil Consulting Full time

    Role: GCP Data engineerExperience: 4-8 yearsLocation: Chennai, Hyderabad, BengaluruWork mode: Work from OfficeSkills & Qualifications:- Strong proficiency in Python and SQL/ Teradata/ Java & Dataflow.- Hands-on experience with GCP services, including BigQuery, Cloud Composer (Airflow), Dataproc, and GCS.- Knowledge of ETL/ELT workflows and data modeling...

  • GCP Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS Hiring for GCP Engineer RoleTCS is conducting an In-Person Drive at Multiple LocationsJob Title: GCP EngineerLocation: Chennai, Bhubaneshwar, HyderabadExperience Range: 3 to 10 yrsWalk-In Date- 22nd-March-25Walk-In Time- 9:30AM-1:00PMVenue- TCS Chennai- Tata ConsultancyServices,Kumaran Nagar, 415/21-24, TNHB Main Rd, Old Mahabalipuram Road, Chennai,...

  • GCP Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Incedo Inc. Full time

    Job : GCP Data Engineer Location: ChennaiExperience: 5+ years Role and responsibilities:Responsible for implementation and ongoing administration of GCP cloud.Looking for a Spark developer who knows how to fully exploit the potential of our Spark cluster.Write Python doc-style documentation with all code.Good to have Teradata development Knowledge.Design...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: 316318 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior .NET/GCP Engineer (REMOTE) to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Senior...


  • Chennai, Tamil Nadu, India Saaki Argus and Averil Consulting Full time

    About Saaki Argus and Averil ConsultingWe are a dynamic consulting firm that offers expert services in data engineering. Our team is passionate about leveraging cloud technologies to drive business growth and innovation.Job OverviewWe are seeking an experienced GCP Data Engineer to join our team. As a key member of our data engineering group, you will be...


  • Chennai, Tamil Nadu, India Saaki Argus and Averil Consulting Full time

    Saaki Argus and Averil Consulting is looking for a seasoned GCP Data Engineer Role professional to join our team. As a key player in our data engineering team, you will be responsible for developing and deploying large-scale data processing systems on the Google Cloud Platform (GCP).You will collaborate with cross-functional teams to design, build, and...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: 316318 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior .NET/GCP Engineer (REMOTE) to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Senior .NET/GCP...


  • Chennai, Tamil Nadu, India Ford Motor Company Full time

    Job DescriptionJOB DESCRIPTION8+ years of Data Engineering experience5+ years of Cloud experience (GCP preferred) with solutions designed and implemented at production scaleStrong understanding of key GCP services, especially those related to data processing [Batch/Real Time] Big Query, Cloud Scheduler, Airflow, Postgres, Data Flow, Pub/Sub, Cloud Logging...