Cloud Data Engineer

6 days ago

Chennai, India Visionyle Solutions Full time

Job Title : Cloud Data Engineer

Location : Chennai

Experience : 5+ Years (Adjust as needed)

Position Type : Full-Time / Contract (Specify)

Budget : [Specify Budget]

Position Overview :

We are seeking a Cloud Data Engineer with extensive experience in Google Cloud Platform (GCP) and a strong background in data engineering, cloud infrastructure, and software development. The ideal candidate will play a critical role in designing, developing, and maintaining cloud-based data solutions, leveraging GCP services, automation tools, and data engineering best practices.

Key Responsibilities :

- Design and manage data pipelines in GCP using BigQuery, DataFlow, Dataproc, and DataFusion for efficient batch and real-time data processing.

- Develop and maintain infrastructure as code (IaC) using Terraform for provisioning and managing cloud resources.

- Implement event-driven data pipelines using Confluent Kafka and ensure reliable data transfer between systems.

- Develop and optimize API integrations for seamless data communication between different platforms.

- Write efficient, maintainable Python, PySpark, and shell scripts for data processing, automation, and orchestration tasks.

- Collaborate within an Agile development framework to deliver robust, scalable data solutions on time.

- Troubleshoot, monitor, and optimize data pipeline performance, ensuring data accuracy and system reliability.

- Ensure security and cost optimization in cloud infrastructure and data solutions.

Required Skills and Qualifications :

Technical Skills :

Google Cloud Platform (GCP) :

- BigQuery, DataFlow, Dataproc, DataPlex, DataFusion

- Cloud SQL, Cloud Storage, Terraform, & Scripting :


- Proficiency in Python, PySpark, and Shell Scripting

Data Engineering :

- Experience with data transfer utilities, Confluent Kafka, and API Development

Automation & Orchestration :

- Experience with tools like Airflow, Terraform, and Tekton

Version Control :

- Strong understanding of Git or other version control systems

Preferred Skills :

- Advanced knowledge in Python for automation and data transformation tasks.

- Familiarity with API development and consumption, particularly in cloud environments.

- Experience in optimizing cloud storage solutions for cost and performance efficiency.

Experience Required :

- 5+ years of experience in cloud-based data engineering and software development.

- 2+ years of hands-on experience with GCP services.

- 4+ years in Python and PySpark development.

- 2+ years in Confluent Kafka and API Development.

- 2+ years of experience in Agile environments.

(ref:hirist.tech)

  • Cloud Destinations

    1 month ago

    Chennai, India Cloud Destinations Full time

    About Cloud Destinations:- Cloud Destinations is a leading provider of digital transformation and cloud solutions, serving clients in the healthcare, retail, and technology sectors.- With a strong focus on large-scale cloud migrations and multi-cloud operations, we are committed to delivering innovative solutions that drive business growth.Role Overview:- As...

  • Data Engineer

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Data Engineer

    1 month ago

    Chennai, India NTT DATA Services Full time

    Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...

  • Cloud DevOps Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job SummaryWe are seeking an experienced technical professional to support our Cloud Data Management and Advanced Analytics platforms.Key ResponsibilitiesDesign, implement, and support Cloud Data Management and Advanced Analytics platforms.Provide technological guidance on Data Lake and Enterprise Data Warehouse design, development, implementation, and...

  • Bastion Data Solutions | Cloud SRE Architect

    1 day ago

    Chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Cloud Infrastructure Engineer

    2 months ago

    Coimbatore/Chennai, India Cloud Destinations Full time

    Job Title: Lead DevOps/Senior DevOps EngineerAbout the Role:We are seeking a highly skilled and experienced Lead DevOps/Senior DevOps Engineer to join our team at Cloud Destinations. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure and ensuring the smooth operation of our...

  • Cloud Destinations Senior DevOps Engineer

    1 month ago

    Coimbatore/Chennai, India Cloud Destinations Full time

    About the Role:We are seeking a highly skilled Cloud DevOps Engineer with senior experience to join our team at Cloud Destinations. As a key member of our tech team, you will be responsible for leading the implementation of our cloud infrastructure and ensuring the smooth operation of our services.Responsibilities:- Lead the design, implementation, and...

  • Cloud Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    We are seeking a skilled Cloud Data Engineer to join Colan Infotech Private Limited.Key Responsibilities:• Design and implement scalable data architectures on GCP.• Develop and maintain data pipelines using BigQuery, Cloud Storage, and Dataform.• Ensure data quality and integrity through thorough testing and validation.Requirements:• Proven...

  • Bastion Data Solutions | Cloud SRE Architect

    3 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions.. Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management. QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 days ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Cloud sre architect

    2 days ago

    Chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / Dev Ops Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Cloud Data Engineering Lead

    4 weeks ago

    Chennai, Tamil Nadu, India NR Consulting - India Full time

    About the Role:As a Senior Data Engineer - Cloud Solutions, you will be responsible for leading our cloud data engineering efforts, leveraging Google Cloud Platform (GCP) technologies to drive data-driven decision making across the organization. With 7-10 years of experience in cloud data engineering, you will have a proven track record of delivering...

  • Cloud Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Technogen India Pvt. Ltd. Full time

    **Job Title:** Cloud Data Engineer**Job Summary:** We are seeking a skilled Cloud Data Engineer to join our team at Technogen India Pvt. Ltd.**Key Responsibilities:**Design and implement data pipelines using GCP technologies.Develop and maintain big data technologies, including BigQuery, Composer, and DataFlow.Collaborate with cross-functional teams to...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Cloud SRE Architect

    2 days ago

    Chennai, India Bastion Data Solutions Full time

    Company Description Bastion data solutions.. Role Description This is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management. Qualifications...

  • Cloud SRE Architect

    2 days ago

    Chennai, India Bastion Data Solutions Full time

    Company Description Bastion data solutions.. Role Description This is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management. ...

  • Cloud SRE Architect

    1 day ago

    Chennai, India Bastion Data Solutions Full time

    Company Description Bastion data solutions..Role Description This is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.Qualifications Site...

  • Senior Data Engineer

    4 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...