GCP Data Engineer
4 weeks ago
About the Role: We are seeking a Lead GCP Data Engineer who can demonstrate a broad range of technical skills across Google Cloud Platform (GCP) and third-party technologies. As a pivotal member of our team, you will be responsible for designing robust data architectures, developing efficient data pipelines, and optimizing data processing workflows on GCP. Your expertise will be instrumental in driving our data engineering initiatives forward, ensuring scalability, reliability, and performance.
Key Responsibilities
- Data Architecture Design: Design scalable and efficient data architectures on GCP that meet the organization's data processing and analysis requirements. Collaborate closely with data scientists, business analysts, and stakeholders to define effective data models and structures.
- Data Pipeline Development: Develop and implement data pipelines using GCP services such as Google Cloud Storage, Big Query, Dataflow, and Pub/Sub. Ensure data quality, reliability, and governance throughout the data lifecycle.
- Data Transformation and Integration: Utilize technologies like Apache Beam, Apache Spark, and Cloud Dataproc to transform and integrate data from diverse sources. Perform data cleansing, aggregation, enrichment, and normalization to support downstream applications and analytics.
- Performance Optimization: Optimize data processing workflows to enhance performance and efficiency. Monitor pipelines, identify bottlenecks, and implement optimizations such as improved data partitioning, sharding, and leveraging GCP's autoscaling capabilities.
- Continuous Improvement: Stay abreast of advancements in data engineering and cloud technologies. Explore and implement new GCP features and services to enhance data processing capabilities and drive innovation within the team.
- Research and Innovation: Conduct research on emerging data engineering technologies, tools, and best practices. Evaluate new methodologies to improve data engineering processes and bring innovative solutions to the organization.
- Task Automation: Automate data engineering tasks using scripting, workflows, or tools like Cloud Composer and Cloud Functions. Streamline data ingestion, transformation, monitoring, and other operational processes to improve efficiency and reduce manual effort.
-
Attributes & Competencies
- Education: BE/BTech, MTech, or MCA.
- Experience: Minimum 5+ years in development/migration projects, with at least 3 years focused on GCP. Experience in GCP-based Big Data deployments (batch/real-time) using Big Query, Big Table, Google Cloud Storage, Pub/Sub, Data Fusion, Dataflow, Dataproc, and Airflow.
Technical Skills
- Google Certified Professional Cloud Architect with experience automating and orchestrating workloads on GCP or other public clouds.
- Proficiency in at least one configuration management system (Chef, Puppet, Ansible, Salt, etc.).
- Strong programming skills in Python, Go, with expertise in Git and Git workflows.
- Demonstrated proficiency in CI/CD tools such as Jenkins, TeamCity, or Spinnaker.
-
GCP Data Engineer
5 days ago
Bengaluru, Karnataka, India Crescendo Global Full timeJob Description : We are looking for an experienced and skilled Data Engineer with a strong background in Google Cloud Platform (GCP) and a deep understanding of data engineering principles to join our dynamic team. The ideal candidate will have mastery in GCP data services and extensive expertise in ETL processes and data integration. You will play a...
-
GCP Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Crescendo Global Full timeJob Description :We are looking for an experienced and skilled Data Engineer with a strong background in Google Cloud Platform (GCP) and a deep understanding of data engineering principles to join our dynamic team. The ideal candidate will have mastery in GCP data services and extensive expertise in ETL processes and data integration. You will play a...
-
Gcp Lead Engineer
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeReq ID 298270NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a GCP Lead Engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Primary Skill ...
-
GCP Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from TCSTCS is hiring for GCP Data EngineerDesired Experience Range: 5+ YearsJob Location: Gurgaon / Bangalore / Pune/ Chennai / MumbaiKey responsibilities:As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code...
-
GCP Data engineer
3 weeks ago
Bengaluru, Karnataka, India Live Connections Full timeRole – GCP Data EngineerExp : 9yrs to 17yrsLocation : Chennai/Bangalore/Noida/HyderavbadHive, Python, Java or SQL, Hadoop, Spark, ETL, GCP BigQuery, Cloud SQL, Dataflow, Dataproc, Cloud build, cloud run, cloud functions, pub-sub, cloud composer Data lake, Multi cloud (e.g.,Google Cloud, AWS, Azure)
-
GCP Data engineer
2 weeks ago
Bengaluru, Karnataka, India Live Connections Full timeRole – GCP Data Engineer Exp : 9yrs to 17yrs Location : Chennai/Bangalore/Noida/Hyderavbad Hive, Python, Java or SQL, Hadoop, Spark, ETL, GCP BigQuery, Cloud SQL, Dataflow, Dataproc, Cloud build, cloud run, cloud functions, pub-sub, cloud composer Data lake, Multi cloud (e.g.,Google Cloud, AWS, Azure)
-
GCP Engineer
3 weeks ago
Bengaluru, Karnataka, India Kiash Solutions LLP Full timeCompany OverviewOur organization is dedicated to leveraging the power of Google Cloud Platform (GCP) to innovate and drive business solutions. We are in search of talented GCP Engineers to join our dynamic team and help us build and manage robust cloud infrastructure.Job OverviewWe are hiring for various roles within our GCP engineering team. Each position...
-
GCP Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Infogain Full timeGCP Data Engineer (Senior) with skills Data Engineering, Kafka, Python, Scala, Big Data, ETL, Apache Spark for location Bangalore, India Posted on: July 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES need someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of...
-
GCP Data Engineer
3 weeks ago
Bengaluru, Karnataka, India People Prime Worldwide Private Limited Full timeJob DescriptionAbout client:Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries, it caters to over 700 clients with its extensive domain...
-
GCP Data Engineer
7 days ago
Bengaluru, Karnataka, India Infogain India Private Limited Full timeJob DescriptionROLES & RESPONSIBILITIESExp: 5-10 yearsMust have - Python, Java, Bigquery, PySpark- Extensive experience with Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow.- Expertise in ETL (Extract, Transform, Load) processes and data integration on GCP.- Strong SQL and database querying optimization skills on GCP.-...
-
GCP Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Aqilea (formerly Soltia) Full timeCompany Description We are a consulting company with a bunch of technology-interested and happy people We love technology, we love design and we love quality. Our diversity makes us unique and creates an inclusive and welcoming workplace where each individual is highly valued. With us, each individual is her/himself and respects others for who...
-
GCP Data engineer
3 days ago
Bengaluru, Karnataka, India Kyndryl Solutions Private Limited Full timeJob DescriptionThe RoleAre you ready to dive headfirst into the captivating world of data engineering at Kyndryl As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.As a Data Engineer at...
-
GCP Data Engineer
4 weeks ago
Bengaluru, Karnataka, India EliteRecruitments Full timeLocation: BangaloreJob Summary:We are seeking a highly skilled Senior Google BigQuery Data Engineer to lead the design, development,and optimization of our data platform. The ideal candidate will have a deep understanding of BigQuery'sarchitecture, capabilities, and best practices, including columnar storage, nested and repeated fields, andseparation of...
-
Senior GCP Data Engineer
23 hours ago
Bengaluru, Karnataka, India Tipstat® Full timeWe are seeking a GCP Data Engineer with hands-on experience in designing and building data pipelines on the Google Cloud Platform. The successful candidate will be responsible for leveraging GCP services to collect, transform, and manage large datasets, ensuring efficient and secure data delivery to meet business needs.Key ResponsibilitiesData Storage &...
-
Senior GCP Data Engineer Position
3 days ago
Bengaluru, Karnataka, India Careerzgraph Full timeJob Overview:We are looking for an experienced Cloud Data Engineer to join our team at Careerzgraph. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure on GCP.Responsibilities:-...
-
Gcp Data Engineer
4 weeks ago
Bengaluru, Karnataka, India OmegaHires Full timeJob Title GCP Data Engineer Duration 06 Months Contract to Hire Location Bangalore IN Hybrid Roles Responsibilities Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity Collaborates with analytics and business teams to improve data models that feed business intelligence tools increasing data...
-
Data Engineer
5 days ago
Bengaluru, Karnataka, India Intelli Swift Full timeJob OverviewIn the ever-evolving landscape of data engineering, we are seeking a seasoned professional to spearhead our data analytics and machine learning initiatives. As a Data Engineer with expertise in Google Cloud Platform (GCP) and proficiency in BigQuery, you will be responsible for designing, developing, and maintaining scalable data pipelines and...
-
GCP Data Engineer
7 days ago
Bengaluru, Karnataka, India Infogain India Private Limited Full timeJob DescriptionROLES & RESPONSIBILITIES..Key Responsibilities:..- Develop and maintain enterprise-grade data pipelines and delivery solutions on ..Google Cloud Platform (GCP).., including tools like ..BigQuery.., ..Dataflow.., and ..Composer...- Design and implement ..ETL processes.. for data ingestion, transformation, and delivery from multiple formats...
-
GCP Data engineer
4 weeks ago
Bengaluru, Karnataka, India myGwork Full timeThis job is with Kyndryl, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always...
-
Data Engineer Position for GCP Expert
5 days ago
Bengaluru, Karnataka, India Intelli Swift Full timeWe are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) and proficiency in BigQuery to join our team. This role requires a deep understanding of GCP services, particularly BigQuery, as well as experience in data modeling, ETL processes, and cloud architecture.The ideal candidate will be responsible for designing,...