GCP Data Engineer
3 days ago
Job Title : Data Engineer / Integration Engineer
Job Summary :
We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of is a plus.
Key Responsibilities :
- Design, build, and maintain scalable data pipelines and workflows.
- Develop and optimize ETL/ELT processes using Python and workflow automation tools.
- Implement and manage data integration between various systems, including APIs and Oracle EBS.
- Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
- Utilize Apache Spark or similar big data frameworks for efficient data processing.
- Develop robust API integrations for seamless data exchange between applications.
- Ensure data accuracy, consistency, and security across all systems.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
- Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
- Document data workflows, processes, and best practices for future reference.
Required Skills & Qualifications :
- Strong proficiency in Python for data engineering and workflow automation.
- Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).
- Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
- Expertise in big data processing frameworks, such as Apache Spark.
- Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data.
- Strong problem-solving skills and ability to optimize data pipelines for performance.
- Experience working in an agile environment with CI/CD processes.
- Strong communication and collaboration skills.
Preferred Skills & Nice-to-Have :
- Experience with platform for data pipeline automation.
- Knowledge of SQL and NoSQL databases.
- Familiarity with Docker and Kubernetes for containerized workloads.
- Exposure to machine learning workflows is a plus.
Why Join Us?
- Opportunity to work on cutting-edge data engineering projects.
- Collaborative and dynamic work environment.
- Competitive compensation and benefits.
- Professional growth opportunities with exposure to the latest technologies.
-
Gcp Data Engineer
2 weeks ago
Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole : GCP Data EngineerExperience : 10 to 15 YearsWork Mode : HybridLocation : HyderabadJob Overview:We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing,...
-
Gcp Data Engineer
1 week ago
Hyderabad, Telangana, India Egen (Formerly SpringML) Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Overview: We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working...
-
Gcp Data Engineer
1 week ago
Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) &...
-
GCP Data Engineer
2 days ago
Hyderabad, Telangana, India Zennial Pro Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title:GCP Data Engineer Location: Hyderabad / Pune Experience: 4+ YearsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines on Google Cloud Platform (GCP) .Work on BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions for data ingestion, transformation, and analytics.Develop ETL/ELT processes ensuring data quality,...
-
GCP Data engineer
10 hours ago
Hyderabad, Telangana, India RSNGINFO SOLUTIONS Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Summary:We are seeking a skilled GCP Data Engineer / Developer to design, build, and optimize scalable data pipelines and applications on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with BigQuery, PySpark, and Airflow DAGs, with added advantage if they possess Java and ReactJS development experience for...
-
GCP Data Engineer
1 week ago
Hyderabad, Telangana, India Synechron Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearGCP Data Engineer | Cloud Data Pipelines, Python, BigQuery, Agile Methodology Job Summary Synechron is seeking a highly skilled GCP Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data solutions leveraging Google Cloud Platform (GCP) technologies. Your expertise will support the...
-
GCP Data Engineer
2 days ago
Hyderabad, Telangana, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...
-
GCP Data Engineer
1 week ago
Hyderabad, Telangana, India Synechron Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob SummarySynechron is seeking a highly skilled GCP Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data solutions leveraging Google Cloud Platform (GCP) technologies. Your expertise will support the organization's data infrastructure, enabling scalable analytics, data processing, and...
-
GCP Data Engineer
3 days ago
Hyderabad, Telangana, India HSBC Full time ₹ 1,20,000 - ₹ 6,00,000 per yearSome careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and...
-
Lead GCP Data Engineer
1 week ago
Hyderabad, Telangana, India Incedo Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key ResponsibilitiesLead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP.Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...