Estuate - GCP Data Engineer - Big Data

3 weeks ago

Hyderabad, India Estuate Software Pvt Ltd Full time

Job Title : Data Engineer / Integration EngineerJob Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.Key Responsibilities : - Design, build, and maintain scalable data pipelines and workflows.- Develop and optimize ETL/ELT processes using Python and workflow automation tools.- Implement and manage data integration between various systems, including APIs and Oracle EBS.- Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.- Utilize Apache Spark or similar big data frameworks for efficient data processing.- Develop robust API integrations for seamless data exchange between applications.- Ensure data accuracy, consistency, and security across all systems.- Monitor and troubleshoot data pipelines, identifying and resolving performance issues.- Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.- Document data workflows, processes, and best practices for future reference.Required Skills & Qualifications : - Strong proficiency in Python for data engineering and workflow automation.- Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).- Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).- Expertise in big data processing frameworks, such as Apache Spark.- Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data.- Strong problem-solving skills and ability to optimize data pipelines for performance.- Experience working in an agile environment with CI/CD processes.- Strong communication and collaboration skills.Preferred Skills & Nice-to-Have : - Experience with Ascend.io platform for data pipeline automation.- Knowledge of SQL and NoSQL databases.- Familiarity with Docker and Kubernetes for containerized workloads.- Exposure to machine learning workflows is a plus.Why Join Us?- Opportunity to work on cutting-edge data engineering projects.- Collaborative and dynamic work environment.- Competitive compensation and benefits.- Professional growth opportunities with exposure to the latest technologies. (ref:hirist.tech)

  • Estuate - Incorta Developer

    4 days ago

    Hyderabad, Telangana, India Estuate, Inc. Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    DescriptionNo. of Positions : 1.Relevant Experience :3 to 6 Years.Experience :3+ Years 4+ Years 5+ Years.Job Location :Hyderabad.Job Type :Contract (3 4 months).Work Timing :General Shift.Company OverviewAbout Estuate :At Estuate, more than 400 uniquely talented people work together, to provide the world with next-generation product engineering and IT...

  • Estuate - Incorta Developer

    4 days ago

    Hyderabad, India Estuate Software Pvt Ltd Full time

    Description :No. of Positions : 1.Relevant Experience : 3 to 6 Years.Experience : 3+ Years 4+ Years 5+ Years.Job Location : Hyderabad.Job Type : Contract (3 4 months).Work Timing : General Shift.Company overview :About Estuate :- At Estuate, more than 400 uniquely talented people work together, to provide the world with next-generation product engineering...

  • Gcp data engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai / Hyderabd / Bangalore / Pune / Gurgoan/ Noida / NCRExperience: 5 to 10 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions.Requirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of Big Data and Hadoop...

  • 15h Left: Estuate

    4 weeks ago

    Hyderabad, India Estuate, Inc. Full time

    Job Description of Positions: 1. Relevant Experience: 10+ years. Job Location: Hyderabad. Job Type: Full Time. Work Timing : US EST Time Zone. Work Mode : Hybrid. Company overview : About Estuate. At Estuate, more than 400 uniquely talented people work together, to provide the world with next-generation product engineering and IT enterprise services. We help...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Required Technical Skill Set - GCP, Python, SQL, Big Query, ETL Data Pipeline Location of Requirement - Chennai, Kochi, Bangalore,HYD,Pune Must-Have Competencies , Python, Pandas, NumPy SQL, Data Warehouse concept GCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions) Docker, Kubernetes, GitHub Good...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Required Technical Skill Set - GCP, Python, SQL, Big Query, ETL Data PipelineLocation of Requirement - Chennai, Kochi, Bangalore,HYD,Pune Must-Have Competencies ,Python, Pandas, NumPySQL, Data Warehouse conceptGCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions)Docker, Kubernetes, GitHubGood...

  • System Admin

    1 hour ago

    Hyderabad, India Estuate Full time

    No. of Positions: 2- Relevant Experience: 2 to 6 Years- Job Location: Hyderabad- Job Type: Full Time- Work Timing: Rotational Shift- Work Module: Work from OfficeCompany overview: About Estuate At Estuate, more than 400 uniquely talented people work together, to provide the world with next-generation product engineering and IT enterprise services. We help...

  • Estuate - Senior Manager/Lead - IT Offshore Global Supply Chain

    3 weeks ago

    Hyderabad, India Estuate, Inc. Full time

    Senior Manager - IT Offshore Global Supply Chain Lead of Positions: 1.Relevant Experience: 10 to 15 Years.Experience: 10+ Years 11+ Years 12+ Years 13+ Years 14+ Years.Job Location: Hyderabad.Job Type: Full Time.Work Timing: General Shift (US EST time zone).Work Mode: Hybrid.Company overview: About Estuate.At Estuate, more than 400 uniquely talented people...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Gcp data engineer

    1 week ago

    Hyderabad, India Egen Full time

    We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various...