Cloud Data Engineer with Expertise in ETL Pipelines

2 days ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

We are seeking an experienced Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform (GCP).

The ideal candidate will have extensive experience in GCP, specifically with GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, and Python programming language.

You will work closely with cross-functional teams to architect and implement scalable data pipelines that extract, transform, and load data from various sources into BigQuery for analysis and business insights.

In this role, you will also be responsible for implementing best practices for data ingestion, data quality, and data governance, as well as collaborating with stakeholders to identify business requirements and develop solutions to meet those needs.

The successful candidate will have strong knowledge of databases, including SQL and NoSQL, and experience working with cloud-based databases.

This is a challenging and rewarding opportunity for someone who enjoys working with large datasets, designing complex data systems, and solving complex problems.

Responsibilities:

  • Design, build, and maintain large-scale data processing systems on GCP
  • Develop and implement data pipelines using GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, and Python
  • Work closely with cross-functional teams to architect and implement scalable data systems
  • Implement best practices for data ingestion, data quality, and data governance
  • Collaborate with stakeholders to identify business requirements and develop solutions

Requirements:

  • 4+ years of experience in GCP, specifically with GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, and Python programming language
  • Strong knowledge of databases, including SQL and NoSQL
  • Experience working with cloud-based databases
  • Excellent problem-solving skills and attention to detail
  • Bachelor's degree in Computer Science or related field

What We Offer:

  • A competitive salary and benefits package
  • Opportunities for professional growth and development
  • A dynamic and collaborative work environment
  • Flexible working hours and remote work options

If you are interested in this exciting opportunity, please submit your resume to prachi@iitjobs.com. We look forward to hearing from you

  • ETL Data Engineer with Expertise in Scalable Data Pipelines

    2 weeks ago

    Kozhikode, Kerala, India beBeeetldeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: ETL Developer - DataStage, AWS, SnowflakeOverview of the PositionWe are seeking a skilled and motivated ETL developer to join our team. You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Responsibilities

  • Etl Engineer

    2 days ago

    Kozhikode, Kerala, India Eficaz HR Services Private Limited Full time

    Role DescriptionThis is a full-time role for an ETL Engineer with one of our renowned client for Pune location.The ETL Engineer will be responsible for designing, deploying, and managing ETL processes to integrate data from various sources.Daily tasks include using ETL tools, performing data modeling, ensuring data quality, and providing analytical...

  • Cloud-Based Data Pipeline Specialist

    4 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerDomain: Cloud-based SolutionsOverview:Leading organizations are seeking skilled data engineers to design, build, and manage robust data pipelines that power cloud-based solutions.Key Responsibilities:Design, develop, and maintain ETL/ELT pipelines to process structured, unstructured, and streaming data in the cloud.Leverage cloud...

  • Senior Data Pipeline Specialist

    5 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Data Engineering PositionWe are seeking a highly skilled Data Engineer to fill this critical role.The ideal candidate will have a strong background in data engineering, with a proven track record of designing and implementing scalable data pipelines on Google Cloud Platform (GCP).Design and implement highly scalable, reliable, and secure data pipelines...

  • Senior Data Pipeline Specialist

    23 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Are you a data pipeline specialist with a passion for driving business growth through data-driven insights? As a seasoned ETL Engineer, you will play a key role in designing and deploying large-scale data pipelines to support our business intelligence initiatives.Key Responsibilities:Design and Develop Scalable ETL PipelinesWork extensively with SQL to...

  • Cloud Data Engineer Opportunity

    3 days ago

    Kozhikode, Kerala, India beBeeCloudEngineer Full time ₹ 16,15,797 - ₹ 20,39,878

    Job DescriptionAs a Cloud Data Engineering expert, you will design and implement scalable data pipelines using GCP services. This includes orchestrating complex workflows using Apache Airflow and other tools, processing large datasets using ETL techniques and Big Query, and developing and maintaining RESTful or GraphQL APIs for data integration.Key...

  • Cloud Data Solutions Architect

    7 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a highly skilled Cloud Data Engineer, you will play a key role in designing and implementing scalable data pipelines using cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, and GCP Dataflow.You will be responsible for architecting and implementing data lakes and data warehouses on cloud platforms, including AWS, Azure, and GCP....

  • Data Pipeline Quality Assurance Specialist

    2 weeks ago

    Kozhikode, Kerala, India beBeeSeniorTestEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About our company:We are a leading provider of business transformation services, leveraging technology to address a wide range of business needs.Our goal is to unleash human energy through technology for an inclusive and sustainable future.We provide various services, including consulting, technology, professional, and outsourcing services.Job Summary:The...

  • Cloud Data Solutions Architect

    5 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Data Engineer OpportunityJob OverviewWe are seeking a skilled Cloud Data Engineer to join our team. The ideal candidate will have a strong background in cloud platforms and be responsible for designing, implementing, and maintaining robust data pipelines.Key Responsibilities:Design, develop, and maintain scalable ETL pipelines using cloud-native tools...

  • Cloud Data Architect

    1 day ago

    Kozhikode, Kerala, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Cloud Data ArchitectAbout the RoleWe are seeking a skilled Cloud Data Architect to lead our team in designing, implementing, and maintaining robust data pipelines and scalable data lakes.ResponsibilitiesDesign and Develop Scalable ETL Pipelines:Utilize cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, and GCP Dataflow to...