Data Pipeline Architect

6 days ago

Palakkad, Kerala, India beBeeETLDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

We are seeking a skilled professional to fill the role of an ETL Specialist with expertise in designing and optimizing complex data pipelines using Talend Open Studio.

Key qualifications for this position include 8 to 10 years of experience working with large datasets, proficiency in SQL and Python programming languages, as well as hands-on experience with cloud-based data storage solutions such as BigQuery and Google Cloud Storage.

The ideal candidate will possess strong analytical and problem-solving skills, be able to work independently, and have excellent communication and collaboration skills.

The selected candidate will be responsible for designing, developing, and deploying ETL pipelines using Talend Open Studio, as well as troubleshooting and debugging issues that may arise.

This is a remote contract position with a duration of 3 months. We are open to candidates from all over the world and offer a competitive compensation package.

  • Role: ETL Developer
  • Experience: 8-10 years
  • Work Timings: Flexible (remote)
  • Duration: 3 Months (Contract)

Mandatory Requirements:

  • Talend Data Integration: Design and optimize complex ETL pipelines, debugging, and deployment using TMC
  • BigQuery: Partitioning, clustering, federated queries, advanced SQL (CTEs, arrays, window functions)
  • Python: ETL scripting, automation, and integration with cloud data pipelines
  • PostgreSQL: PL/pgSQL functions, triggers, query optimization, materialized views
  • Cloud (GCP): Hands-on experience with Pub/Sub, Dataflow, Dataprep, and Google Cloud Storage
  • Version Control: Proficiency in Git/GitHub workflows with branching, PR reviews, and CI/CD using Jenkins

Nice to Have:

  • BigQuery ML: Experience with regression, classification, forecasting
  • Performance Optimization: Exposure to advanced performance optimization for BigQuery slots and reservations
  • Data Integration: Familiarity with offline-first data solutions and advanced integration strategies

  • Expert Data Pipeline Architect

    6 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:A Data Engineer is needed to design, build, and maintain large-scale data pipelines using Google Cloud Platform.Responsibilities:Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data in GCP.Create complex datasets based on business requirements.Construct 'big data' pipeline architecture.Identify...

  • Data Systems Architect

    5 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Systems ArchitectWe are seeking an experienced Data Systems Architect to join our team. As a Data Systems Architect, you will be responsible for designing, building, and maintaining efficient data pipelines.

  • Data Architect

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a data architect, you will design and develop large-scale data pipelines for ingestion, transformation, and storage. Your focus will be on creating efficient data architectures that enable business stakeholders to make informed decisions.

  • Chief Data Pipeline Engineer

    5 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Key Responsibilities:We are seeking a skilled Data Architect to develop and maintain data pipelines using Python and AWS (S3, Redshift, Lambda, Glue).Develop scalable data architectures using AWS services.Implement and optimize ETL processes for large datasets using Python and AWS Glue.Collaborate with cross-functional teams to design and implement data...

  • Senior Data Architect

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,30,000

    Unlock the Potential of Data EngineeringWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, building, and maintaining high-performance data pipelines that support advanced analytics and machine learning.Key Responsibilities:Lead the optimization and...

  • Data Pipeline Developer

    7 days ago

    Palakkad, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an Ingestion Specialist with expertise in data pipeline development and Kubernetes to fill a key role in our organization.This position requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.The ideal candidate will have hands-on experience with data pipelines,...

  • Senior Data Pipeline Specialist

    16 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer PositionLemongrass is seeking a skilled Cloud Data Engineer to design, develop, and maintain scalable data pipelines using cloud-native tools. The ideal candidate will have extensive experience with AWS, Azure, and GCP, as well as knowledge of data governance, security, and compliance best practices.">Key Responsibilities:Design, develop,...

  • Lead Data Architect

    15 hours ago

    Palakkad, Kerala, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Architect Job OpportunityWe are seeking an experienced Lead Data Architect to design and implement scalable data solutions that power analytics, reporting, and Member initiatives.This role is ideal for someone with deep expertise in ETL development, data modeling, and financial data domains, particularly within banking systems.Candidate will be...

  • Data Architect Specialist

    6 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Architect SpecialistAs a Data Architect Specialist, you will play a crucial role in designing and developing efficient data solutions.The role involves building complex data pipelines using Snowflake Tasks, Streams, and Stored Procedures to manage and process large datasets. This requires a deep understanding of data modeling and the ability to optimize...

  • Data Pipeline Specialist

    15 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering ProfessionalWe are seeking a skilled data engineer to join our analytics division.You will be part of our data analytics and business intelligence vertical, responsible for conceptualizing and owning the build out of problem-solving data marts for consumption by data science and business intelligence teams. You will evaluate design and...