Senior Data Pipeline Specialist

12 hours ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Cloud Data Engineer Position

Lemongrass is seeking a skilled Cloud Data Engineer to design, develop, and maintain scalable data pipelines using cloud-native tools. The ideal candidate will have extensive experience with AWS, Azure, and GCP, as well as knowledge of data governance, security, and compliance best practices.

">
  • Key Responsibilities:
  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Required Skills and Qualifications:

The successful candidate will possess the following skills and qualifications:

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms: AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Strong experience with Spark and Scala for data processing.

Benefits:

Lemongrass offers the following benefits:

  • Remote working opportunities.
  • Flexibility in work schedule.
  • A subscription to A Cloud Guru and generous budget for certifications and resources.
  • State-of-the-art technology and tools.
  • Collaborative team environment.

Equal Opportunity Employer:

Lemongrass is an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

  • Senior Big Data Specialist

    2 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...

  • Data Pipeline Developer

    6 days ago

    Palakkad, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an Ingestion Specialist with expertise in data pipeline development and Kubernetes to fill a key role in our organization.This position requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.The ideal candidate will have hands-on experience with data pipelines,...

  • Senior Data Integrity Specialist

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Integrity SpecialistAbout the Role:We are seeking a seasoned Senior Data Integrity Specialist to join our team. In this role, you will be responsible for ensuring the accuracy and reliability of data pipelines deployed into cloud environments.Key Responsibilities:Design and develop comprehensive test cases to validate data flows,...

  • Data Pipeline Architect

    6 days ago

    Palakkad, Kerala, India beBeeETLDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a skilled professional to fill the role of an ETL Specialist with expertise in designing and optimizing complex data pipelines using Talend Open Studio.Key qualifications for this position include 8 to 10 years of experience working with large datasets, proficiency in SQL and Python programming languages, as well as hands-on experience with...

  • Data Pipeline Specialist

    11 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering ProfessionalWe are seeking a skilled data engineer to join our analytics division.You will be part of our data analytics and business intelligence vertical, responsible for conceptualizing and owning the build out of problem-solving data marts for consumption by data science and business intelligence teams. You will evaluate design and...

  • Senior Data Engineer

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.The ideal candidate will have experience with data pipeline tools, cloud platforms, and data warehousing. They will...

  • Senior Data Pipeline Engineer

    4 days ago

    Palakkad, Kerala, India beBeeETL Full time ₹ 18,00,000 - ₹ 25,40,000

    Job OpportunitySeeking a highly skilled ETL Developer to design, develop, and maintain data pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.As an experienced ETL professional, you will be responsible for building and optimizing data flows for loading curated datasets into Snowflake, leveraging best practices for...

  • Senior Data Integration Specialist

    6 days ago

    Palakkad, Kerala, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Integration SpecialistAbout the Role:We are seeking a highly skilled Senior Data Integration Specialist to join our team. In this role, you will be responsible for designing and implementing scalable solutions to manage data flows between various systems.Key Responsibilities:

  • Expert Data Pipeline Architect

    2 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:A Data Engineer is needed to design, build, and maintain large-scale data pipelines using Google Cloud Platform.Responsibilities:Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data in GCP.Create complex datasets based on business requirements.Construct 'big data' pipeline architecture.Identify...

  • Advanced Data Solutions

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data SpecialistJob Summary:We are seeking a highly skilled Senior Data Specialist to drive data-driven initiatives and develop scalable solutions. This role involves building efficient pipelines, working with streaming data, and collaborating with cross-functional teams to deliver high-quality outcomes.Key Responsibilities:Pipeline Development and...