Data Pipeline Specialist

14 hours ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineering Professional

We are seeking a skilled data engineer to join our analytics division.

  • You will be part of our data analytics and business intelligence vertical, responsible for conceptualizing and owning the build out of problem-solving data marts for consumption by data science and business intelligence teams. You will evaluate design and operational tradeoffs within systems.
  • Design, develop, and maintain robust data pipelines and ETL processes using data platforms for the organization's centralized data warehouse.
  • Create or contribute to frameworks that improve the efficacy of logging data, while working with the engineering team to triage issues and resolve them.
  • Validate data integrity throughout the collection process, performing data profiling to identify and comprehend data anomalies.
  • Influence product and cross-functional (engineering, data science, operations, strategy) teams to identify data opportunities to drive impact.
Required Skills and Qualifications

Experience & Education

  • Bachelor's degree in computer science, mathematics, a related field, or equivalent practical experience.
  • 5 years of experience coding with SQL or one or more programming languages (e.g., Python, Java, R, etc.) for data manipulation, analysis, and automation.
  • 5 years of experience designing data pipelines (ETL) and dimensional data modeling for synchronous and asynchronous system integration and implementation.
  • Experience in managing troubleshooting technical issues, and working with engineering and sales services teams.

Preferred qualifications:

  • Master's degree in engineering, computer science, business, or a related field.
  • Experience with cloud-based services relevant to data engineering, data storage, data processing, data warehousing, real-time streaming, and serverless computing.
  • Experience with experimentation infrastructure, and measurement approaches in a technology platform.
  • Experience with data processing software (e.g., Hadoop, Spark) and algorithms (e.g., MapReduce, Flume).

  • Data Pipeline Developer

    7 days ago

    Palakkad, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an Ingestion Specialist with expertise in data pipeline development and Kubernetes to fill a key role in our organization.This position requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.The ideal candidate will have hands-on experience with data pipelines,...

  • Data Pipeline Architect

    6 days ago

    Palakkad, Kerala, India beBeeETLDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a skilled professional to fill the role of an ETL Specialist with expertise in designing and optimizing complex data pipelines using Talend Open Studio.Key qualifications for this position include 8 to 10 years of experience working with large datasets, proficiency in SQL and Python programming languages, as well as hands-on experience with...

  • Senior Data Pipeline Specialist

    15 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer PositionLemongrass is seeking a skilled Cloud Data Engineer to design, develop, and maintain scalable data pipelines using cloud-native tools. The ideal candidate will have extensive experience with AWS, Azure, and GCP, as well as knowledge of data governance, security, and compliance best practices.">Key Responsibilities:Design, develop,...

  • Expert Data Pipeline Architect

    5 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:A Data Engineer is needed to design, build, and maintain large-scale data pipelines using Google Cloud Platform.Responsibilities:Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data in GCP.Create complex datasets based on business requirements.Construct 'big data' pipeline architecture.Identify...

  • Senior Data Engineer

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.The ideal candidate will have experience with data pipeline tools, cloud platforms, and data warehousing. They will...

  • Data Architecture Specialist

    7 days ago

    Palakkad, Kerala, India beBeeDataArchitecture Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Architecture SpecialistWe are seeking an experienced data architecture specialist to fill a short-term contract role.The ideal candidate will have 7+ years of experience in designing, implementing, and optimizing data pipelines using Azure Data Factory, as well as developing Databricks notebooks using SQL and Python.Data Pipeline Design:...

  • Lead Data Pipeline Developer

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to join our team in Mumbai. The ideal candidate will have strong experience in PySpark and hands-on expertise in building scalable data pipelines.The successful candidate will work on designing, developing, and maintaining batch and streaming data pipelines using Spark SQL, DataFrame, and RDD APIs. They...

  • Data Engineer for Scalable Data Pipelines

    11 hours ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    We are seeking a highly skilled Data Engineer to lead the design and development of scalable data pipelines. The ideal candidate will have expertise in data engineering principles, with a strong understanding of cloud-based data platforms.Key Responsibilities:Design and develop efficient data pipelines using Airflow and SnowflakeCollaborate with...

  • Senior Data Pipeline Engineer

    4 days ago

    Palakkad, Kerala, India beBeeETL Full time ₹ 18,00,000 - ₹ 25,40,000

    Job OpportunitySeeking a highly skilled ETL Developer to design, develop, and maintain data pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.As an experienced ETL professional, you will be responsible for building and optimizing data flows for loading curated datasets into Snowflake, leveraging best practices for...

  • Senior Big Data Specialist

    5 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...