Data Pipeline Specialist

11 hours ago

mangalore, India beBeeData Full time

Data Pipeline SpecialistThe role involves creating and managing scalable data pipelines and ETL/ELT processes using various tools like Airflow, Airbyte, and PySpark.Effective collaboration with cross-functional teams is essential to ensure seamless data availability and integrity for multiple applications.Key Responsibilities:Design robust data pipelines to extract, transform, and load data from diverse sources.Utilize Airflow for orchestrating complex workflows and efficiently managing data pipelines.Collaborate with software engineers and analysts to guarantee data reliability and consistency across different systems.Implement high-performance data pipelines to extract, process, and load data in real-time.The ideal candidate should possess hands-on experience working with big data technologies, including AWS services such as S3, RDS, and Lambda. Strong expertise in data modeling, ETL/ELT processes, and database management is necessary.Benefits of the Role:The successful Data Pipeline Specialist will have the opportunity to work on cutting-edge projects, develop technical skills, and contribute to the growth of our organization.What We Offer:We provide a dynamic work environment, opportunities for professional development, and a competitive compensation package.

  • Solutions Architect – Data Pipeline Specialist

    2 days ago

    mangalore, India beBeeData Full time

    Solutions Architect – Data Pipeline SpecialistAt the core of our Mobility DataOps ecosystem lies a complex network of data flows, tools, and processes. As a Solutions Architect – Data Pipeline Specialist, you will play a crucial role in designing and implementing the technical architecture of our projects.Your expertise will be essential in ensuring...

  • Data Pipeline Assurance Specialist

    5 days ago

    mangalore, India beBeeQuality Full time

    Job Title: QA Consultant – ETLDescription:We are seeking an experienced professional to play a crucial role in ensuring the quality and reliability of our data pipelines. As a QA Consultant – ETL, you will work closely with our integration teams to test upstream/downstream interfaces, validate JSON/XML schema structure, status codes, and pagination...

  • Data Pipeline Architect

    5 days ago

    mangalore, India beBeePlatformEngineer Full time

    Job TitleWe are seeking a highly skilled Platform Engineer to join our team.Key ResponsibilitiesData Pipeline Development: Develop scalable data pipelines using Python, Apache Spark, and Databricks.Notebook-Based Workflows: Create and manage notebook-based workflows for data processing, analysis, and automation.Cloud-Native Solutions: Implement and maintain...

  • Data Pipeline Architect

    3 days ago

    mangalore, India beBeeData Full time

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design, build, and own data pipelines that fuel large language model (LLM) development.Create robust, scalable, automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Implement rigorous data cleaning, deduplication, filtering, and normalization...

  • A Data Specialist Role

    5 days ago

    mangalore, India beBeeDataSpecialist Full time

    Data SpecialistA data specialist will make targeted enhancements to existing workflows and pipelines. The consultant will be responsible for designing and implementing a batch processing pipeline in a cloud-based environment, integrating image processing workflows and machine learning model deployment.This role supports the development of a robust data...

  • Senior Data Pipeline Tester

    5 days ago

    mangalore, India beBeeDataPipelineValidator Full time

    Seeking a skilled Data Pipeline Validator to ensure the accuracy and reliability of data pipelines, business intelligence reports, dashboards, and analytics solutions.Key ResponsibilitiesValidate and analyze data pipelines to ensure accuracy and performance.Test Business Intelligence (BI) reports and dashboards to ensure reliable results.Collaborate with...

  • Chief Data Pipeline Architect

    5 days ago

    mangalore, India beBeeDataEngineer Full time

    Job OverviewAs a Data Engineer, you will be responsible for designing and developing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills and expertise in ETL/ELT processes.The ideal candidate will have hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB....

  • Global Data Pipeline Expert

    4 days ago

    mangalore, India beBeeCloud Full time

    Job Opportunity:We are seeking a skilled Data Support Engineer to join our application development team.The ideal candidate will have a strong foundation in Unix system administration, a solid understanding of cloud-based data services (especially AWS), and hands-on experience with ETL pipelines and production support.This role plays a key part in ensuring...

  • Strategic Data Insight Specialist

    2 days ago

    mangalore, India beBeeData Full time

    Role OverviewWe seek a skilled Data Insight Specialist to lead our data strategy.This role is ideal for someone with strong technical skills, experience working with data platforms, and a deep understanding of business needs.You will work closely with cross-functional teams to design and implement scalable data solutions that drive strategic business...

  • Data Engineering Specialist

    5 days ago

    mangalore, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistJob Description:We are seeking a talented Data Engineering Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and developing secure, high-quality production code and data pipelines.This role offers hands-on experience with real-world big data activities,...