Data Pipeline Specialist

2 days ago

Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Data Pipeline Specialist

About the Role:

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining production-level data pipelines that handle large volumes of structured and unstructured data.

Key Responsibilities:

  • Design and implement end-to-end ETL/ELT processes to ensure reliability, scalability, and high availability.
  • Work with AWS services (S3, EC2, RDS, DynamoDB, Athena, Redshift, etc.) to power large-scale data workflows.
  • Collaborate closely with AI/ML teams to support model training, retrieval-augmented generation (RAG), and analytics pipelines.
  • Continuously monitor, optimize, and improve data workflows for performance and cost efficiency.
  • (Nice to have) Use Apache Airflow or similar orchestration tools to manage workflows.

Requirements:

  • 1–2 years of professional experience as a Data Engineer (or related role).
  • Proven experience building and running production pipelines at terabyte scale
  • Proficiency with Python and SQL for data engineering.
  • Strong knowledge of AWS cloud services and big data best practices.
  • Bonus: Airflow, Spark, or other orchestration/processing frameworks.
  • A self-starter who thrives in a fast-moving startup environment.

What We Offer:

  • Work on real, production-scale data problems from day one.
  • Be part of a fast-growing AI startup with global reach.
  • Collaborate with a world-class team across AI, data, and product.

  • Database Data Pipeline Specialist

    6 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 25,17,500 - ₹ 25,45,000

    ETL/ Database Engineer / Tester Position">We are seeking an experienced professional to design, develop and implement ETL processes and data pipelines.The ideal candidate will have a strong understanding of ETL concepts and data warehouse testing methodologies. They should be proficient in RDBMS: MySQL, Oracle SQL, and have hands-on experience with SSIS (SQL...

  • Expert Azure Data Pipelines Consultant

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    At ThreatXIntel, we are dedicated to protecting businesses and organizations from cyber threats. Our proactive approach to security involves continuously monitoring and testing digital environments to identify vulnerabilities.We are seeking an experienced Azure Data Factory (ADF) Specialist to support our data integration and ETL needs. The ideal consultant...

  • Advanced Data Pipeline Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer Position", "We are seeking an experienced Data Engineer with strong expertise in Python and AWS services to design, develop, and optimize data pipelines.""

  • Data Specialist

    4 days ago

    Shimoga, Karnataka, India beBeeData Full time US$ 80,000 - US$ 1,00,000

    Job Title: Data SpecialistWe are seeking an experienced data specialist to lead our data infrastructure initiative.Key Responsibilities:Design and develop scalable data pipelines using modern technologies.Develop high-quality code for efficient data processing and analysis.Utilize programming skills for building robust software applications.Requirements:At...

  • High-Performance Data Pipeline Specialist

    6 days ago

    Shimoga, Karnataka, India beBeePerformance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerThis role is ideal for a skilled professional who can design, build, and maintain high-performance data pipelines. Key Responsibilities: Design and implement scalable batch processing systems using Python and big data technologies Optimize database performance, focusing on slow-running queries and latency improvements Use...

  • Data Development Specialist

    4 days ago

    Shimoga, Karnataka, India beBeeDataDevelopment Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Development SpecialistJob Description:We are seeking an accomplished data development specialist to take on the key challenge of developing and maintaining high-performance data pipelines, collaborating with analytics and business teams, and implementing best practices to monitor data quality.Develops and maintains scalable data pipelines to...

  • Cloud Data Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeCloudData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data SpecialistAbout the Role:We are seeking a highly skilled Cloud Data Specialist to collaborate with data science teams and implement complex algorithms and analytical solutions.Collaborate with cross-functional teams to design and develop scalable data pipelines.Develop predictive models to drive actionable insights for business...

  • Machine Learning Data Pipeline Specialist

    1 week ago

    Shimoga, Karnataka, India beBeeMachineLearning Full time ₹ 9,00,000 - ₹ 12,00,000

    MLOps EngineerWe're an end-to-end MLOPs platform built by developers for developers.The ideal candidate will be a recent graduate who wants to create and fine-tune models from large amounts of raw information and optimize them. You will work with our team to build ML/DL data pipelines to extract valuable business insights, analyze trends, and help us make...

  • Lead Cloud Data Specialist

    5 hours ago

    Shimoga, Karnataka, India beBeeSoftwareEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistKey Responsibilities:Develop and Optimize Data Pipelines:Design Scalable Data Architectures:Perform Data Ingestion, Transformation, and Orchestration:Write and Optimize SQL Queries:Implement CI/CD Pipelines:Collaborate with Stakeholders:Ensure Data Governance, Security, and Compliance:Monitor and...

  • AI Data Specialist

    5 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    AI Data SpecialistWe are seeking a highly skilled and innovative AI Data Specialist to join our team. As an AI Data Specialist, you will be responsible for designing, developing, testing, and maintaining software components and machine learning pipelines.Key responsibilities include:Designing and implementing core components including memory, routing, cache,...