Data Pipeline Engineer

20 hours ago

Bareilly, Uttar Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

Job Opportunity: Ingestion Specialist

We are seeking a skilled professional to develop and optimize data ingestion pipelines.

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support efficient ingestion workflows.

Key Responsibilities:
  • Design, develop, and maintain data ingestion pipelines for integrating multiple sources into cloud-based platforms.
  • Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with technical teams to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with cloud-based platforms, such as AWS, Azure, or GCP.
  • Proficiency in programming languages, including Python, Scala, or SQL.
  • Familiarity with streaming data ingestion technologies, like Kafka or Kinesis.
  • Strong problem-solving and analytical skills.
Preferred Qualifications:
  • Background in infrastructure as code (IaC) using Terraform or Helm.
  • Knowledge of data governance and security best practices.

Benefits include working with a talented team of professionals and opportunities for growth and development.

  • Advanced Data Pipeline Engineer

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeBlockchain Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Backend Developer Role SummaryThe role involves building robust data pipelines that power real-time pricing engines, decoding smart contract events, and implementing pricing logic from decentralized exchanges (DEXs).Job Description:We are seeking a skilled Backend Developer to join our team. The ideal candidate will have experience in Go or Rust, a strong...

  • Data Pipeline Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataintegration Full time ₹ 15,00,000 - ₹ 30,00,000

    ETL Developer Job DescriptionWe are seeking an experienced ETL developer to design and develop complex data processing systems.The ideal candidate will have hands-on experience with data integration tools and a strong understanding of SQL, UNIX, and scripting languages.Prior experience with cloud-based data platforms is also highly valued.This role involves...

  • Unlock Scalable Data Pipelines with Expert Data Engineering Skills

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time US$ 12,00,000 - US$ 18,00,000

    Data Engineering RoleRole: Data Engineer – Microsoft Fabric and Azure Synapse4-5 years of experience in Synapse and expertise in its fundamentals.Hands-on experience with close to 1 year in Microsoft Fabric.You will be working on designing and implementing scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and...

  • Chief Data Pipeline Developer

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering ProfessionalWe are seeking a highly skilled professional to lead the development and maintenance of robust data pipelines for structured and unstructured data.Key Responsibilities:Hold a bachelor's or master's degree in Computer Science, Data Science, Engineering, or a related field with 3+ years of experience.Proven expertise in working...

  • Senior Python Data Pipeline Specialist

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Freelance Data Engineer – Python\Data Engineering Expertise RequiredThreatXIntel is a cyber security company that protects businesses and organizations from cyber threats.We offer customized and affordable solutions tailored to meet the specific needs of our clients, ensuring that businesses of all sizes have access to high-quality cyber security...

  • Lead Data Pipeline Specialist

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeTester Full time ₹ 15,00,000 - ₹ 25,00,000

    About this position :We are seeking a highly skilled ETL and Power BI Tester to join our team. As an experienced professional, you will be responsible for ensuring the accuracy, integrity, and performance of ETL Pipelines deployed into Azure cloud environments.The role involves developing and automating comprehensive test cases to validate data flows,...

  • Technical Lead for Data Pipelines

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeDataPlatformEngineer Full time US$ 1,25,000 - US$ 1,75,000

    Job OverviewWe are seeking a seasoned Technical Leader to spearhead the development and operation of production-grade data pipelines. As a Lead Data Platform Engineer, you will be responsible for setting technical direction, running design reviews, coaching engineers, and coordinating work across time zones.Key Responsibilities:Data Pipeline Engineering:...

  • High-Performance Data Pipeline Specialist

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Databricks Data Engineer Job DescriptionWe are seeking a highly skilled Senior Databricks Data Engineer to design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.The ideal candidate will have strong hands-on experience in Databricks and AWS, with a solid understanding of PySpark, CI/CD pipelines, and...

  • Senior Data Pipeline Specialist

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining efficient data pipelines.The successful candidate will work closely with cross-functional teams to ensure data is clean, reliable, and accessible for analytics, reporting, and product innovation.Key Skills...

  • Distinguished Data Engineer

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Developer Job OverviewWe are seeking a skilled Big Data Engineer to join our team of data experts. This critical role involves designing, building, and maintaining robust data pipelines for high-volume financial data from various sources.Develop end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets.Integrate...