Data Pipeline Architect

3 days ago

Alwar, Rajasthan, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

We are seeking a highly skilled Data Ingestion Specialist to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred Qualifications:
  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Business Data Architect

    14 hours ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Role: Business Data ArchitectWe're seeking an experienced Business Data Architect to design and implement scalable data solutions that drive business growth. The ideal candidate has a strong background in data engineering, expertise in designing and building production-level data pipelines, and hands-on experience with large-scale data workflows.Key...

  • Expert Cloud Data Pipeline Architect

    3 days ago

    Alwar, Rajasthan, India beBeeCloudEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAre you a seasoned data expert looking to build and deploy scalable data pipelines on the cloud?We're seeking an experienced Senior AWS Data Engineer to lead our data engineering efforts, design and develop end-to-end data pipelines, and implement data processing and transformation workflows using Apache Spark and SQL.You will collaborate with...

  • Senior Data Solutions Architect

    5 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,44,00,000 - ₹ 2,16,00,000

    Our organization is seeking a skilled professional to design and implement data architecture and pipelines. This individual will work on multiple projects with GCP-Big Query and Data Proc technologies.The ideal candidate will be collaborative, organized, and think outside the box. They will also be passionate about making a difference through...

  • Data Pipeline Specialist

    5 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 5,00,000 - ₹ 10,00,000

    Job Title: Data EngineerWe are seeking a skilled professional to design, build, and optimize scalable data pipelines.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Key Responsibilities:Design, build, and maintain ETL/ELT...

  • Enterprise Data Architect

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectRole Summary: We are seeking a highly motivated and detail-oriented professional to join our team as a Data Architect.We design, build, and maintain scalable data infrastructure that supports real-time and batch data processing. You will collaborate with cross-functional teams, including data scientists, analysts, and software...

  • Data Architect Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title:A data architect is needed to design and develop a scalable big data pipelineWe are seeking an experienced professional to lead the implementation of a high-performance big data platform. The ideal candidate will have in-depth knowledge of distributed systems, cloud computing, and data warehousing.Key Responsibilities:Design and develop a scalable...

  • Building Data Pipelines

    4 days ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering SpecialistAs a Data Engineering Specialist, you will be responsible for designing and developing data pipelines to ingest data from various sources into our enterprise-wide data repository.Main Responsibilities:Architecture and Development: Utilize cloud-based services such as AWS Lambda, Amazon DMS, and Amazon Glue for data ingestion and...

  • Data Pipeline Tester

    3 days ago

    Alwar, Rajasthan, India beBeeTestEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Senior Test EngineerAs a key member of our team, you will play a crucial role in ensuring the accuracy, integrity, and performance of ETL pipelines deployed into Azure cloud environments.Design and develop comprehensive test cases to validate data flows, transformations, and system behaviors using Python scripting and Pytest framework.Validate data...

  • Transformative Data Architect

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    At Foodsmart, we are transforming the way people access and enjoy healthy food. Our mission is to make nutritious food accessible and affordable for everyone, regardless of economic status.We achieve this by fostering healthier food choices, driving lasting behavior change, and delivering long-term health outcomes through our personalized, digital...

  • PostgreSQL Data Architect

    15 hours ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a highly skilled Data Engineer with expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes.The ideal candidate will design and implement a scalable PostgreSQL-based data warehouse, manage a data lake on AWS infrastructure, and leverage open-source technologies to drive business outcomes.Key...