Data Pipeline Architect

1 week ago


Bellary, Karnataka, India beBeeDataPipeline Full time ₹ 8,00,000 - ₹ 15,00,000
Job Title: Data Pipeline Architect

Key Responsibilities:

  • We're seeking an experienced Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • The successful candidate will implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps etc.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks Spark and data lake architectures.
  • Proficiency in Python Scala or SQL for data processing.
  • Familiarity with cloud platforms such as AWS Azure or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred Qualifications:
  • Experience with Infrastructure as Code Terraform Helm etc.
  • Background in streaming data ingestion Kafka Kinesis etc.
  • Knowledge of data governance and security best practices.

  • Data Architect

    3 days ago


    Bellary, Karnataka, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title:Data ArchitectSynopsis:We are seeking a Data Architect to join our team and help design, build, and maintain backend components, APIs, and integrations.About the Role:Responsibilities:Design and build scalable, secure, and high-performance data pipelines that integrate with various systems and technologies.Develop architecture for data flows across...

  • Cloud Data Architect

    21 hours ago


    Bellary, Karnataka, India beBeeData Full time US$ 1,50,000 - US$ 2,50,000

    About our companyWe are a software-enabled services provider focused on delivering superior, highly automated managed IT services to enterprise customers worldwide.Job Role:A cloud data engineer is required to design and develop scalable ETL pipelines using cloud-native tools. They will also be responsible for architecting and implementing data lakes and...


  • Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job SummaryWe are seeking a talented Data Engineer to join our team. As a Data Engineer, you will design, build, and maintain production-level data pipelines that handle large amounts of structured and unstructured data.Design and implement scalable data pipelines using AWS services such as S3, EC2, RDS, DynamoDB, Athena, and Redshift.Collaborate with...


  • Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering Role OverviewWe are seeking a skilled Data Engineer to join our organization.As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines to ingest data from various sources into a data warehouse.Design and develop optimized data pipelines to extract data from databases and flat...


  • Bellary, Karnataka, India beBeeSenior Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:We are seeking a skilled Senior Test Engineer to join our team. The ideal candidate will have experience in ETL and Power BI testing, with a strong background in Azure Data Factory, Python, and Pytest.The successful candidate will be responsible for designing and developing comprehensive test cases to validate data flows, transformations, and...


  • Bellary, Karnataka, India beBeeTechnicalConsultant Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job OverviewThe role involves configuring, integrating, and optimizing financial data workflows within a platform. Collaboration with cross-functional teams is essential for designing reusable and scalable solutions, implementing automation, and enhancing system performance across key investment operations.This position demands hands-on expertise in tools...


  • Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock the Power of Data Engineering\Entities In this pivotal role, you will be instrumental in architecting and implementing robust data pipelines that fuel business growth. Working closely with cross-functional teams, you will identify opportunities for data acquisition, develop analytical tools and programs, and collaborate to improve data models.Key...


  • Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 12,62,926 - ₹ 25,14,151

    We are seeking a highly skilled Data Solutions Architect with 4+ years of experience in designing, building, and optimizing large-scale data processing workflows. The ideal candidate will have hands-on experience with ETL pipeline design, development, and maintenance using Azure Data Factory, Databricks, and Spark.Key ResponsibilitiesDesign and develop...


  • Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. In this role, you will design and build scalable data pipelines using Google Cloud Platform (GCP) services.The ideal candidate will have experience with GCP data processing technologies such as Cloud Functions, Cloud Run, Pub/Sub, BigQuery, and Cloud Storage. You will...

  • Etl Data Architect

    6 days ago


    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Senior ETL Developer (Informatica BDM/DEI)Key Responsibilities:Design and develop scalable data pipelines using Informatica BDM/DEI.Integrate data from structured and unstructured sources including big data platforms.Apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaborate with data architects and...