
Data Pipeline Architect
1 week ago
Key Responsibilities:
- We're seeking an experienced Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.
- The successful candidate will implement and maintain CI/CD pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- Ensure data integrity, security and compliance throughout the ingestion process.
- Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
- Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
- Proven experience in data ingestion and pipeline development.
- Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps etc.
- Strong knowledge of Kubernetes and container orchestration.
- Experience with Databricks Spark and data lake architectures.
- Proficiency in Python Scala or SQL for data processing.
- Familiarity with cloud platforms such as AWS Azure or GCP.
- Strong problem-solving and analytical skills.
- Preferred Qualifications:
- Experience with Infrastructure as Code Terraform Helm etc.
- Background in streaming data ingestion Kafka Kinesis etc.
- Knowledge of data governance and security best practices.
-
Data Architect
3 days ago
Bellary, Karnataka, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Job Title:Data ArchitectSynopsis:We are seeking a Data Architect to join our team and help design, build, and maintain backend components, APIs, and integrations.About the Role:Responsibilities:Design and build scalable, secure, and high-performance data pipelines that integrate with various systems and technologies.Develop architecture for data flows across...
-
Cloud Data Architect
21 hours ago
Bellary, Karnataka, India beBeeData Full time US$ 1,50,000 - US$ 2,50,000About our companyWe are a software-enabled services provider focused on delivering superior, highly automated managed IT services to enterprise customers worldwide.Job Role:A cloud data engineer is required to design and develop scalable ETL pipelines using cloud-native tools. They will also be responsible for architecting and implementing data lakes and...
-
Data Pipeline Specialist
3 days ago
Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000Job SummaryWe are seeking a talented Data Engineer to join our team. As a Data Engineer, you will design, build, and maintain production-level data pipelines that handle large amounts of structured and unstructured data.Design and implement scalable data pipelines using AWS services such as S3, EC2, RDS, DynamoDB, Athena, and Redshift.Collaborate with...
-
Data Pipeline Specialist
6 days ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Engineering Role OverviewWe are seeking a skilled Data Engineer to join our organization.As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines to ingest data from various sources into a data warehouse.Design and develop optimized data pipelines to extract data from databases and flat...
-
Data Pipeline Tester
5 days ago
Bellary, Karnataka, India beBeeSenior Full time ₹ 15,00,000 - ₹ 20,00,000Job Summary:We are seeking a skilled Senior Test Engineer to join our team. The ideal candidate will have experience in ETL and Power BI testing, with a strong background in Azure Data Factory, Python, and Pytest.The successful candidate will be responsible for designing and developing comprehensive test cases to validate data flows, transformations, and...
-
Data Pipelines Specialist
1 week ago
Bellary, Karnataka, India beBeeTechnicalConsultant Full time ₹ 80,00,000 - ₹ 1,20,00,000Job OverviewThe role involves configuring, integrating, and optimizing financial data workflows within a platform. Collaboration with cross-functional teams is essential for designing reusable and scalable solutions, implementing automation, and enhancing system performance across key investment operations.This position demands hands-on expertise in tools...
-
Chief Data Architect
4 days ago
Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Unlock the Power of Data Engineering\Entities In this pivotal role, you will be instrumental in architecting and implementing robust data pipelines that fuel business growth. Working closely with cross-functional teams, you will identify opportunities for data acquisition, develop analytical tools and programs, and collaborate to improve data models.Key...
-
Data Solutions Architect
1 week ago
Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 12,62,926 - ₹ 25,14,151We are seeking a highly skilled Data Solutions Architect with 4+ years of experience in designing, building, and optimizing large-scale data processing workflows. The ideal candidate will have hands-on experience with ETL pipeline design, development, and maintenance using Azure Data Factory, Databricks, and Spark.Key ResponsibilitiesDesign and develop...
-
Building Scalable Data Pipelines
23 hours ago
Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. In this role, you will design and build scalable data pipelines using Google Cloud Platform (GCP) services.The ideal candidate will have experience with GCP data processing technologies such as Cloud Functions, Cloud Run, Pub/Sub, BigQuery, and Cloud Storage. You will...
-
Etl Data Architect
6 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title:Senior ETL Developer (Informatica BDM/DEI)Key Responsibilities:Design and develop scalable data pipelines using Informatica BDM/DEI.Integrate data from structured and unstructured sources including big data platforms.Apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaborate with data architects and...