
Data Pipeline Architect
2 days ago
We are seeking an experienced professional to fill the role of Kafka Integration Specialist. The ideal candidate will have extensive knowledge in designing, developing, and integrating Apache Kafka solutions. Key responsibilities include creating and maintaining Kafka-based data pipelines, managing clusters, ensuring high availability and performance.
- Design and implement Kafka-based data pipelines that meet business requirements.
- Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies to ensure seamless data flow.
- Manage Kafka clusters for optimal performance, scalability, and high availability.
- Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
- Implement best practices for data streaming, including message serialization, partitioning, and replication.
- Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).
- Proficiency in programming languages like Java, Python, or Scala.
- Experience with distributed systems and data streaming concepts.
- Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.
- Expertise in creating and managing topics, partitions, and consumer groups.
- Hands-on experience with integration tools such as REST APIs, MQ, or ESB.
- Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.
- Experience with monitoring tools like Prometheus, Grafana, or Datadog is a plus.
- Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation is a plus.
- Knowledge of data serialization formats like Avro, Protobuf, or JSON is a plus.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
-
Data Pipeline Architect
7 days ago
Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000Job Overview:We are seeking a skilled professional to fill the role of Senior Data Engineer, responsible for designing and implementing data pipelines and extracting information from various sources.Key Responsibilities:Data Extraction and Parsing: Develop automated systems to extract relevant data from websites, ensuring accuracy and uptime.Pipeline...
-
Data Pipeline Architect
2 weeks ago
Gurgaon, Haryana, India beBeeEtldata Full time ₹ 20,00,000 - ₹ 25,00,000Job Opportunity:We are seeking an experienced professional to fill a pivotal role in our organization. As an ETL Developer, you will be responsible for designing and implementing data pipelines that drive business growth.About the Role:The ideal candidate will have hands-on experience with data warehouse design, data modeling, and ETL tools such as...
-
Chief Data Pipeline Architect
2 weeks ago
Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Data Engineer with at least 5 years of experience required to manage the entire data lifecycle, from extraction and transformation to loading and analysis. You'll leverage your skills in data transformation, database management, and scripting to build robust data pipelines in a fast-paced, agile environment.Main ResponsibilitiesData Transformation &...
-
Chief Data Pipeline Architect
2 weeks ago
Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Data Engineering RoleWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and performance tuning ETL processes using ETL tools such as SSIS/ADF in a multi-dimensional data warehousing environment.The successful candidate will work with cloud data platforms such as Azure...
-
Strategic Cloud Data Architect
1 week ago
Gurgaon, Haryana, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Cloud Data Architect RoleThe role of a Cloud Data Architect is to design and implement scalable, secure, and efficient cloud-native data architectures on AWS. This involves leading the development and deployment of robust data solutions across large-scale systems.Key Responsibilities:Designing end-to-end cloud-native data architectures on AWS for large-scale...
-
Data Pipeline Engineer
4 days ago
Gurgaon, Haryana, India BlackRock Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAbout this role Aladdin Data is at the heart of Aladdin and increasingly the ability to consume, store, analyze and gain insight from data has become a key component of our competitive advantage. The DOE team is responsible for the data ecosystem within BlackRock. Our goal is to build and maintain a leading-edge data platform that provides highly available,...
-
Cloud Data Architect
1 week ago
Gurgaon, Haryana, India beBeeSnowflake Full time ₹ 20,00,000 - ₹ 30,00,000Cloud Data ArchitectWe are seeking a highly skilled and experienced Cloud Data Architect to design, implement, and optimize our cloud data warehousing solutions.Lead the design and implementation of enterprise-wide Snowflake solutions, ensuring best practices in data modeling, architecture, and security.Collaborate with business stakeholders, data engineers,...
-
Data Architect
2 days ago
Gurgaon, Haryana, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000Seeking a seasoned Data Architect to spearhead the development and deployment of AI assistants. This role requires expertise in large language model orchestration, prompt engineering, and embedding pipeline management.Key Responsibilities:Develop and deploy Slack-based AI assistants leveraging Gemini models.Design and implement prompt templates tailored to...
-
Data Architect
1 week ago
Gurgaon, Haryana, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000Job Title: Data ArchitectWe are seeking a highly skilled and detail-oriented Data Architect to play a pivotal role in designing robust data processes for financial datasets.The successful candidate will be responsible for building and maintaining data ingestion pipelines, ensuring data quality, and enabling seamless access for quantitative research and...
-
Chief Data Architect
1 week ago
Gurgaon, Haryana, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000Job Details :The role of Data Engineer requires an individual with hands-on experience in Databricks to build scalable data pipelines and integrate them with cloud platforms. This position involves managing data governance using Unity Catalog, a crucial aspect of the job.Required Skills and Qualifications :Expertise in Databricks, either on AWS or Azure...