Big Data Engineer
1 week ago
- Deploy and upgrade high-availability Kafka clusters ensuring fault tolerance.
- Automate the installation and configuration of production-grade Kafka clusters using tools such as Ansible and Chef.
- Troubleshoot critical issues optimizing Kafka performance and minimizing downtime.
- Configure MirrorMaker for data replication between two data centers to ensure effective disaster recovery.
- Deploy and manage real-time monitoring and management systems on a Kubernetes cluster.
- Integrate Schema Registry and deploy multiple connectors to facilitate seamless data flow.
- Onboard new users by managing permissions, creating topics, and implementing end-to-end security with SSL/TLS.
- Design and manage infrastructure to enhance message processing efficiency.
- Conduct testing to optimize partitioning, replication, and retention policies.
Bachelor's Degree in Computer Science or related field required.
Required Skills
Kafka clusters, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.
Experience
Minimum 3 years of experience working with Kafka and related technologies.
-
Big Data Engineer
7 minutes ago
Bhavnagar, Gujarat, India beBeeDataiku Full time ₹ 18,00,000 - ₹ 25,00,000Job Title: Data Science and Engineering ProfessionalOverview of the Role:We are seeking a skilled professional to lead our Big Data Platform efforts. The ideal candidate will have extensive experience in managing big data platforms, handling day-to-day operations, and troubleshooting complex issues.Key Responsibilities:Administer and monitor Big Data...
-
Advanced Big Data Engineer
4 days ago
Bhavnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,12,000Job DescriptionWe are seeking a seasoned Big Data Developer to drive the design, implementation, and maintenance of large-scale data processing systems.The ideal candidate will have 2+ years of experience in Big Data development with expertise in Scala, AWS, and Python or Java.Design and implement scalable data processing systems using Big Data...
-
Data Engineer for Big Data Solutions
7 days ago
Bhavnagar, Gujarat, India beBeeInformatica Full time ₹ 1,00,00,000 - ₹ 1,50,00,000Job DescriptionThe ideal candidate will have a proven track record of designing and developing scalable ETL workflows using Informatica BDM/DEI.They will integrate data from structured and unstructured sources, including big data platforms, and apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaboration with data...
-
Chief Data Architect – Big Data Platforms
1 week ago
Bhavnagar, Gujarat, India beBeeBigDataLeader Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Lead Big Data Engineering TeamWe are seeking an experienced Lead to spearhead a team of data engineers working on large-scale distributed data systems. The ideal candidate will have deep expertise in Big Data platforms and cloud technologies.Key Responsibilities:Grow and lead a team of data engineers to design, develop, and deliver scalable data pipelines...
-
Big Data Specialist
7 days ago
Bhavnagar, Gujarat, India beBeeClustering Full time ₹ 12,00,000 - ₹ 15,00,000Job Title: Big Data SpecialistWe are seeking an experienced professional with a strong background in big data administration to lead our team.Design, build, and manage complex big data architectures to ensure high performance and uptime.Migrate large datasets between different platforms while minimizing downtime.Perform performance tuning and optimization of...
-
Data Scientist with Big Data Expertise
1 week ago
Bhavnagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data Scientist with Big Data ExpertiseWe are seeking a skilled and experienced data scientist to join our team.The ideal candidate will have expertise in big data, including data ingestion from disparate sources onto big data platforms.Key Skills:PySparkHiveBenefits:A chance to work on exciting big data projectsA collaborative and dynamic work...
-
Big Data Expert
4 days ago
Bhavnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Title:Big Data Analyst and DeveloperJob Description:We are seeking a skilled Big Data specialist to design, develop, and implement data pipelines using latest technologies such as PySpark, Scala Spark, and Java Spark SQL. The ideal candidate will have experience in data structures and algorithms, with strong understanding of data transformation logic.The...
-
Big Data Platform Architect
1 week ago
Bhavnagar, Gujarat, India beBeeDataLeader Full time ₹ 25,00,000 - ₹ 35,00,000Job DescriptionSigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with leading organizations across sectors such as retail, finance, life sciences, and manufacturing to solve complex business challenges. Our global team specializes in cloud data modernization,...
-
Senior Big Data Solutions Architect
1 week ago
Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Big Data ArchitectWe are seeking a skilled Big Data Architect to lead our data-driven initiatives and design scalable data pipelines. This role involves collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL workflows using Apache Spark, Python,...
-
Big Data Specialist
1 week ago
Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineering SpecialistLocation: Flexible nationwide remote or hybrid, choice of the candidate.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid We are looking for a highly skilled Big Data Engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka. The ideal...
