
Big Data Specialist
4 days ago
We are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves working closely with cross-functional teams to ensure the reliability, scalability, and performance of data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes.
- Work with large datasets using Hadoop ecosystem tools (Hive, Spark).
- Build and optimize real-time and batch data processing solutions using Kafka and Spark Streaming.
- Write efficient, high-performance SQL queries to extract, transform, and load data.
- Develop reusable data frameworks and utilities in Python.
- Collaborate with data scientists, analysts, and product teams to deliver reliable data solutions.
- Monitor, troubleshoot, and optimize big data workflows for performance and cost efficiency.
Must-Have Skills
- Strong hands-on experience with Hive and SQL for querying and data transformation.
- Proficiency in Python for data manipulation and automation.
- Expertise in Apache Spark (batch and streaming).
- Experience working with Kafka for streaming data pipelines.
Good-to-Have Skills
- Experience with workflow orchestration tools (Airflow etc.)
- Knowledge of cloud-based big data platforms (AWS EMR, GCP Dataproc, Azure HDInsight).
- Familiarity with CI/CD pipelines and version control (Git).
-
Big Data Specialist
2 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000Big Data SpecialistGreetings from our team!We are seeking an experienced Big Data Specialist to join our team. As a key member, you will play a critical role in driving business growth through data-driven insights.This is an exceptional opportunity for a motivated and talented individual who thrives in a fast-paced environment. Our ideal candidate will have...
-
Big Data Infrastructure Specialist
5 days ago
Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 12,00,000 - ₹ 15,00,000Job Title:Big Data Infrastructure SpecialistJob Overview:We are seeking a skilled Big Data Infrastructure Specialist to design and implement scalable data infrastructure solutions.Key Responsibilities:Deploy and manage Hadoop clusters on Apache and CDHConfigure and secure Hadoop environments using Yarn and HiveDesign and implement data pipelines using Spark,...
-
Big Basket
1 hour ago
Bengaluru, Karnataka, India big basket Full timeWhat would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...
-
Big Data Engineering Specialist
6 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000Job OverviewThe role of a Data Solutions Engineer is to develop and implement large-scale data processing systems that can handle structured and unstructured data with real-time interpretation.Key ResponsibilitiesDesign and build scalable infrastructure for big data collection, analysis, and processing.Collaborate closely with cross-functional teams and...
-
Big Data Specialist
2 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data EngineerWe are seeking a detail-oriented and passionate professional to design and develop scalable data solutions using Python, PySpark, and SQL.Key Responsibilities:Create efficient and effective data pipelines using big data technologies like Hadoop, Spark, and Databricks.Implement APIs, integrations, and automation for large-scale...
-
Big Data Specialist
4 days ago
Bengaluru, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000Senior Data Solutions ArchitectWe're seeking an experienced data solutions architect to lead the design and development of scalable data architectures, pipelines and workflows for large volumes of structured and unstructured data.About the Role:This is a key leadership position that requires strong technical expertise in data engineering, cloud computing and...
-
Enterprise Big Data Strategist
2 days ago
Bengaluru, Karnataka, India beBeeBigData Full time US$ 1,80,000 - US$ 2,10,000Job TitleWe seek a seasoned Big Data Specialist to drive our company's innovative initiatives.Achieve industry-best outcomes by leveraging cutting-edge technologies and best practices.Bolster the team's capacity for innovation, scalability, and growth.About the RoleDevelop and implement strategic big data solutions that meet evolving business needs.Elevate...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Coders Brain Full timeJob DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...
-
Big Data Expert
6 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000Lead Data SpecialistWe are seeking a seasoned data expert to join our team as a Lead Data Specialist. In this role, you will be responsible for overseeing the development and implementation of scalable data pipelines and ETL processes that integrate data from multiple sources.Key Responsibilities:Design, build, and optimize data pipelines for batch and...
-
Big Data Developer
15 hours ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000The primary objective of this role is to design and develop data pipelines utilizing Big Data technologies. A deep understanding of Py Spark, Hive, and Spark optimization is crucial for success in this position.Key Responsibilities Develop and maintain data pipelines using Big Data technologies. Collaborate with cross-functional teams to identify and...