Big Data Specialist
16 hours ago
Our organization seeks an experienced and skilled data engineer to develop, implement, and maintain scalable big data solutions utilizing cutting-edge technologies.
Key Responsibilities:- Design, create, and optimize data pipelines using cloud-based platforms and distributed computing systems.
- Collect, transform, and load large datasets from various sources including databases, files, and APIs.
- Guarantee data accuracy and consistency throughout the entire data lifecycle.
- Enhance data pipeline efficiency and performance.
- Develop and manage complex data models and schemas.
- Collaborate with data scientists and analysts to support their data requirements.
- Stay current with the latest advancements in big data engineering and related technologies.
- 6+ years of experience working with modern data platforms and ETL processes.
- Strong knowledge of Azure Databricks architecture, including Databricks Delta Lake, Spark, and MLflow.
- Proficiency in Snowflake and its SQL dialect, data warehousing concepts, and performance optimization techniques.
- Familiarity with DBT for data modeling, testing, and deployment.
- Solid understanding of SQL and data querying techniques.
- Hands-on experience with Kafka for real-time data processing and streaming.
- Knowledge of data engineering best practices and methodologies.
- Ability to handle large datasets and complex data pipelines.
The ideal candidate will possess a deep understanding of modern data platforms and hands-on experience with Azure Databricks, Snowflake, DBT, SQL, and Kafka.
-
Big Data Specialist
4 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...
-
Big Data Specialist
1 week ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000Big Data SpecialistGreetings from our team!We are seeking an experienced Big Data Specialist to join our team. As a key member, you will play a critical role in driving business growth through data-driven insights.This is an exceptional opportunity for a motivated and talented individual who thrives in a fast-paced environment. Our ideal candidate will have...
-
Big Data Specialist
2 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data systems.Key Responsibilities:Design, implement, and deploy data processing pipelines.Develop and maintain ETL processes for big data technologies.Collaborate with cross-functional teams to ensure data quality and integrity.Ensure data security and...
-
Big Data Infrastructure Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 12,00,000 - ₹ 15,00,000Job Title:Big Data Infrastructure SpecialistJob Overview:We are seeking a skilled Big Data Infrastructure Specialist to design and implement scalable data infrastructure solutions.Key Responsibilities:Deploy and manage Hadoop clusters on Apache and CDHConfigure and secure Hadoop environments using Yarn and HiveDesign and implement data pipelines using Spark,...
-
Big Data Operations Specialist
2 hours ago
Bengaluru, Karnataka, India beBeeCloud Full time US$ 90,000 - US$ 1,20,000Job Title: Big Data Operations SpecialistKey Responsibilities:Design and implement large-scale data pipelines to process and analyze big data.Collaborate with cross-functional teams to develop and maintain data infrastructure, ensuring high availability and performance.Required Skills and Qualifications:Good experience in working with NoSQL systems, such as...
-
Big Data Specialist
2 days ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 2,02,50,000Job Opportunity: Big Data SpecialistAbout the Role:The ideal candidate will have experience working with large-scale data systems, designing and implementing efficient data pipelines, and ensuring seamless integration of data sources.Responsibilities:Design, develop, and maintain scalable big data processing systems using Python and PySparkCollaborate with...
-
Cloud Big Data Engineer
2 hours ago
Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.
-
Big Data Engineer Position
4 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Big Data SpecialistWe are seeking a highly skilled big data specialist to design, develop, and maintain large-scale data systems. This individual will be responsible for architecting and implementing data pipelines using various distributed data processing frameworks.",
-
Big Basket
6 days ago
Bengaluru, Karnataka, India big basket Full timeWhat would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...
-
Big Data Specialist
4 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Data Engineer PositionJob Summary:We are seeking a skilled Big Data Specialist to join our team of experts. The ideal candidate will be responsible for designing, developing, and maintaining scalable data platforms and architectures to support our analytics and business intelligence needs.About Us:We believe in harnessing the power of technology to drive...
