
Big Data Developer
4 days ago
Position : Big Data Engineer (Immediate Joiner)
Experience : 5+ Years
Location : (Gurugram / Bangalore)
Joining : Immediate Joiner
Job Summary :
We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.
The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.
Key Responsibilities :
Data Warehousing :
- Design, develop, and maintain large-scale data warehouses using Amazon Redshift.
- Optimize Redshift cluster performance, scalability, and cost-effectiveness.
Data Pipelines :
- Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda.
- Ensure data quality, integrity, and security across the data pipeline.
Data Processing :
- Develop and optimize data processing applications using Spark, Scala, and AWS services.
- Work with data scientists and analysts to develop predictive models and perform advanced analytics.
AWS Services :
- Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems.
- Ensure data systems are highly available, scalable, and and Optimization :
- Troubleshoot and optimize data pipeline performance issues.
- Ensure data systems are optimized for cost, performance, and scalability.
Requirements :
Experience : 5+ years of experience in big data engineering or a related field.
Technical Skills :
- Proficiency in Amazon Redshift, Apache Spark, and Scala.
- Experience with AWS services like S3, Glue, Lambda, and IAM.
- Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift.
Data Architecture : Strong understanding of data architecture principles and design patterns.
Problem-Solving : Excellent problem-solving skills and attention to detail.
Preferred Qualifications :
Certifications : AWS Certified Big Data Specialty or similar certifications.
Machine Learning : Familiarity with machine learning frameworks like Spark MLlib or TensorFlow.
Agile Methodology : Experience working in agile development environments.
Data Governance : Experience with data governance, data quality, and data security.
-
Big Data Developer
5 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000The primary objective of this role is to design and develop data pipelines utilizing Big Data technologies. A deep understanding of Py Spark, Hive, and Spark optimization is crucial for success in this position.Key Responsibilities Develop and maintain data pipelines using Big Data technologies. Collaborate with cross-functional teams to identify and...
-
Big Data Developer
3 days ago
Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...
-
Big Data Developer
2 weeks ago
Bengaluru, Karnataka, India Recro Full timeRole Overview: Spark/Scala Developer (Big Data) We are seeking experienced Big Data Engineers with strong expertise in Scala and Apache Spark to join our team. The ideal candidate will be responsible for designing and implementing scalable data solutions, optimizing performance, and translating business requirements into technical deliverables. Key...
-
Big Basket
4 days ago
Bengaluru, Karnataka, India big basket Full timeWhat would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...
-
Big Data Developer
5 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878As a Big Data Developer, you will work closely with cross-functional teams to design and implement scalable data pipelines using Databricks and Hadoop.Key Responsibilities :Create robust and efficient data architectures to support real-time analytics and data-driven decision making.Leverage big data processing and cloud-based analytics tools like Databricks...
-
Big Basket
4 days ago
Bengaluru, Karnataka, India big basket Full timeAs a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...
-
Senior Big Data Developer
1 hour ago
Bengaluru, Karnataka, India beBeeBigDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Big Data EngineerWe are seeking a skilled and innovative Big Data Engineer to join our team. This role involves designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data.Key Responsibilities:Data Pipeline Development: Design, build, and maintain robust and scalable ETL...
-
Big Data Developer
6 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have strong experience in Scala, Spark, and Big Data ecosystem.Key ResponsibilitiesDesign and develop scalable data engineering solutions using Scala & SparkImplement unit testing best practices to ensure code qualityRequirementsHands-on experience with...
-
Big Data Developer
4 weeks ago
Bengaluru, Karnataka, India Maimsd Technology Full timeJob DescriptionBig Data Developer - Spark/HadoopWe are seeking an experienced Big Data Developer with expertise in Hadoop, Spark, and Kafka to take complete ownership of the software development lifecycle, from requirement gathering to final deployment. This role is ideal for a proactive individual who can translate business use cases into robust, scalable,...
-
Big Data Developer
2 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timePosition - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...