Big Data Developer
3 days ago
Location: Remote
Experience: 5+ years
Job Type: Contractual Remote
About Us:
We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and contribute to cutting-edge data solutions.
Job Description:
We are seeking an experienced Big Data Developer with a deep understanding of Scala and Apache Spark to build, maintain, and scale data processing pipelines. The ideal candidate will have strong expertise in handling large datasets, working in a distributed computing environment, and developing efficient, high-performance applications.
Responsibilities:
Design, develop, and optimize large-scale data processing systems using Apache Spark and Scala.
Work with massive datasets, ensuring high throughput and low-latency data processing.
Build and maintain scalable, distributed systems in a cloud-based environment.
Develop data integration solutions and ensure the efficient movement of data across systems.
Collaborate with data engineers, data scientists, and other cross-functional teams to identify and implement business solutions.
Write clean, efficient, and maintainable code following industry best practices and coding standards.
Troubleshoot and optimize Spark jobs and ensure that processing tasks run with minimal downtime.
Design and implement data pipelines for ETL (Extract, Transform, Load) tasks.
Perform code reviews and mentor junior developers to ensure high standards are maintained.
Required Skills and Experience:
5+ years of experience as a Big Data Developer with a focus on Scala and Apache Spark.
Strong understanding of distributed systems and parallel processing.
Proven experience in building and optimizing large-scale, high-performance data processing pipelines.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
Knowledge of big data tools like Hadoop, Hive, Kafka, and HBase.
Solid understanding of SQL and experience with NoSQL databases.
Ability to write efficient, maintainable, and scalable code in Scala and Spark.
Experience with data warehousing, ETL, and real-time streaming applications.
Strong problem-solving skills and the ability to troubleshoot complex data-related issues.
ye pehele vali ka jd Big Data developer with Scala + Spark(5+ years)
-
Big Data Developer
3 weeks ago
bangalore, India Amossys Consulting Services Full timePosition Title: Data EngineerExperience Required: 5+ yearsEmployment Type: Full-timeEmployment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have...
-
Big Data Developer
6 days ago
bangalore, India Advent Global Solutions Full timePosition : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and Mumbai Experience : 5 to 14 years Relevant : should be 4+ yrs for Junior and 7+ yrs for Senior Primary skills : Spark, SQL,Hive Develop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...
-
Big Data Developer
6 days ago
bangalore, India Advent Global Solutions Full timePosition : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...
-
Big Data Developer
6 days ago
bangalore, India Advent Global Solutions Full timePosition : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...
-
Big data developer
1 month ago
Bangalore, India HARMAN India Full timeHarman India is looking for Big Data Developer. Location: Bangalore Experience: 4-6 Years. Notice Period: Immediate to 15 Days. Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data...
-
Big Data Developer
1 month ago
bangalore, India HARMAN India Full timeHarman India is looking for Big Data Developer.Location: Bangalore Experience: 4-6Years.Notice Period: Immediate to 15Days.Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate...
-
Big data developer
2 weeks ago
Bangalore, India Tata Consultancy Services Full timeTCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore/Chennai/Hyderabad/Pune Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in...
-
Big Data Developer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeTCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore/Chennai/Hyderabad/Pune Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in Big Data,...
-
Big Data Developer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeTCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...
-
Big Data Developer
2 months ago
bangalore, India HARMAN India Full timeHarman India is looking for Big Data Developer.Location: Bangalore Experience: 4-6Years.Notice Period: Immediate to 15Days.Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate...
-
Big Data Developer
2 months ago
bangalore, India HARMAN India Full timeHarman India is looking for Big Data Developer. Location: Bangalore Experience: 4-6Years. Notice Period: Immediate to 15Days. Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to...
-
Big Data Developer
1 month ago
bangalore, India ACL Digital Full timeSenior Big Data EngineerExperience : 5+ YearsLocation : BangaloreWork Mode : Hybrid (3 days work from Office)Mandate SkillsHadoop, Spark and ScalaThe candidate should have minimum 4 years relevant experience in Scala.He/She should have current project experience in both Spark and Scala.ResponsibilitiesCreate and maintain optimal data pipeline...
-
Big Data Developer
3 days ago
Bangalore, India LTIMindtree Full timePlease fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA
-
Big Data Developer
1 month ago
Bangalore, India ACL Digital Full timeSenior Big Data Engineer Experience : 5+ Year sLocation : Bangalor eWork Mode : Hybrid (3 days work from Office ) Mandate Skil lsHadoop, Spark and Sca la The candidate should have minimum 4 years relevant experience in Sca la.He/She should have current project experience in both Spark and Sca la. Responsibili tiesCreate and maintain optimal data...
-
Big data developer
1 month ago
Bangalore, India ACL Digital Full timeSenior Big Data Engineer Experience : 5+ Year s Location : Bangalor e Work Mode : Hybrid (3 days work from Office ) Mandate Skil ls Hadoop, Spark and Sca la The candidate should have minimum 4 years relevant experience in Sca la. He/She should have current project experience in both Spark and Sca la. Responsibili ties Create and maintain...
-
Senior Big Data Developer
2 weeks ago
bangalore, India IntraEdge Full timeWe are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...
-
Senior big data developer
4 weeks ago
Bangalore, India IntraEdge Full timeWe are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...
-
Big Data Developer
2 months ago
Bangalore, India ACL Digital Full timeSenior Big Data Engineer Experience : 5+ Year sLocation : Bangalor eWork Mode : Hybrid (3 days work from Office ) Mandate Skil lsHadoop, Spark and Sca la The candidate should have minimum 4 years relevant experience in Sca la.He/She should have current project experience in both Spark and Sca la. Responsibili tiesCreate and maintain optimal data...
-
Senior Big Data Developer
3 weeks ago
bangalore, India IntraEdge Full timeWe are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...
-
Senior Big Data Developer
4 weeks ago
bangalore, India IntraEdge Full timeWe are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...