
Sr. Spark Big Data Developer
2 weeks ago
PFB the detailed JD:
�� Experience: 5 to 7+ years (Hands-on)
�� Notice Period: 0-30 Days
Must Have:
Proficiency in at least one of the following programming languages:
Java/Scala/Python
Good understanding of SQL
Experience of development and deployment of at least one end-to-end data
storage/processing pipeline
Strong Experience in Spark development with batch and streaming
Intermediate level expertise in HDFS and Hive
Experience with Pyspark and Data Engineering
ETL implementation and migration to spark
Experience of working with Hadoop cluster
Python, PySpark, Data Bricks developer with knowledge of cloud
Experience with Kafka and Spark streaming (Dstream and Structured Streaming)
Experience with using Jupyter notebooks or any other developer tool
Experience with Airflow or other workflow engines
Good communication skills and logical skills
Good to Have Skills:
Prior experience of writing Spark jobs using Java is highly appreciated
Prior experience of working with Cloudera Data Platform (CDP)
Hands-on experience with NoSQL databases like HBase, Cassandra,
Elasticsearch, etc.
Experience of using maven and git
Agile scrum methodologies
Flink and Kudu streaming
Automation of workflows CI/CD
Nifi streaming and transformation
Job Types: Full-time, Permanent
Pay: ₹100, ₹1,500,000.00 per year
Benefits:
- Provident Fund
Work Location: In person
-
Sr. Spark Big Data Developer
3 days ago
Kothrud Depot, Bus Stop, India CRUTZ LEELA ENTERPRISES Full timePFB the detailed JD: �� Experience: 5 to 7+ years (Hands-on) �� Notice Period: 0-30 Days Must Have: Proficiency in at least one of the following programming languages: Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end data storage/processing pipeline Strong Experience in...
-
Sr. Big Data Engineer
23 hours ago
Pune, India Synechron Technologies Private Limited Full timeJob Description Job Summary: We are looking for a highly skilled Sr. Big Data Engineer professional to join our team. This role will focus on designing, developing, and maintaining large-scale data processing systems. The ideal candidate will have extensive experience in Big Data technologies, Java programming, and a strong understanding of data...
-
Big Data Architect
2 weeks ago
Kothrud, Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full timePosition - Big Data Architect Experience: 10-12 years Key Responsibilities: - Data Architecture Design: Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. - Data Modeling: Developing data models and database structures to ensure efficient data storage and retrieval. - Data Security and...
-
Senior Spark Developer
5 days ago
Pune, India Consulting Pandits Full timeSpark Rockstar Wanted!Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing...
-
Big Data Architect
5 days ago
Pune, India Consulting Pandits Full timeBig Data Architect - Build the Future of Data ManagementAre you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of...
-
Senior Big Data Engineer
5 days ago
Pune, India Devlats Pvt Ltd Full timeSr. Big Data EngineerLocation : PuneExperience : 8+ years overall; 6+ years relevantMode : HybridRole Overview :We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing...
-
Big Data Engineer
23 hours ago
Pune, India Synechron Technologies Private Limited Full timeJob Description As a Big Data Engineer, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role...
-
Lead Big Data
23 hours ago
Pune, India Synechron Technologies Private Limited Full timeJob Description s a Lead Big Data, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will...
-
Big Data Engineer
3 days ago
Pune, India WorkiFicient Full timeRoles and Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse,...
-
Lead Big Data Engineer
5 days ago
Pune, India Recro Full timeResponsibilities :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse, process, and...