Sr. Spark Big Data Developer
11 hours ago
Sr. Spark Big Data Developer
PFB the detailed JD:
�� Experience: 5 to 7+ years (Hands-on)
�� Notice Period: 0-30 Days
Must Have:
Proficiency in at least one of the following programming languages:
Java/Scala/Python
Good understanding of SQL
Experience of development and deployment of at least one end-to-end data
storage/processing pipeline
Strong Experience in Spark development with batch and streaming
Intermediate level expertise in HDFS and Hive
Experience with Pyspark and Data Engineering
ETL implementation and migration to spark
Experience of working with Hadoop cluster
Python, PySpark, Data Bricks developer with knowledge of cloud
Experience with Kafka and Spark streaming (Dstream and Structured Streaming)
Experience with using Jupyter notebooks or any other developer tool
Experience with Airflow or other workflow engines
Good communication skills and logical skills
Good to Have Skills:
Prior experience of writing Spark jobs using Java is highly appreciated
Prior experience of working with Cloudera Data Platform (CDP)
Hands-on experience with NoSQL databases like HBase, Cassandra,
Elasticsearch, etc.
Experience of using maven and git
Agile scrum methodologies
Flink and Kudu streaming
Automation of workflows CI/CD
Nifi streaming and transformation
Job Types: Full-time, Permanent
Pay: ₹500, ₹1,500,000.00 per year
Benefits:
- Provident Fund
Work Location: In person
-
Big Data Developer
1 week ago
Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...
-
Senior Big Data Developer
2 weeks ago
Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per yearWe are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes
-
Big Data Lead
2 weeks ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesignation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...
-
Big Data Developer
2 weeks ago
Pune, Maharashtra, India Impetus Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob DescriptionYear of Experience - 1 to 3 yearsLocation - Indore, Pune, Noida, Hyderabad, Bangalore, GurugramRequired Skills:Python Programming: Strong ability to write clean and efficient code.Spark SQL: Good understanding of Spark SQL for distributed data processing.Data Processing: Experience with large datasets and structured data manipulation.SQL...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per yearCoforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...
-
Big Data Developer Lead
3 days ago
Pune, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOur is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).· Job Title: Big Data Developer...
-
Big Data Developer
8 hours ago
Pune, Maharashtra, India Uplers Full time ₹ 60,000 - ₹ 1,80,000 per yearExperience: yearsSalary: Confidential (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Office (Pune)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive)**(*Note: This is a requirement for one of Uplers' client - Nexus Cognitive)**What do you need for...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Vodafone Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearDesign, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and...
-
Sr. Big Data Engineer
2 weeks ago
Pune, Maharashtra, India DV Consultancy Full time ₹ 42,00,000 per yearJob profile - Sr Big Data EngineerJob Location - PuneExperience required yearsCTC - 35 LPALooking for immediate joiners.For detailed JD, kindly send your resume at Job Type: Full-timePay: Up to ₹3,500,000.00 per yearApplication Question(s):How many years of experience do you have?What is your current CTC?What is your expected CTC?Work Location: In person
-
Big Data Engineer
7 days ago
Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...