Senior Spark Developer
6 days ago
Spark Rockstar Wanted
Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from you
Responsibilities :
- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing
- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark
- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka
- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding
- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streaming
Qualifications :
years of experience in Spark development, with a strong portfolio of projects that showcase your expertise
- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)
- Programming prowess in Python, Scala, and Java
- Experience with ETL implementation and migration to Spark
- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration
-
Spark Developer
3 days ago
Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSpark DeveloperSpark, Scala, Bigdata • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability • Good knowledge on software configuration management systems • Awareness of latest technologies and Industry trends • Logical thinking and problem-solving skills along...
-
Python and Spark developer
4 days ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per yearDuration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...
-
Senior Spark Data Engineer
10 hours ago
Pune, Maharashtra, India Barclays Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJoin us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical...
-
Senior Big Data/Spark Engineer
2 weeks ago
Pune, Maharashtra, India Barclays Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJoin us as a Senior Big Data/Spark Engineer at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to...
-
Spark SQL Developer
6 days ago
Pune, Maharashtra, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRoles and ResponsibilitiesCollaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution...
-
UiPath RPA Developer
2 weeks ago
Pune, Maharashtra, India Spark Consultancy Full time ₹ 5,00,000 - ₹ 22,00,000 per yearDear Candidate,We are hiring a UiPath RPA Developer for the Pune location.(To Confirm Please Drop a Whatsapp or call on Harsh )( In case The Number Is Busy, Please Drop A Whatsapp @ Harsh )Any graduate can apply."ONLINE INTERVIEW"Job Title: RPA DeveloperDepartment: ITReports To: IT ManagerSummary:We are seeking a highly skilled and experienced RPA Developer...
-
Senior Cloudera Developer
4 days ago
Pune, Maharashtra, India Deutsche Telekom Full time ₹ 12,00,000 - ₹ 36,00,000 per yearYour Role : We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data solutions. Responsibilities : - Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive. - Collaborate with data engineers to...
-
Java Senior Developer
20 hours ago
Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJava Senior DeveloperExperienced in Core Java & Spring boot Design, develop, and implement Kafka-based microservices using Spring Boot. Build data pipelines for ingesting, processing, and analyzing large-scale data sets. Optimize Kafka configurations for performance and reliability. Work with Big Data technologies such as Hadoop, Spark, and...
-
Senior Big Data Developer
4 days ago
Pune, Maharashtra, India Citi Full time ₹ 8,00,000 - ₹ 24,00,000 per yearThe Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Senior Software Engineer, Actimize(Python,Spark)
2 weeks ago
Pune, Maharashtra, India NICE Full time ₹ 1,20,000 - ₹ 3,00,000 per yearSo, what's the role all about?Within Actimize, the AI and Analytics Team is developing the next generation advanced analytical cloud platform that will harness the power of data to provide maximum accuracy for our clients' Financial Crime programs. As part of the PaaS/SaaS development group, you will be responsible for developing this platform for Actimize...