
Apache Spark Professional
6 days ago
Job Description
Roles and Responsibilities:
Skillset :Apache Spark Designer
Education- BE, MCA, MSc or equivalent( valid degree)
- 8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent)
- BFSI domain experience is preferred
- AApache Spark Designer to create and manage large scale data processing solutions
- In this role, Candidate should have a background in data and business analysis
- Should have hands on Apache Spark where you have worked on design, development and deployment on cluster of servers
- Also have data related processing problem-solving aptitude
Responsibilities
- Translate business needs to technical specifications
- Architecting, Design, build and deploy data processing solutions
- Hands on tools to process, stage, store data Conduct recon of data
- Collaborate with teams to integrate systems Develop and execute Spark Queries, database queries and conduct analyses
- Create dataset, RDD, Data Frame for requested projects Develop and update technical documentation
- Sound knowledge about effort estimation methods for data processing solutions requirements
- Proven experience as Apache Spark Designer.
- Hands-on coding experience for Apache Spark designing
- Background in data processing design (e.g. large scale data processing with API based status) and data curation
- In-depth understanding of database management systems, Spark clustering, Spark executor, Driver, real time data processing platform, Java 1.8, and ETL (Extract, transform, load) framework
- Knowledge of SQL queries, Spark Engine and Spark Services, Experience of Spark query tuning and performance optimization
Soft skills
- Proven abilities to take initiative and be innovative
- Analytical mind with a problem-solving aptitude
-
15h Left: Apache Spark Professional
3 weeks ago
Mumbai, Maharashtra, India Coders Brain Full timeJob DescriptionRoles and Responsibilities:Skillset :Apache Spark DesignerEducation- BE, MCA, MSc or equivalent( valid degree)- 8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent)- BFSI domain experience is preferred- AApache Spark Designer to create and manage large scale data...
-
Apache Spark Designer
1 week ago
Mumbai, India Valuemap Technologies Full timeGreetings From Valuemap Technologies!!! **Job Title: Apache Spark Designer** **Location: Mumbai Fort** **Duration: Fulltime** **Notice Period: Immediate (Highly Preffered)** **Skills Required**: Translate business needs to technical specifications Architecting, Design, build and deploy data processing solutions Hands on tools to process, stage, store...
-
Software Engineer II
1 day ago
Mumbai, India JP Morgan Chase & Co. Full timeJob Description You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer II at JPMorgan Chase within the Commercial and Investment Bank's Risk Central Team, you are part of an agile team that works to enhance, design, and...
-
Freelancer For Databricks With Spark
3 days ago
Mumbai, India Mindmajic Technologies Full timeCompany Description Mindmajic Technologies provides comprehensive cloud services for the design, development, integration, and maintenance of cloud-based apps, with expertise in AWS. We focus on personal interaction and mutual trust to achieve our goals, emphasizing cooperation and teamwork. We are committed to providing the best service and support to our...
-
Big Data Engineer- Spark/Scala
2 weeks ago
Bengaluru, Mumbai, India AVE-Promagne Business Solutions Full time ₹ 1,50,000 - ₹ 28,00,000 per yearMust have 3+ years of experience with Apache Spark in Scala Must have Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning Hands-on experience with performance tuning in production Spark jobs Must have Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either) Must have Proficiency...
-
Senior Big Data Professional
2 weeks ago
Mumbai, Maharashtra, India beBeeEngineer Full time US$ 1,50,000 - US$ 2,00,000Big Data Engineer OpportunitiesWe are seeking an experienced Senior Big Data Engineer to join our team.As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Apache Spark, Scala, and Python.Key Responsibilities:Lead the design and development of big data...
-
Senior Spark Developer
18 hours ago
Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThe Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data....
-
Senior Python
6 days ago
Ahmedabad, Mumbai, India Best infosystems Ltd. Full timeJob Description Job Title: Senior Python & Spark Developer Job Type: Full-Time Experience Required: 5+ years Location: Ahmedabad preferred, but open for Mumbai JOB DESCRIPTION: We are looking for an experienced Senior Python & pySpark Developer with strong expertise in Python (Django, Flask) and PySpark for large-scale data processing. The ideal...
-
Big Data Engineer
2 weeks ago
Mumbai, Maharashtra, India beBeeApache Full time ₹ 18,00,000 - ₹ 24,00,000Job Title: Spark/Scala DeveloperWe are seeking a skilled Spark Scala Developer to join our team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.About the Role:Design, develop, and maintain big data...
-
Subject Matter Expert and Trainer
5 days ago
Mumbai, Maharashtra, India AA Stars Solutions Full time**Responsibilities**: - Develop and deliver in-depth training programs on Data & Analytics with a focus on Spark and AWS services. - Create training materials, including presentations, hands-on labs, and documentation, tailored to different skill levels. - Conduct live training sessions, workshops, and webinars for diverse audiences, including data...