Apache Spark Professional

6 days ago


Mumbai, India Coders Brain Full time

Job Description

Roles and Responsibilities:

Skillset :Apache Spark Designer

Education- BE, MCA, MSc or equivalent( valid degree)

- 8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent)
- BFSI domain experience is preferred
- AApache Spark Designer to create and manage large scale data processing solutions
- In this role, Candidate should have a background in data and business analysis
- Should have hands on Apache Spark where you have worked on design, development and deployment on cluster of servers
- Also have data related processing problem-solving aptitude

Responsibilities

- Translate business needs to technical specifications
- Architecting, Design, build and deploy data processing solutions
- Hands on tools to process, stage, store data Conduct recon of data
- Collaborate with teams to integrate systems Develop and execute Spark Queries, database queries and conduct analyses
- Create dataset, RDD, Data Frame for requested projects Develop and update technical documentation
- Sound knowledge about effort estimation methods for data processing solutions requirements
- Proven experience as Apache Spark Designer.
- Hands-on coding experience for Apache Spark designing
- Background in data processing design (e.g. large scale data processing with API based status) and data curation
- In-depth understanding of database management systems, Spark clustering, Spark executor, Driver, real time data processing platform, Java 1.8, and ETL (Extract, transform, load) framework
- Knowledge of SQL queries, Spark Engine and Spark Services, Experience of Spark query tuning and performance optimization

Soft skills

- Proven abilities to take initiative and be innovative
- Analytical mind with a problem-solving aptitude



  • Mumbai, Maharashtra, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:Skillset :Apache Spark DesignerEducation- BE, MCA, MSc or equivalent( valid degree)- 8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent)- BFSI domain experience is preferred- AApache Spark Designer to create and manage large scale data...


  • Mumbai, India Valuemap Technologies Full time

    Greetings From Valuemap Technologies!!! **Job Title: Apache Spark Designer** **Location: Mumbai Fort** **Duration: Fulltime** **Notice Period: Immediate (Highly Preffered)** **Skills Required**: Translate business needs to technical specifications Architecting, Design, build and deploy data processing solutions Hands on tools to process, stage, store...


  • Mumbai, India JP Morgan Chase & Co. Full time

    Job Description You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer II at JPMorgan Chase within the Commercial and Investment Bank's Risk Central Team, you are part of an agile team that works to enhance, design, and...


  • Mumbai, India Mindmajic Technologies Full time

    Company Description Mindmajic Technologies provides comprehensive cloud services for the design, development, integration, and maintenance of cloud-based apps, with expertise in AWS. We focus on personal interaction and mutual trust to achieve our goals, emphasizing cooperation and teamwork. We are committed to providing the best service and support to our...


  • Bengaluru, Mumbai, India AVE-Promagne Business Solutions Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Must have 3+ years of experience with Apache Spark in Scala Must have Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning Hands-on experience with performance tuning in production Spark jobs Must have Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either) Must have Proficiency...


  • Mumbai, Maharashtra, India beBeeEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Big Data Engineer OpportunitiesWe are seeking an experienced Senior Big Data Engineer to join our team.As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Apache Spark, Scala, and Python.Key Responsibilities:Lead the design and development of big data...

  • Senior Spark Developer

    18 hours ago


    Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data....

  • Senior Python

    6 days ago


    Ahmedabad, Mumbai, India Best infosystems Ltd. Full time

    Job Description Job Title: Senior Python & Spark Developer Job Type: Full-Time Experience Required: 5+ years Location: Ahmedabad preferred, but open for Mumbai JOB DESCRIPTION: We are looking for an experienced Senior Python & pySpark Developer with strong expertise in Python (Django, Flask) and PySpark for large-scale data processing. The ideal...

  • Big Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India beBeeApache Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Spark/Scala DeveloperWe are seeking a skilled Spark Scala Developer to join our team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.About the Role:Design, develop, and maintain big data...


  • Mumbai, Maharashtra, India AA Stars Solutions Full time

    **Responsibilities**: - Develop and deliver in-depth training programs on Data & Analytics with a focus on Spark and AWS services. - Create training materials, including presentations, hands-on labs, and documentation, tailored to different skill levels. - Conduct live training sessions, workshops, and webinars for diverse audiences, including data...