Apache Spark Developer

1 week ago

pune, India Wipro Full time

Role Purpose

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to feasible design Collaborate with functional teams or systems analysts who carry out the detailed investigation into software requirements Conferring with project managers to obtain information on software capabilities Perform coding and ensure optimal software/ module development Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces. Analyzing information to recommend and plan the installation of new systems or modifications of an existing system Ensuring that code is error free or has no bugs and test failure Preparing reports on programming project specifications, activities and status Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns Compile timely, comprehensive and accurate documentation and reports as requested Coordinating with the team on daily project status and progress and documenting it Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution Capturing all the requirements and clarifications from the client for better quality work Taking feedback on the regular basis to ensure smooth and on time delivery Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members. Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc Timely Response to customer requests and no instances of complaints either internally or externally Stakeholder Interaction Stakeholder Type Stakeholder Identification Purpose of Interaction Internal Lead Software Developer and Project Manager Regular reporting & updates Software Developers For work coordination and support in providing testing solutions External Clients Provide apt solutions and support as per the requirement Display Lists the competencies required to perform this role effectively: Functional Competencies/ Skill Leveraging Technology - Knowledge of current and upcoming technology along with expertise in programming (automation, tools and systems) to build efficiencies and effectiveness in own function/ Client organization - Competent Process Excellence - Ability to follow the standards and norms to produce consistent results, provide effective control and reduction of risk - Expert Technical knowledge - knowledge of various programming languages, tools, quality management standards and processes - Expert Competency Levels Foundation Knowledgeable about the competency requirements. Demonstrates (in parts) frequently with minimal support and guidance. Competent Consistently demonstrates the full range of the competency without guidance. Extends the competency to difficult and unknown situations as well. Expert Applies the competency in all situations and is serves as a guide to others as well. Master Coaches others and builds organizational capability in the competency area. Serves as a key resource for that competency and is recognised within the entire organization. Behavioral Competencies Formulation & Prioritization Innovation Managing Complexity Execution Excellence Passion for Results Deliver No. Performance Parameter Measure 1. Continuous Integration, Deployment & Monitoring of Software 100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan 2. Quality & CSAT On-Time Delivery, Manage software, Troubleshoot queries Customer experience, completion of assigned certifications for skill upgradation 3. MIS & Reporting 100% on time MIS & report generation Apache Spark

  • Hiring For Apache spark developer

    1 week ago

    Pune, India timesjobs Full time

    Hiring For Apache spark developerApache spark developerDesired ProfileSkills : Apache spark developer, Data Lake solution using Scala/Python with large and multi-format data, coding experience using Spark (Scala/Python), SQLNotice Period: 0- 60 daysEducation: any graduates(full-time)Location: PuneEmail: career@krazymantra.com

  • Apache Spark Expert

    3 weeks ago

    Pune, India Info Origin Full time

    Position Title: - Apache Spark Expert**Location**: - Pune, MH, OnsitePosition Type: - Full-TimeInterview Process: - Webcam/SkypeReq Id: - 3314Salary/Rate: - MarketPosition Duration: - Permanent**Key Responsibilities**: - Provide architectural consultancy to clients and develop implementation roadmaps for Apache Spark and Kafka solutions. - Translate...

  • Kafka Architect

    4 weeks ago

    Pune, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    4 weeks ago

    Bangalore/Pune/Kolkata/Chennai, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    1 month ago

    Bangalore/Pune/Kolkata/Chennai, IN Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Spark & Scala Developer

    2 weeks ago

    pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperShift- Malaysian / EURExp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position)Full time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign...

  • Spark & Scala Developer

    3 weeks ago

    Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperShift- Malaysian / EURExp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position)Full time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation...

  • Spark & Scala Developer

    1 week ago

    Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperShift- Malaysian / EURExp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position)Full time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation...

  • Spark & Scala Developer

    2 weeks ago

    Pune, India Radioactive Technologies Full time

    Spark & Scala Developer Shift- Malaysian / EUR Exp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position) Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all...

  • Snowflake, Databricks or Apache Spark

    2 weeks ago

    Pune, Maharashtra, India Zensar Technologies Full time

    Snowflake, Databricks or Apache Spark-(0103943)DescriptionRoles and Responsibilites Managing the entire development lifecycle, from requirements gathering to deployment and maintenance Developing and implementing analytics strategies and roadmaps Collaborating with senior business leaders to align analytics initiatives with business goals Identifying and...

  • Data Engineer

    4 weeks ago

    Bangalore/Pune, India Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Scala Developer

    2 weeks ago

    pune, India T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQL Job Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Data Streaming

    3 weeks ago

    Pune, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    3 weeks ago

    Pune, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • WovV Technologies

    4 weeks ago

    Pune, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years. Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...

  • Apache Developer

    4 weeks ago

    pune, India Corporate Resources Full time

    Job Description Title: Apache Developer Location: Hyderabad, Pune, Bangalore, Chennai. Permanent opportunity. Years of experience: 5 Years. Skills Required - Apache Solr, Java/J2EE, Python, NoSQL DB. Web technologies - Apache/Tomcat. ...

  • Apache Developer

    2 weeks ago

    Pune, Maharashtra, India Corporate Resources Full time

    Job DescriptionTitle: Apache DeveloperLocation: Hyderabad, Pune, Bangalore, Chennai.Permanent opportunity.Years of experience: 5 Years.Skills Required - Apache Solr, Java/J2EE, Python, NoSQL DB.Web technologies - Apache/Tomcat.IndustryIT-Software / Software ServicesFunctional AreaIT Software - Application Programming, MaintenanceJob RoleSoftware DeveloperJob...

  • Scala Developer

    3 weeks ago

    Bangalore/Pune/Hyderabad, India T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQL Job Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Scala Developer

    2 weeks ago

    Bangalore/Pune/Hyderabad, IN T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQLJob Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Spark/PySpark Developer

    4 weeks ago

    Bihar/Jharkhand/Maharashtra/Pondicherry/Coimbatore/Patna/Aurangabad/Ranchi/Mumbai/Navi Mumbai/Pune/N, India ATech Full time

    Job Profile : Spark ( Pyspark ) DeveloperIndustry Type : IT Services Job description :- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.-...