Pyspark Developer

3 weeks ago

Noida Mumbai, India MFX Infotech Private Limited Full time
Job Description

ROLE SUMMARY

Sompo is seeking a Data & BI QA Tester to participate in the quality assurance processes, performing tests of reports, data transformation and load to identify, isolate and help resolve issues. This position will also suggest root-cause scenarios.

ROLE RESPONSIBILITIES

- Work with different IT teams to verify reports, data extract, transformation and load steps conform to specified exit criteria and standards.
- Design and execute test scenarios, develop, and document data test plans based on requirements and technical specifications.
- Identify, analyze, and document all defects. Perform triage to ascertain possible causes for errors.
- Record and document results of test execution, distributing the defect tracking report.
- Ensure compliance with general quality assurance best practices, accepted industry standards and those standards set forth by upstream sources.
- Create SQL queries to valid results against source data.

TECHNICAL QUALIFICATIONS

- 5 years of experience with mostly used Microsoft Office suites.
- 5 years of experience testing data transformations.
- 5 years of knowledge and understanding of basic SQL.
- 3 years of experience testing reports (using tools like Cognos and Microstrategy).
- Working knowledge of ETL processes.
- Good understanding of SDLC methodology.
- Knowledge of Property and Casualty Insurance is a plus.
- Experience with a defect tracking system like TFS.

GENERAL QUALIFICATIONS

- 5 years of experience documenting test results.
- 5 years of experience writing manual test cases.
- 5 years of experience executing manual and automated test cases.
- Excellent written and verbal communications skills.
- Excellent problem solving and analytical skills.
- Ability to create and execute a test plan.
- Ability to work with a team to test reports, data loads and determine root causes of failures.

EDUCATION REQUIREMENTS

- Bachelor's degree in Computer science or equivalent required.
- Certification in Quality Assurance desired.

  • Python with Pyspark

    2 weeks ago

    Mumbai, India INFOBEANS TECHNOLOGIES Full time

    Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ years Role: Python with Pyspark Location: Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, Indore Experience: 4+ years Key Skills:. Python, Pyspark, AWS Job Category: Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration...

  • PySpark ETL Developer

    5 days ago

    Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Purpose The Senior Developer will be a part of the ISPL Mumbai IHC ETL projects team. The developer position will primarily work on Apache Spark(python), Spark SQL, ETL tools, Unix, Autosys and DBResponsibilitiesDirect Responsibilities Expertise on PySpark, database migration, transformation, and integration solutions for any Data warehousing...

  • Aws & Pyspark

    2 weeks ago

    Mumbai, India Change Leader Full time

    From 4 to 9 year(s) of experience - ₹ Not Disclosed by Recruiter - Mumbai, Pune, Chennai, Bangalore/Bengaluru**Roles and Responsibilities** **Must haveskills**: 1.PySpark(Python +Spark) or Spark with Scala. Spark aka Apache Spark. 2.Cloud(AWSorAzure). Preferably AWS Good to have:Databricks(PySpark),Snowflake.AWS(S3, Glue,...) **Primary skill**: Data...

  • Pyspark Developer

    1 week ago

    Mumbai, Maharashtra, India Artech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesYou will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also be...

  • Pyspark Developer

    7 days ago

    Mumbai, India Artech Full time

    Role & responsibilities You will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also be...

  • Azure Data Engineer with Databricks and PySpark 15h Left

    3 weeks ago

    Noida, Mumbai, Pune, India Birlasoft Limited Full time

    Job DescriptionYears of experience 8 to 10 Years- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating Technical Specification Design,...

  • PySpark Module Lead

    3 weeks ago

    Noida, Uttar Pradesh, India Sopra Steria Full time

    Job DescriptionWe are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will collaborate closely with our Data Scientists to develop and deploy machine learning models. Proficiency in below listed skills will be crucial in building and maintaining pipelines for training and inference...

  • Looking for immediate joiners Digital

    3 days ago

    Mumbai, India Tata Consultancy Services Full time

    Experience: 6-8yearsLocation: MumbaiJob description of Digital : PySpark- Expertise and experience in Python and Pyspark (at least 4 years of experience)- Experience with BI tools, SQL queries, and organizing and analyzing data- Should have working knowledge and hands-on experience on the following Palantir Tools - Data Connection, Ontology, Code...

  • Looking for immediate joiners Digital

    1 day ago

    Mumbai, India Tata Consultancy Services Full time

    Experience: 6-8yearsLocation: MumbaiJob description of Digital : PySparkExpertise and experience in Python and Pyspark (at least 4 years of experience)Experience with BI tools, SQL queries, and organizing and analyzing dataShould have working knowledge and hands-on experience on the following Palantir Tools - Data Connection, Ontology, Code Workbook/Code...

  • Looking for immediate joiners Digital

    1 week ago

    Mumbai, India Tata Consultancy Services Full time

    Experience: 6-8yearsLocation: MumbaiJob description of Digital : PySparkExpertise and experience in Python and Pyspark (at least 4 years of experience) Experience with BI tools, SQL queries, and organizing and analyzing data Should have working knowledge and hands-on experience on the following Palantir Tools - Data Connection, Ontology, Code Workbook/Code...