PySpark QA

6 days ago


Hyderabad, India Virtusa Full time
PySpark QA - CREQ191292 Description

JOB DESCRIPTIONSkill: PySpark QARole / Tier: Lead Software Engineer/Tier 2Experience: 6 – 9 yearsJob Description:Primary SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.build CI/CD pipelinesSpark APIs to cleanse, explore, aggregate, transform, store & analyseinstalling, configuring, debugging and troubleshooting Hadoop clustersSecondary SkillsCloud-based infrastructure , AWS services EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDSdeploying and managing ETL pipelines, RDBMS technologies (PostgreSQL, MySQL, Oracle, etc.).knowledge of data frames, Pandas , data visualization tools & data mining .knowledge of JIRA, Bitbucket GitHubJDSeeking a developer to develop, enhance, in a Pyspark -QA role.ResponsibilityExperience with BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.Hands-on experience in build CI/CD pipelines is required Outstanding coding, debugging and analytical skills, Core problem solving skillseliminate possible solutions and select an optimal solution.Experience in installing, configuring, debugging and troubleshooting Hadoop clusters is desired skill.Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Data Modelling Years of Experience 5 Travel No
  • PySpark QA

    4 days ago


    hyderabad, India Virtusa Full time

    PySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.build CI/CD pipelinesSpark APIs to cleanse,...

  • Data Engineer

    4 days ago


    hyderabad, India Info Services Full time

    Data Engineering QA Hyderabad Full-time Min Exp: 5+ years Required. Work timing : From 12 pm to 9 pm IST Notice period has to be less than 30 days, preferably immediate Must have skills: Complex SQL query writing Python coding Big Data platform tools like Spark or PySpark Please submit to

  • Data Engineer

    3 days ago


    Hyderabad, India Info Services Full time

    Data Engineering QAHyderabadFull-timeMin Exp: 5+ years Required.Work timing: From 12 pm to 9 pm ISTNotice period has to be less than 30 days, preferably immediateMust have skills:Complex SQL query writingPython codingBig Data platform tools like Spark or PySparkPlease submit to arunb@infoservices.com

  • Data Engineer

    4 days ago


    Hyderabad, India Info Services Full time

    Data Engineering QAHyderabadFull-timeMin Exp: 5+ years Required.Work timing: From 12 pm to 9 pm ISTNotice period has to be less than 30 days, preferably immediateMust have skills:Complex SQL query writingPython codingBig Data platform tools like Spark or PySparkPlease submit to arunb@infoservices.com


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “ Lead AzureData Engineers”who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment.What you...

  • Lead Data Engineer

    1 month ago


    Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “ Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...


  • hyderabad, India YASH Technologies Full time

    We are looking forward to hire “ Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment.What...


  • hyderabad, India YASH Technologies Full time

    We are looking forward to hire “ Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment.What...


  • Hyderabad, Telangana, India YASH Technologies Full time

    We are looking forward to hire "Lead Azure Data Engineers" who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...


  • Hyderabad, Telangana, India YASH Technologies Full time

    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single...


  • Hyderabad, India Evernorth Health Services Full time

    Responsibilities:Design, develop and implement data pipeline (integration, transformation, data loading, data validation and error handling) using Databricks and Snowflakes.Deploy the data pipeline to the production environment via CI/CD system such as Jenkins and Terraform.Continuously monitor the pipeline and address any issues or improvements.Collaborate...


  • hyderabad, India Anicalls (Pty) Ltd Full time

    Candidate should be able to:Work closely with our QA Team to ensure data integrity and overall system qualityWork closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirementsWrite Shell/Python scripts for jobs scheduling and data wranglingWrite Scoop Jobs to Import/Export data from...


  • hyderabad, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description - Senior Data Quality Engineer (Azure Specialist, Automation) Experience : 6-8+ yearsWork Location - Pune, Hyderabad(Hybrid)The Senior Data Quality Engineer is a collaborative role responsible for designing sound, scalable, and performant data quality metrics that meet the requirements in a large data volume enterprise. Technical SkillsMust...


  • Hyderabad, India Evernorth Health Services Full time

    Responsibilities:Design, develop and implement data pipeline (integration, transformation, data loading, data validation and error handling) using Databricks and Snowflakes. Deploy the data pipeline to the production environment via CI/CD system such as Jenkins and Terraform. Continuously monitor the pipeline and address any issues or improvements....


  • Hyderabad, India Evernorth Full time

    Responsibilities:Design, develop and implement data pipeline (integration, transformation, data loading, data validation and error handling) using Databricks and Snowflakes.Deploy the data pipeline to the production environment via CI/CD system such as Jenkins and Terraform.Continuously monitor the pipeline and address any issues or improvements.Collaborate...


  • Hyderabad, India Evernorth Full time

    Responsibilities: Design, develop and implement data pipeline (integration, transformation, data loading, data validation and error handling) using Databricks and Snowflakes. Deploy the data pipeline to the production environment via CI/CD system such as Jenkins and Terraform. Continuously monitor the pipeline and address any issues or improvements....


  • Hyderabad, Telangana, India Evernorth Full time

    Responsibilities:Design, develop and implement data pipeline (integration, transformation, data loading, data validation and error handling) using Databricks and Snowflakes.Deploy the data pipeline to the production environment via CI/CD system such as Jenkins and Terraform.Continuously monitor the pipeline and address any issues or improvements.Collaborate...

  • Python

    1 week ago


    Hyderabad, Telangana, India GEM Techsoft Private limited Full time

    Mandatory Skills Strong in python programming / Python Developer & hands on expertise, Advance python (OOPS), strong in MySQL/SQL. Python API/ Flask/Django Framework. Preferred Skills Python Basic Library, AI/ ML experience, Docker, Kubernetes, OpenShift, modern web UI technologies; HTML5, ReactJS, RESTful services, WebSocket's, PySpark, HIVE, Agile...