PySpark QA

5 months ago


Hyderabad, India Virtusa Full time
PySpark QA - CREQ191292 Description

JOB DESCRIPTION

Skill: PySpark QA

Role / Tier: Lead Software Engineer/Tier 2

Experience: 6 – 9 years

Job Description:

Primary Skills

BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.
build CI/CD pipelines
Spark APIs to cleanse, explore, aggregate, transform, store & analyse
installing, configuring, debugging and troubleshooting Hadoop clusters

Secondary Skills

Cloud-based infrastructure , AWS services EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDS
deploying and managing ETL pipelines, RDBMS technologies (PostgreSQL, MySQL, Oracle, etc.).
knowledge of data frames, Pandas , data visualization tools & data mining .
knowledge of JIRA, Bitbucket GitHub

JD
Seeking a developer to develop, enhance, in a Pyspark -QA role.
Responsibility
Experience with BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.
Hands-on experience in build CI/CD pipelines is required Outstanding coding, debugging and analytical skills, Core problem solving skills
eliminate possible solutions and select an optimal solution.
Experience in installing, configuring, debugging and troubleshooting Hadoop clusters is desired skill.

Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Data Modelling Years of Experience 5 Travel No
  • PySpark QA Engineer

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: PySpark QAJob Summary:Virtusa is seeking a skilled PySpark QA engineer to develop, enhance, and maintain our big data technology solutions. The ideal candidate will have hands-on experience with Hadoop, Spark, and Python, as well as strong coding, debugging, and analytical skills.Key Responsibilities:Design, develop, and deploy big data technology...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...


  • Hyderabad, Telangana, India Cognizant Full time

    **Exp: 9.5 to 13 years** **Skill: ETL QA with Azure data bricks and Pyspark** **Location : Bangalore/Hyderabad/Kolkata/Pune/Chennai** **Technical Skills**: Tableau ,Azure SQL Domain Skills **Roles & Responsibilities : -** Develop and maintain Tableau dashboards to provide actionable insights for various business units - Utilize Azure SQL to manage and...


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...


  • Hyderabad, Telangana, India Ninja Van Full time

    Ninja Van Software Engineering TeamWe are a late-stage logtech startup disrupting a massive industry with innovation and cutting-edge technology. Our mission is to connect shippers and shoppers across Southeast Asia to a world of new possibilities.Role & ResponsibilitiesDesign, develop, and maintain software that powers Ninja Van's complex logistics...


  • Pune/Hyderabad, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Senior Data Quality EngineerLocation : Pune, HyderabadExperience : 6-8 Years(Relevant 5 Yrs Must)Salary : 25 LPASkills : PySpark, Python, SQL,JIRA,API Testing, ADF, Bigdata, synapse, Confluence, Postman, data lakes, ADLS, Bit Bucket, ELT/ETL,ETL testing Spark, Event HubsThe Senior Data Quality Engineer is a collaborative role responsible for designing sound,...


  • Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Software Engineering Director, you'll play a critical role in delivering care and improving health outcomes by connecting people with the care, pharmacy benefits, data, and resources they need to feel their best.The...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. Our mission is to advance health equity and improve health outcomes, particularly for those who are disproportionately affected by health disparities.Key Responsibilities:Ensure that all standard requirements are met and...


  • Hyderabad, Telangana, India Manuh Technologies Full time

    Position Lead : AWS Data Engineer. Location : Pune/ Gurgaon/Hyderabad Hybrid. Experience : 9+. Job Description : - 9+ years of experience as a Data Engineer on the AWS Stack PySpark. - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM,...


  • Hyderabad, India Manuh Technologies Full time

    Position Lead : AWS Data Engineer. Location : Pune/ Gurgaon/Hyderabad Hybrid. Experience : 9+. Job Description : - 9+ years of experience as a Data Engineer on the AWS Stack PySpark. - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM,...

  • Data Architect

    3 weeks ago


    Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we are committed to helping people live healthier lives and making the health system work better for everyone. Our mission is to address health disparities and improve health outcomes, an enterprise priority reflected in our mission. We are seeking a talented Data Architect to join our team and contribute to this mission.Key...


  • Hyderabad, Telangana, India Ninja Van Full time

    About Ninja VanNinja Van is a leading late-stage logistics startup that is revolutionizing the industry with cutting-edge technology and innovative solutions. Founded in 2014 in Singapore, we have rapidly expanded to become one of Southeast Asia's largest and fastest-growing express logistics companies, delivering to 100 million customers across the region...


  • Hyderabad, Telangana, India Epam Full time

    About the RoleEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...


  • Hyderabad, India Manuh Technologies Full time

    Job Title: Lead AWS Data EngineerAt Manuh Technologies, we are seeking a highly skilled and experienced Lead AWS Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable code for our high-scale data applications and services.Key...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India PepsiCo Full time

    Job SummaryAs a key member of the data & analytics team at PepsiCo, you will be responsible for developing and overseeing the company's data product build & operations. This role requires a strong technical expert who can drive a vision for how data engineering can proactively create a positive impact on the business. You will lead the development of large...


  • Hyderabad, Telangana, India Ninja Van Full time

    About Ninja VanNinja Van is a late-stage logistics technology startup that is revolutionizing the industry with innovation and cutting-edge technology. Founded in 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies.We've delivered to 100 million different customers across the...


  • Pune/Hyderabad, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Title: Senior Data Quality EngineerWe are seeking a highly skilled Senior Data Quality Engineer to join our team at IFlowTech Solutions Private Limited. As a Senior Data Quality Engineer, you will be responsible for designing and implementing data quality metrics that meet the requirements of our large data volume enterprise.Key Responsibilities:Develop...

  • Python

    5 months ago


    Hyderabad, Telangana, India GEM Techsoft Private limited Full time

    Mandatory Skills Strong in python programming / Python Developer & hands on expertise, Advance python (OOPS), strong in MySQL/SQL. Python API/ Flask/Django Framework. Preferred Skills Python Basic Library, AI/ ML experience, Docker, Kubernetes, OpenShift, modern web UI technologies; HTML5, ReactJS, RESTful services, WebSocket's, PySpark, HIVE, Agile...


  • Hyderabad, India Evernorth Full time

    About Evernorth:Evernorth Health Services, a division of The Cigna Group (NYSE: CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality. We relentlessly innovate to make the prediction, prevention, and treatment of illness and disease more accessible to millions of people.Responsibilities:Design, develop and implement data...