PySpark QA
5 months ago
JOB DESCRIPTION
Skill: PySpark QA
Role / Tier: Lead Software Engineer/Tier 2
Experience: 6 – 9 years
Job Description:
Primary Skills
BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.
build CI/CD pipelines
Spark APIs to cleanse, explore, aggregate, transform, store & analyse
installing, configuring, debugging and troubleshooting Hadoop clusters
Secondary Skills
Cloud-based infrastructure , AWS services EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDS
deploying and managing ETL pipelines, RDBMS technologies (PostgreSQL, MySQL, Oracle, etc.).
knowledge of data frames, Pandas , data visualization tools & data mining .
knowledge of JIRA, Bitbucket GitHub
JD
Seeking a developer to develop, enhance, in a Pyspark -QA role.
Responsibility
Experience with BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark.
Hands-on experience in build CI/CD pipelines is required Outstanding coding, debugging and analytical skills, Core problem solving skills
eliminate possible solutions and select an optimal solution.
Experience in installing, configuring, debugging and troubleshooting Hadoop clusters is desired skill.
-
PySpark QA Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: PySpark QAJob Summary:Virtusa is seeking a skilled PySpark QA engineer to develop, enhance, and maintain our big data technology solutions. The ideal candidate will have hands-on experience with Hadoop, Spark, and Python, as well as strong coding, debugging, and analytical skills.Key Responsibilities:Design, develop, and deploy big data technology...
-
Senior PySpark Developer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...
-
Etl QA with Azure Data Bricks and Pyspark
1 month ago
Hyderabad, Telangana, India Cognizant Full time**Exp: 9.5 to 13 years** **Skill: ETL QA with Azure data bricks and Pyspark** **Location : Bangalore/Hyderabad/Kolkata/Pune/Chennai** **Technical Skills**: Tableau ,Azure SQL Domain Skills **Roles & Responsibilities : -** Develop and maintain Tableau dashboards to provide actionable insights for various business units - Utilize Azure SQL to manage and...
-
Lead Data Engineer- Azure
5 months ago
Hyderabad, India YASH Technologies Full timeWe are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...
-
Lead Data Engineer- Azure
5 months ago
Hyderabad, India YASH Technologies Full timeWe are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...
-
Senior Software Engineer
2 weeks ago
Hyderabad, Telangana, India Ninja Van Full timeNinja Van Software Engineering TeamWe are a late-stage logtech startup disrupting a massive industry with innovation and cutting-edge technology. Our mission is to connect shippers and shoppers across Southeast Asia to a world of new possibilities.Role & ResponsibilitiesDesign, develop, and maintain software that powers Ninja Van's complex logistics...
-
Senior Data Quality Engineer
1 month ago
Pune/Hyderabad, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full timeSenior Data Quality EngineerLocation : Pune, HyderabadExperience : 6-8 Years(Relevant 5 Yrs Must)Salary : 25 LPASkills : PySpark, Python, SQL,JIRA,API Testing, ADF, Bigdata, synapse, Confluence, Postman, data lakes, ADLS, Bit Bucket, ELT/ETL,ETL testing Spark, Event HubsThe Senior Data Quality Engineer is a collaborative role responsible for designing sound,...
-
Software Engineering Director
2 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAt UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Software Engineering Director, you'll play a critical role in delivering care and improving health outcomes by connecting people with the care, pharmacy benefits, data, and resources they need to feel their best.The...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAt UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. Our mission is to advance health equity and improve health outcomes, particularly for those who are disproportionately affected by health disparities.Key Responsibilities:Ensure that all standard requirements are met and...
-
Lead AWS Data Engineer
1 month ago
Hyderabad, Telangana, India Manuh Technologies Full timePosition Lead : AWS Data Engineer. Location : Pune/ Gurgaon/Hyderabad Hybrid. Experience : 9+. Job Description : - 9+ years of experience as a Data Engineer on the AWS Stack PySpark. - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM,...
-
Lead AWS Data Engineer
1 month ago
Hyderabad, India Manuh Technologies Full timePosition Lead : AWS Data Engineer. Location : Pune/ Gurgaon/Hyderabad Hybrid. Experience : 9+. Job Description : - 9+ years of experience as a Data Engineer on the AWS Stack PySpark. - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM,...
-
Data Architect
3 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAt UnitedHealth Group, we are committed to helping people live healthier lives and making the health system work better for everyone. Our mission is to address health disparities and improve health outcomes, an enterprise priority reflected in our mission. We are seeking a talented Data Architect to join our team and contribute to this mission.Key...
-
Logistics Software Engineer
1 week ago
Hyderabad, Telangana, India Ninja Van Full timeAbout Ninja VanNinja Van is a leading late-stage logistics startup that is revolutionizing the industry with cutting-edge technology and innovative solutions. Founded in 2014 in Singapore, we have rapidly expanded to become one of Southeast Asia's largest and fastest-growing express logistics companies, delivering to 100 million customers across the region...
-
Lead Data Quality Automation Engineer
3 weeks ago
Hyderabad, Telangana, India Epam Full timeAbout the RoleEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...
-
AWS Data Engineer Lead
3 weeks ago
Hyderabad, India Manuh Technologies Full timeJob Title: Lead AWS Data EngineerAt Manuh Technologies, we are seeking a highly skilled and experienced Lead AWS Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable code for our high-scale data applications and services.Key...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India PepsiCo Full timeJob SummaryAs a key member of the data & analytics team at PepsiCo, you will be responsible for developing and overseeing the company's data product build & operations. This role requires a strong technical expert who can drive a vision for how data engineering can proactively create a positive impact on the business. You will lead the development of large...
-
Staff Software Engineer
2 weeks ago
Hyderabad, Telangana, India Ninja Van Full timeAbout Ninja VanNinja Van is a late-stage logistics technology startup that is revolutionizing the industry with innovation and cutting-edge technology. Founded in 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies.We've delivered to 100 million different customers across the...
-
Senior Data Quality Engineer
3 weeks ago
Pune/Hyderabad, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full timeJob Title: Senior Data Quality EngineerWe are seeking a highly skilled Senior Data Quality Engineer to join our team at IFlowTech Solutions Private Limited. As a Senior Data Quality Engineer, you will be responsible for designing and implementing data quality metrics that meet the requirements of our large data volume enterprise.Key Responsibilities:Develop...
-
Python
5 months ago
Hyderabad, Telangana, India GEM Techsoft Private limited Full timeMandatory Skills Strong in python programming / Python Developer & hands on expertise, Advance python (OOPS), strong in MySQL/SQL. Python API/ Flask/Django Framework. Preferred Skills Python Basic Library, AI/ ML experience, Docker, Kubernetes, OpenShift, modern web UI technologies; HTML5, ReactJS, RESTful services, WebSocket's, PySpark, HIVE, Agile...
-
Software Engineering Advisor
3 days ago
Hyderabad, India Evernorth Full timeAbout Evernorth:Evernorth Health Services, a division of The Cigna Group (NYSE: CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality. We relentlessly innovate to make the prediction, prevention, and treatment of illness and disease more accessible to millions of people.Responsibilities:Design, develop and implement data...