Pyspark Developer
4 weeks ago
TCS is Hiring for Pyspark Developer
Experience : 5 - 12 years
Location: Bangalore/Hyderabad/Pune
Please find the JD below
Must-Have
Mandatory: Primary skill: Pyspark.
3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
Must have excellent knowledge in Apache Spark and Python programming experience.
Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.
Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
Should have experience in fine-tuning process and troubleshooting performance issue.
Experience in source code control systems like git, GitHub, SVN etc.
Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.
Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.
Excellent communication and interpersonal skills.
Good-to-Have
Understanding of Unix/Linux Shell Scripting
Should understand and have operating experience with Agile delivery methodologies.
Should have hands-on experience in the following: data validation, writing unit test cases.
Working experience of ETL Tools like Data Stage, Talend etc. is an added advantage.
Working experience on Databricks / Delta Lake is an added advantage.
-
PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Kairos Konnect Full timePyspark Developer Key things : Python, PysparkOffshore Years exp 6+ yrsNo of positions : 5 rolesHyderabad- 5 days onsiteShift timings are 1pm-10pmResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeGreetings from TATA CONSULTANCY SERVICES LIMITED Role–Pyspark DeveloperExperience Range-5 to 10 yearsWork Location –Hyderabad, PuneSKILLS REQUIRED:Analyze existing Teradata tables and Data Warehouse structures.Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.Develop PySpark scripts to extract, transform, and load...
-
Python Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. Key Skills: (Must Have) Programming Languages: Python Big Data Technologies: PySpark Database Technologies: SQL Communication & Collaboration: Excellent...
-
Python Pyspark Developer
4 weeks ago
Hyderabad, Telangana, India Coforge Full time- Job Title: Python Pyspark Developer- Experience- 5.0 - 12.0 years- Location- Hyderabad- Shift- Shift (02:00 pm -10:30 pm)- Mode- Strictly Work from Office- Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)- Programming Languages: Python- Big Data Technologies: PySpark- Database Technologies: SQL- Communication & Collaboration:...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Full timeJob DescriptionDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market If so, we are excited to have bumped onto you.Learn how we are redefining themeaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.- Jobseeker Video Testimonials- Employee Glassdoor...
-
PySpark QA
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timePySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...
-
Python Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...
-
Python Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. We at Coforge are looking for below skill set: Communication & Collaboration: Excellent written and verbal communication skills Strong proficiency in...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...
-
PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Kairos Konnect Full timeResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating manual processes,...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Folks Palette LLP Full timeJob Description :Responsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Kairos Konnect Full timeResponsibilities : - Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating manual processes,...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Corporate Resources Full timeJob Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...
-
Senior PySpark Developer
4 hours ago
Hyderabad, Telangana, India S P A Enterprise Services Ltd. Full timeKey Responsibilities- Implement data transformation logic, data cleansing, and data enrichment processes to ensure data quality and consistency.- Optimize data pipelines and queries using Spark SQL and PySpark to improve performance and scalability.- Refactor and modernize legacy codebases, focusing on clean code, improved readability, and maintainability.-...
-
Software Engineer II-PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Chase Bank Full timeJob DescriptionYou're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you.As a PySpark Developer Software Engineer II at JPMorgan Chase within the Commercial & Investment Bank Payments Technology team, you are part of an agile team that works to...
-
Python Pyspark Developer
2 days ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)Programming Languages: Python Big Data Technologies: Py Spark Database Technologies: SQLCommunication & Collaboration: Excellent written...
-
- PySpark Developer
4 weeks ago
Hyderabad, Telangana, India DATA ECONOMY PRIVATE LIMITED Full timeKey Responsibilities : - Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks.- Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.- ETL Pipeline Development : Create, manage, and optimize ETL pipelines using PySpark...
-
Python and PySpark Expert Wanted
8 hours ago
Hyderabad, Telangana, India SOULPAGE IT SOLUTIONS PRIVATE LIMITED Full timeAbout UsSoulpage IT Solutions is an innovative AI/ML technology company based in Hyderabad. Our company specializes in cutting-edge solutions for data engineering, AI, and cloud-based analytics.The OpportunityWe are seeking an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. As a Data Engineer at...
-
PySpark SQL Specialist in Cloud Data Engineering
4 hours ago
Hyderabad, Telangana, India HireIT Consultants Full timeJob TitleSQL Developer with PySpark Coding Job DescriptionAbout the PositionWe are seeking a skilled SQL Developer to work on designing, implementing, and maintaining data pipelines and ensuring data accuracy, integrity, and performance in a cloud or on-premise environment.Key AccountabilitiesDesign and implement data processing pipelines using PySpark to...