- PySpark Developer
4 weeks ago
Key Responsibilities :
- Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks.
- Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.
- ETL Pipeline Development : Create, manage, and optimize ETL pipelines using PySpark for large-scale data processing.
- CI/CD Implementation : Build and maintain CI/CD pipelines for deploying and maintaining cloud-based applications.
- Data Analysis : Perform detailed data analysis and deliver actionable insights to stakeholders.
- Collaboration : Work closely with cross-functional teams to understand requirements, present solutions, and ensure alignment with business goals.
- Agile Methodology : Operate effectively in agile or hybrid agile environments, delivering high-quality results within tight deadlines.
- Framework Development : Enhance and expand existing frameworks and capabilities to support evolving business needs.
- Documentation and Communication : Create clear documentation and present technical solutions to both technical and non-technical audiences.
Required Qualifications :
Experience :
- 10+ years of experience with Python programming.
- 5+ years of experience in cloud infrastructure, particularly AWS.
- 3+ years of experience with PySpark, including usage with EMR or Glue Notebooks.
- 3+ years of experience with Apache Airflow for workflow orchestration.
- Solid experience with data analysis in fast-paced environments.
Domain Expertise :
- Strong understanding of capital markets, financial systems, or prior experience in the financial domain is a must.
Technical Skills :
- Proficiency with cloud-native technologies and frameworks.
- Familiarity with CI/CD practices and tools like Jenkins, GitLab CI/CD, or AWS CodePipeline.
- Experience with notebooks (e.g., Jupyter, Glue Notebooks) for interactive development.
Soft Skills :
- Excellent problem-solving skills and ability to handle complex technical challenges.
- Strong communication and interpersonal skills for collaboration across teams and presenting solutions to diverse audiences.
- Ability to thrive in a fast-paced, dynamic environment.
Preferred Qualifications :
- Familiarity with machine learning frameworks and techniques for financial modeling.
- Certifications in AWS or other cloud technologies. (ref:hirist.tech)
-
Pyspark Developer
4 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeGreetings from Tata Consulting ServicesTCS is Hiring for Pyspark DeveloperExperience : 5 - 12 yearsLocation: Bangalore/Hyderabad/PunePlease find the JD belowMust-HaveMandatory: Primary skill: Pyspark.3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for...
-
PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Kairos Konnect Full timePyspark Developer Key things : Python, PysparkOffshore Years exp 6+ yrsNo of positions : 5 rolesHyderabad- 5 days onsiteShift timings are 1pm-10pmResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeGreetings from TATA CONSULTANCY SERVICES LIMITED Role–Pyspark DeveloperExperience Range-5 to 10 yearsWork Location –Hyderabad, PuneSKILLS REQUIRED:Analyze existing Teradata tables and Data Warehouse structures.Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.Develop PySpark scripts to extract, transform, and load...
-
Python Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. Key Skills: (Must Have) Programming Languages: Python Big Data Technologies: PySpark Database Technologies: SQL Communication & Collaboration: Excellent...
-
Python Pyspark Developer
4 weeks ago
Hyderabad, Telangana, India Coforge Full time- Job Title: Python Pyspark Developer- Experience- 5.0 - 12.0 years- Location- Hyderabad- Shift- Shift (02:00 pm -10:30 pm)- Mode- Strictly Work from Office- Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)- Programming Languages: Python- Big Data Technologies: PySpark- Database Technologies: SQL- Communication & Collaboration:...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Full timeJob DescriptionDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market If so, we are excited to have bumped onto you.Learn how we are redefining themeaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.- Jobseeker Video Testimonials- Employee Glassdoor...
-
PySpark QA
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timePySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...
-
Python Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...
-
Python Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. We at Coforge are looking for below skill set: Communication & Collaboration: Excellent written and verbal communication skills Strong proficiency in...
-
PySpark
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Folks Palette LLP Full timeJob Description :Responsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Kairos Konnect Full timeResponsibilities : - Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating manual processes,...
-
Pyspark Developer
3 weeks ago
Hyderabad, Telangana, India Corporate Resources Full timeJob Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...
-
Senior PySpark Developer
1 day ago
Hyderabad, Telangana, India S P A Enterprise Services Ltd. Full timeKey Responsibilities- Implement data transformation logic, data cleansing, and data enrichment processes to ensure data quality and consistency.- Optimize data pipelines and queries using Spark SQL and PySpark to improve performance and scalability.- Refactor and modernize legacy codebases, focusing on clean code, improved readability, and maintainability.-...
-
Software Engineer II-PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Chase Bank Full timeJob DescriptionYou're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you.As a PySpark Developer Software Engineer II at JPMorgan Chase within the Commercial & Investment Bank Payments Technology team, you are part of an agile team that works to...
-
Python Pyspark Developer
3 days ago
Hyderabad, Telangana, India Coforge Full timeJob Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)Programming Languages: Python Big Data Technologies: Py Spark Database Technologies: SQLCommunication & Collaboration: Excellent written...
-
Python and PySpark Expert Wanted
2 days ago
Hyderabad, Telangana, India SOULPAGE IT SOLUTIONS PRIVATE LIMITED Full timeAbout UsSoulpage IT Solutions is an innovative AI/ML technology company based in Hyderabad. Our company specializes in cutting-edge solutions for data engineering, AI, and cloud-based analytics.The OpportunityWe are seeking an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. As a Data Engineer at...
-
Hyderabad, Telangana, India HireIT Consultants Full timeJob TitleSQL Developer with PySpark Coding Job DescriptionAbout the PositionWe are seeking a skilled SQL Developer to work on designing, implementing, and maintaining data pipelines and ensuring data accuracy, integrity, and performance in a cloud or on-premise environment.Key AccountabilitiesDesign and implement data processing pipelines using PySpark to...
-
Azure Databricks/PySpark Engineer
3 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...