Senior Software Engineer- Python, Pyspark

2 weeks ago


Hyderabad, Telangana, India myGwork Full time
This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About the Role: Grade Level (for internal use): 10 S&P Dow Jones Indices is seeking a Python/Bigdata developer to be a key player in the implementation and support of data Platforms for S&P Dow Jones Indices. This role requires a seasoned technologist who contributes to application development and maintenance. The candidate should actively evaluate new products and technologies to build solutions that streamline business operations. The candidate must be delivery-focused with solid financial applications experience. The candidate will assist in day-to-day support and operations functions, design, development, and unit testing. Responsibilities and Impact: Lead the design and implementation of EMR / Spark workloads using Python, including data access from relational databases and cloud storage technologies. Implement new powerful functionalities using Python, Pyspark, AWS and Delta Lake. Independently come up with optimal designs for the business use cases and implement the same using big data technologies. Enhance existing functionalities in Oracle/Postgres procedures, functions. Performance tuning of existing Spark jobs. Respond to technical queries from operations and product management team. Implement new functionalities in Python, Spark, Hive. Enhance existing functionalities in Postgres procedures, functions. Collaborate with cross-functional teams to support data-driven initiatives. Mentor junior team members and promote best practices. Respond to technical queries from the operations and product management team. What We're Looking For: Basic Required Qualifications: Bachelor's degree in computer science, Information Systems, or Engineering, or equivalent work experience. 5 - 8 years of IT experience in application support or development. Hands on development experience on writing effective and scalable Python programs. Deep understanding of OOP concepts and development models in Python. Knowledge of popular Python libraries/ORM libraries and frameworks. Exposure to unit testing frameworks like Pytest. Good understanding of spark architecture as the system involves data intensive operations. Good amount of work experience in spark performance tuning. Experience/exposure in Kafka messaging platform. Experience in Build technology like Maven, Pybuilder. Exposure with AWS offerings such as EC2, RDS, EMR, lambda, S3,Redis. Hands on experience in at least one relational database (Oracle, Sybase, SQL Server, PostgreSQL). Hands on experience in SQL queries and writing stored procedures, functions. A strong willingness to learn new technologies. Excellent communication skills, with strong verbal and writing proficiencies. Additional Preferred Qualifications: Proficiency in building data analytics solutions on AWS Cloud. Experience with microservice and serverless architecture implementation. About S&P Global Dow Jones Indices At S&P Dow Jones Indices, we provide iconic and innovative index solutions backed by unparalleled expertise across the asset-class spectrum. By bringing transparency to the global capital markets, we empower investors everywhere to make decisions with conviction. We're the largest global resource for index-based concepts, data and research, and home to iconic financial market indicators, such as the S&P 500 and the Dow Jones Industrial Average. More assets are invested in products based upon our indices than any other index provider in the world. With over USD 7.4 trillion in passively managed assets linked to our indices and over USD 11.3 trillion benchmarked to our indices, our solutions are widely considered indispensable in tracking market performance, evaluating portfolios and developing investment strategies. S&P Dow Jones Indices is a division of S&P Global (NYSE: SPGI). S&P Global is the world's foremost provider of credit ratings, benchmarks, analytics and workflow solutions in the global capital, commodity and automotive markets. With every one of our offerings, we help many of the world's leading organizations navigate the economic landscape so they can plan for tomorrow, today. For more information, visit www.spglobal.com/spdji. What's In It For You? Our Purpose: Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world. Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence, pinpointing risks and opening possibilities. We Accelerate Progress. Our People: We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all. From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference. Our Values: Integrity, Discovery, Partnership At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of integrity in all we do, bring a spirit of discovery to our work, and collaborate in close partnership with each other and our customers to achieve shared goals. Benefits: We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global. Our benefits include: Health & Wellness: Health care coverage designed for the mind and body. Flexible Downtime: Generous time off helps keep you energized for your time on. Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills. Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs. Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families. Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference. For more information on benefits by country visit: https://spgbenefits.com/benefit-summaries Inclusive Hiring and Opportunity at S&P Global: At S&P Global, we are committed to fostering an inclusive workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and equal opportunity, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
----------------------------------------------------------- Equal Opportunity Employer S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment. If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.

US Candidates Only: The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp_%20English_formattedESQA508c.pdf ----------------------------------------------------------- 20 - Professional (EEO-2 Job Categories-United States of America), IFTECH202.1 - Middle Professional Tier I (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning) Job ID: 310741 Posted On: 2025-03-11 Location: Hyderabad, Telangana, India#LI-DNI

  • Hyderabad, Telangana, India ScaleOrange Technologies Pvt Ltd Full time

    About the Role:We are seeking a senior Data Engineering professional to join our team on a contract basis.The ideal candidate should have strong expertise in SQL, Python, and PySpark, with at least 4+ years of experience in data engineering.Key Responsibilities:Develop and optimize advanced SQL queries for data extraction and transformation.Work with Python...


  • Hyderabad, Telangana, India Coforge Full time

    Company Overview: At Coforge, we empower businesses to succeed in a rapidly changing world by leveraging technology and innovation. Our team of experts works tirelessly to deliver high-quality solutions that meet the evolving needs of our clients.Job Description: We are looking for a Senior Big Data Engineer to join our team. As a key member of our...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. Key Skills: (Must Have) Programming Languages: Python Big Data Technologies: PySpark Database Technologies: SQL Communication & Collaboration: Excellent...


  • Hyderabad, Telangana, India SOULPAGE IT SOLUTIONS PRIVATE LIMITED Full time

    About UsSoulpage IT Solutions is an innovative AI/ML technology company based in Hyderabad. Our company specializes in cutting-edge solutions for data engineering, AI, and cloud-based analytics.The OpportunityWe are seeking an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. As a Data Engineer at...


  • Hyderabad, Telangana, India Nagarro Software Pvt. Ltd Full time

    We're Nagarro - A Digital Product Engineering CompanyNagarro Software Pvt. Ltd is a leading provider of digital product engineering services. We help our clients create innovative products, services, and experiences that inspire and delight users.Our team is made up of experts in data engineering, with a strong focus on BigQuery, Cloud Composer, and PySpark....


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...

  • PySpark QA

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    PySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. We at Coforge are looking for below skill set: Communication & Collaboration: Excellent written and verbal communication skills Strong proficiency in...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title:Python Pyspark DeveloperExperience-5.0 - 12.0 yearsLocation-HyderabadShift-Shift (02:00 pm -10:30 pm)Mode-Strictly Work from OfficeNotice Period-Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and relevant...


  • Hyderabad, Telangana, India Artmac Soft LLC Full time

    Who We AreArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers Job Title AWS Data Engineer with PySpark 2024 -Freshers Job Type Full TimeExperience 0-1 yearsLocation Hyderabad TelanganaResponsibilities Basic understanding of AWS cloud services S3 ...


  • Hyderabad, Telangana, India SaiRa People Tech Solutions Private Limited Full time

    Job DescriptionSaiRa People Tech Solutions Private Limited seeks a highly skilled Senior Software Engineer to join our team. As a key member of our software development group, you will play a vital role in designing, developing, and implementing cutting-edge solutions using Python, React JS, and microservices with Flask.The ideal candidate will have strong...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)Programming Languages: Python Big Data Technologies: Py Spark Database Technologies: SQLCommunication & Collaboration: Excellent written...


  • Hyderabad, Telangana, India Nagarro Software Pvt. Ltd Full time

    We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 36 countries, to be exact). Our work culture is dynamic and...


  • Hyderabad, Telangana, India myGwork Full time

    This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About the Role: Grade Level (for internal use): 10 S&P Dow Jones Indices is seeking a Python/Bigdata developer to be a key player in the implementation and support of data...


  • Hyderabad, Telangana, India Coforge Full time

    Company Overview">Coforge is a leading provider of digital transformation services, helping businesses navigate the complexities of the modern tech landscape.">Job Description">We are seeking a highly skilled Senior Data Science Engineer with expertise in PySpark to join our team. As a key member of our data science group, you will be responsible for...


  • Hyderabad, Telangana, India 4S Advisory Full time

    The role of Senior Software Engineer Python at 4S Advisory involves designing, developing, and deploying large-scale applications that meet the needs of our clients. We are looking for an experienced professional with a strong background in Python development and a passion for innovative problem-solving.Key Responsibilities:- Develop scalable and secure...


  • Hyderabad, Telangana, India Nagarro Software Pvt. Ltd Full time

    Digital Product Engineering ServicesNagarro Software Pvt. Ltd provides cutting-edge digital product engineering services to businesses worldwide. Our team of experts helps clients design and develop innovative products, services, and experiences that drive business growth and customer engagement.We are currently seeking an experienced Senior Data Engineer to...


  • Hyderabad, Telangana, India Evernorth Health Services Full time

    Evaluate Your Skills:Are you a skilled Full Stack Python/PySpark developer looking for a new challenge? Do you have experience working in Agile/Scrum teams and knowledge of Microservice Architecture?We are seeking an experienced Software Engineer to join our Provider Technology organization and take on the role of designing and implementing software for the...


  • Hyderabad, Telangana, India HireIT Consultants Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our dynamic data engineering team at HireIT Consultants. The ideal candidate will have expertise in SQL and PySpark, with experience in designing, implementing, and maintaining data pipelines.About the RoleThe successful candidate will be responsible for writing, optimizing, and maintaining...