Python Pyspark SDET

1 day ago

bangalore, India InfoBeans Full time

Job Title: SDET – PySpark/Python Data Engineering (Azure Cloud) Location: Indore | Pune | Bangalore | Chennai Experience Required: 5+ years Role Overview: Seeking a skilled Software Development Engineer in Test (SDET) with expertise in PySpark and Python for data engineering and data pipeline validation on Azure Cloud. You will play a critical role in building automation frameworks, developing and executing test cases to ensure the quality and reliability of large-scale data solutions. Key Responsibilities: Develop, maintain, and execute automated test scripts for data pipelines and engineering workflows using Python and PySpark. Validate data transformations, data quality, and pipeline performance on Azure Cloud environments (preferably using Databricks). Collaborate with data engineers and developers to understand data workflows and test scenarios. Build and optimize test frameworks that integrate with CI/CD pipelines. Perform thorough regression, performance, and API testing for data applications. Report and track defects, and work closely with engineering teams for resolution. Skills & Qualifications: Strong programming skills in Python and PySpark. Experience in automated testing for data pipelines and big data platforms. Working knowledge of Azure Cloud services, including Azure Data Factory and Databricks. Familiarity with CI/CD tools and test automation frameworks. Understanding of data validation, ETL testing, and SQL query optimization. Excellent problem-solving and communication skills. Preferred: Hands-on experience with Databricks and related Azure data technologies. Background in software development and test engineering for data-intensive applications.

  • SDET with Python

    2 weeks ago

    bangalore, India SherTech Information Services Full time

    Company Description SherTech Information Services is a growing IT services company that creates scalable software applications for businesses across various domains including Healthcare, Manufacturing, eCommerce, News & Media. SherTech focuses on delivering innovative solutions that cater to the specific needs of its clients, ensuring improved efficiency and...

  • Python Developer

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Python Developer ( Python, Pyspark, Glue)Exp range: 5 yrs to 10 yrsLocation: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, KolkataNotice period –30 daysPls find the Job Description below.1.experience as Python Developer / Designer with ETL.2. Performance Improvement...

  • Python PySpark Developer

    2 days ago

    Bangalore, Karnataka, , India Overture Rede Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Key Responsibilities:• Designing and developing robust PySpark applications for large -scale dataprocessing.• Building and optimizing data ingestion, transformation, and storage processes.• Implementing efficient algorithms and data structures for distributed computing.• Collaborating with cross -functional teams to integrate data -driven solutions...

  • Pyspark developer

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code. Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to...

  • Pyspark developer

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code. Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to...

  • Python Pyspark Data Engineer

    23 hours ago

    Bangalore, Karnataka, India DXC Technology Full time

    Python Pyspark Data Engineer Job Location Hyderabad Bangalore Chennai Kolkata Noida Gurgaon Pune Indore Mumbai Strong Python Skills - Proficient in Python for data manipulation automation and building reusable components Data Pipeline Development - Experience designing and maintaining ETL data pipelines using tools like Airflow or custom scripts Database...

  • Pyspark Developer

    3 days ago

    bangalore, India Tata Consultancy Services Full time

    TCS is conducting Weekday Virtual Drive for the role of Pyspark DeveloperLocation: Bangalore, Pune, Hyderabad, Gurugram, ChennaiYears of Experience: 5 to 10 yrsNotice Period: 0 to 30/ 60 daysDate of Interview: 30th Oct, 2025(Thursday)Time of Interview: 10 AM to 4 PMResponsibilitiesGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive,...

  • Pyspark Developer

    2 days ago

    bangalore, India Tata Consultancy Services Full time

    TCS is conducting Weekday Virtual Drive for the role of Pyspark Developer Location: Bangalore, Pune, Hyderabad, Gurugram, Chennai Years of Experience: 5 to 10 yrs Notice Period: 0 to 30/ 60 days Date of Interview: 30th Oct, 2025(Thursday) Time of Interview: 10 AM to 4 PM Responsibilities Good work experience on Big Data Platforms like Hadoop, Spark, Scala,...

  • Senior Data Engineer

    5 days ago

    bangalore, India Digivance Solutions Full time

    Job Title: Data EngineerLocation: HyderabadExperience Required: 7+ years (3+ years relevant in PySpark, Azure Data Factory, Apache HIve and Python)Must have Open Positions: 3Round of Interviews: 1- Assessment (1:30 hours) 2- Panel (Hyderabad F2F)Valid Passport: Mandate Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using PySpark...

  • SDET SME

    2 weeks ago

    Bangalore, India Digitide Full time

    Role - SDET SME Experience - 12+ years Notice Period - Immediate joiners preferred Location - Mahadevpura, Bengaluru (Onsite) Key Responsibilities Design, develop, and maintain end-to-end automated test frameworks and scripts. Act as SME for multiple automation tools, guiding teams on best practices and tool adoption. Collaborate with multiple QA teams to...