Capco - Big Data Tester - Python/PySpark

15 hours ago

Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

Position : Big Data Tester

Experience : 5-9 Years

Location : Pune, India

Job Summary :

We are seeking an experienced Big Data Tester with 5-9 years of experience in software quality assurance, with a dedicated focus on data. The ideal candidate will have a strong background in Python, PySpark, and SQL, along with a proven track record of implementing best practices for data validation and ETL testing. You will be responsible for ensuring the accuracy, integrity, and reliability of our large-scale data systems. This role is perfect for a detail-oriented professional with a strong technical skillset and a passion for data quality.

Key Responsibilities :

Data Validation and Testing :

- Design, develop, and execute comprehensive test plans and test cases for Big Data applications.

- Perform data validation and integrity checks across various data sources and systems.

- Use Python and PySpark to write scripts and automate testing for ETL processes and data pipelines.

SQL & Data Querying :

- Write and optimize complex SQL queries to validate data transformations and business logic.

- Perform data analysis and use querying skills to identify discrepancies and anomalies.

Troubleshooting and Collaboration :

- Work closely with data engineers and developers to troubleshoot and resolve data quality issues.

- Participate in the entire software development lifecycle, ensuring quality is integrated from the start.

Required Skills & Qualifications

Core Experience : 5-9 years of experience in a testing or quality assurance role.

Mandatory Technical Skills :

- Expertise in Python and PySpark for data processing and automation.

- Extensive hands-on experience with SQL, including writing complex queries.

- Strong knowledge of ETL processes and best practices for data validation.

Professional Attributes :

- A strong, hands-on approach to testing and a meticulous attention to detail.

- Excellent analytical and problem-solving skills.

- Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Skills :

- Experience with Unix environments.

- Hands-on experience with Big Data technologies such as Hadoop, Spark, Kafka, and NoSQL databases (MongoDB, Cassandra, Hive, etc.).

- Experience with both traditional and modern Data Warehousing solutions (Oracle, Teradata, SQL Server, Amazon Redshift, Google BigQuery, Snowflake).

- Prior development experience in AWS.

(ref:hirist.tech)

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Capco Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Big Data Engineer - ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Capco - Python Full Stack Developer - Django/

    3 days ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Title : Python Full-Stack Developer -PuneAbout Us :Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients...

  • Fullstack with Python

    2 days ago

    Pune, Maharashtra, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors....

  • Fullstack with Python

    24 hours ago

    Pune, Maharashtra, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy...

  • Api Automation Tester

    1 week ago

    Pune, Maharashtra, India Capco Full time

    About Us Capco a Wipro company is a global technology and management consulting firm Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by With our presence across 32 cities across globe we support 100 clients across banking financial and Energy sectors We are...

  • Python Full-Stack Developer

    1 week ago

    Pune, Maharashtra, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:  Python Full-Stack Developer - Bangalore/ PuneAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support...

  • Python Full-Stack Developer

    2 days ago

    Pune, Maharashtra, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title: Python Full-Stack Developer - Bangalore/ PuneAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...

  • API Automation Tester

    2 days ago

    Pune, Maharashtra, India Capco Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Senior Python Full Stack Developer

    2 weeks ago

    Pune, Maharashtra, India Capco Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Python Full Stack Developer - PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...

  • Senior Python Full Stack Developer

    2 days ago

    Pune, Maharashtra, India Capco Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Python Full Stack Developer - PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...