Capco - Big Data Tester - Python/PySpark

3 weeks ago

Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

Position : Big Data Tester

Experience : 5-9 Years

Location : Pune, India

Job Summary :

We are seeking an experienced Big Data Tester with 5-9 years of experience in software quality assurance, with a dedicated focus on data. The ideal candidate will have a strong background in Python, PySpark, and SQL, along with a proven track record of implementing best practices for data validation and ETL testing. You will be responsible for ensuring the accuracy, integrity, and reliability of our large-scale data systems. This role is perfect for a detail-oriented professional with a strong technical skillset and a passion for data quality.

Key Responsibilities :

Data Validation and Testing :

- Design, develop, and execute comprehensive test plans and test cases for Big Data applications.

- Perform data validation and integrity checks across various data sources and systems.

- Use Python and PySpark to write scripts and automate testing for ETL processes and data pipelines.

SQL & Data Querying :

- Write and optimize complex SQL queries to validate data transformations and business logic.

- Perform data analysis and use querying skills to identify discrepancies and anomalies.

Troubleshooting and Collaboration :

- Work closely with data engineers and developers to troubleshoot and resolve data quality issues.

- Participate in the entire software development lifecycle, ensuring quality is integrated from the start.

Required Skills & Qualifications

Core Experience : 5-9 years of experience in a testing or quality assurance role.

Mandatory Technical Skills :

- Expertise in Python and PySpark for data processing and automation.

- Extensive hands-on experience with SQL, including writing complex queries.

- Strong knowledge of ETL processes and best practices for data validation.

Professional Attributes :

- A strong, hands-on approach to testing and a meticulous attention to detail.

- Excellent analytical and problem-solving skills.

- Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Skills :

- Experience with Unix environments.

- Hands-on experience with Big Data technologies such as Hadoop, Spark, Kafka, and NoSQL databases (MongoDB, Cassandra, Hive, etc.).

- Experience with both traditional and modern Data Warehousing solutions (Oracle, Teradata, SQL Server, Amazon Redshift, Google BigQuery, Snowflake).

- Prior development experience in AWS.

(ref:hirist.tech)

  • Big Data Engineer

    20 hours ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Big Data Engineer - ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across...

  • Mid-Data Engineer with Python

    1 week ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer with Python & Snowflake- PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...

  • Capco - Python Full Stack Developer - Django/

    3 weeks ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Title : Python Full-Stack Developer -PuneAbout Us :Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients...

  • Api Automation Tester

    4 weeks ago

    Pune, Maharashtra, India Capco Full time

    About Us Capco a Wipro company is a global technology and management consulting firm Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by With our presence across 32 cities across globe we support 100 clients across banking financial and Energy sectors We are...

  • Fullstack with Python

    17 hours ago

    Pune, Maharashtra, India Capco Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors....

  • iKrux - Big Data Tester

    4 days ago

    Pune, Maharashtra, India IKRUX SOLUTIONS (OPC) PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Job Description : We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark/PySpark. The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.Key Responsibilities : -...

  • API Automation Tester

    20 hours ago

    Pune, Maharashtra, India Capco Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Big Data Tester

    19 hours ago

    Pune, Maharashtra, India Shavish Hr And Digital Marketing Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big data Tester have a good Big Data testing, focusing on both automated & manual testing for data validation.Strong understanding of Hadoop ecosystem.Skilled in writing & executing SQL queries. Hands-on exp. with JIRA or Bugzilla.

  • Capco - Big Data NiFi Developer

    3 weeks ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Title : Big Data Nifi DeveloperLocation : Pune (Hybrid)Experience : 3 to 5 YearsWork Mode : Hybrid (2-3 days from client office, rest remote)Job Description :Key Responsibilities :- Integrate and process large volumes of data from diverse sources using Spark and NiFi workflows.- Collaborate with data engineers and analysts to transform business...

  • Big data with Python ATOS

    6 days ago

    Pune, Maharashtra, India Axiom Software Solutions Limited Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Looking for experience in Big Data technologies. • Mandatory - Hands on experience in Python and PySpark. • Build pySpark applications using Spark Dataframes in Python using Jupyter notebook and PyCharm(IDE). • Worked on optimizing spark jobs that processes huge volumes of data. • Hands on experience in version control tools like Git. • Worked...