Etl QA with Azure Data Bricks and Pyspark

1 week ago


Hyderabad Telangana, India Cognizant Full time

**Exp: 9.5 to 13 years**

**Skill: ETL QA with Azure data bricks and Pyspark**

**Location : Bangalore/Hyderabad/Kolkata/Pune/Chennai**

**Technical Skills**:
Tableau ,Azure SQL Domain Skills

**Roles & Responsibilities : -**

Develop and maintain Tableau dashboards to provide actionable insights for various business units - Utilize Azure SQL to manage and manipulate large datasets efficiently - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs - Ensure data accuracy and integrity by implementing robust data validation processes - Optimize existing Tableau dashboards for performance and usability - Provide technical support and troubleshooting for Tableau and Azure SQL-related issues - Conduct regular data analysis to identify trends, patterns, and opportunities for improvement - Create detailed documentation for data processes, dashboards, and SQL queries - Train and mentor junior team members on best practices in Tableau and Azure SQL - Participate in code reviews to ensure high-quality deliverables - Stay updated with the latest industry trends and technologies to continuously improve skills and knowledge - Work closely with stakeholders to gather requirements and translate them into technical specifications - Ensure compliance with data governance and security policies -Qualifications - Possess a Bachelors degree in Computer Science, Information Technology, or a related field - Have a minimum of 5 years of experience working with Tableau and Azure SQL - Demonstrate strong problem-solving skills and attention to detail - Exhibit excellent communication and collaboration abilities - Show proficiency in data visualization and dashboard creation - Nice to have experience with Tableau Advanced Management - Ability to work independently and manage multiple tasks simultaneously - Strong analytical skills with the ability to interpret complex data sets - Experience in optimizing SQL queries for performance - Familiarity with data governance and security best practices - Proven track record of delivering high-quality data solutions - Ability to train and mentor junior team members effectively - C



  • Hyderabad, Telangana, India AT&T Full time

    Key Responsibilities Data Engineering Architecture Design develop and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark Build and manage scalable data ingestion frameworks for batch and real-time data processing Implement and optimize data lake architecture in Azure Data Lake to support...


  • Hyderabad, India knowledge Artisan Full time

    About the Role :We are looking for Sr. Azure Data Engineers to design, develop, and optimize data engineering pipelines on Azure. You will work hands-on with Azure Data Factory, Databricks (PySpark), Azure Synapse, and ADLS Gen2, ensuring scalable, high-performance solutions and collaborating with BI teams for analytics.Key Responsibilities :- Design and...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, India Fragma Data Systems Full time

    Job Description Must-Have Skills - Good experience in Pyspark - Including Dataframe core functions and Spark SQL - Good experience in SQL DBs - Be able to write queries including fair complexity. - Should have excellent experience in Big Data programming for data transformation and aggregations - Good at ELT architecture. Business rules processing and data...

  • PySpark QA

    1 week ago


    Hyderabad, India Virtusa Full time

    PySpark QA - CREQ Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse,...

  • PySpark QA

    1 week ago


    Hyderabad, India Virtusa Full time

    PySpark QA - CREQ Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to...

  • Bigdata Validation

    2 weeks ago


    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** 4-8 Years of QA experience in Bigdata Ecosystem -Hortonworks (HiveQL HDFS) Sqoop Spark Strong in SQL and work experience in Azure data bricks PySpark.. Having knowledge in Scripting Python and Control-M is an added advantage.. **Responsibilities** 4-8 Years of QA experience in Bigdata Ecosystem -Hortonworks (HiveQL HDFS) Sqoop Spark...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Hyderabad, India Black And White Business Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About ClientHiring for One of the Most Prestigious Multinational Corporations Job Title :Azure DatabricksQualification : Any Graduate or AboveExperience : 6 to 16 YrsLocation : pan indiaSkill required - Azure Databricks, Azure Data Factory, Azure SQL with Data Bricks Professional certificate must.Key Responsibilities:Design and build scalable and robust...

  • Azure Data Engineer

    1 week ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Experience Required: 5 to 6Years MandateMode of work: Remote (India)Skills Required: Azure Data Factory, Databricks, Pyspark, Python/Scala , SQLNotice Period : Immediate Joiners/ Permanent(Can join Immediately by 8th September 2025 )5 to 6 years of experience with Big Data technologiesExperience with Microsoft Azure cloud platform.Expertise in Azure...


  • Hyderabad, Telangana, India virtusa Full time

    Job Title Pyspark DeveloperSkills Pyspark ETLExperience 5-8 yearsLocation Pune Chennai HyderabadJob description Responsible for designing developing and maintaining ETL processes to support data integration and business intelligence initiatives Need to closely work with stakeholders to understand data requirements and ensure efficient data flow...

  • Azure Data Engineer

    4 weeks ago


    Hyderabad, India GALAXY I TECHNOLOGIES INC Full time

    Role Description :We are seeking a highly skilled Azure Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust and scalable data pipelines on the Microsoft Azure platform. This role involves integrating, transforming, and consolidating data from various sources to enable business intelligence...