Pyspark Dev

1 week ago


Chennai, Tamil Nadu, India Virtusa Full time
Pyspark Dev & QA - CREQ188700 Description


Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and troubleshooting Hadoop clustersSecondary SkillsKnowledge of cloud-based infrastructure , AWS services EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDSKnowledge of deploying and managing ETL pipelines, RDBMS technologies (PostgreSQL, MySQL, Oracle, etc.).Knowledge of data frames, Pandas , data visualization tools & data miningknowledge of JIRA, Bitbucket GitHubJDThe position is seeking someone having atleast 4 years of experience with expertise in pyspark, databricks, SQL.

An individual must have good experience in extracting and manipulating data from relational databases with advanced SQL, HIVE, Python/PySpark.

ResponsibilityTo develop and implement a comprehensive quality assurance strategy for data engineering projects, ensuring that data quality standards are met throughout the data pipeline.

To collaborate with cross-functional teams to define test plans and strategies for validating data pipelines, ETL processes, and transformations using PySpark, Databricks, and SQL.To design and execute tests using SQL queries and data profiling techniques to validate the accuracy, completeness, and integrity of data stored in various data repositories, including data lakes and databases.

To adhere to formal QA processes, ensuring that the Systems Implementation (SI) team is using industry-accepted best Practices.
Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills PySpark Years of Experience 5 Travel No
  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...


  • Chennai, Tamil Nadu, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations.Job Description:Must Have:15+ years' experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, Tamil Nadu, India RELX India (Pvt) Ltd Risk div Company Full time

    About the RoleThis role performs complex research, design, and software development assignments within a software functional area or product line, and provides direct input to project plans, schedules, and methodology in the development of cross-functional software products. This role performs software design — typically across multiple systems; mentors...


  • Chennai, Tamil Nadu, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations. Job Description: Must Have: 15+ years' experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, Tamil Nadu, India LexisNexis Risk Solutions Full time

    Senior Software Engineer IIWould you like to be part of a team that delivers high-quality software to our customers?Are you a Data Engineer with keen interest of keeping up to date with new technologies?About the BusinessWith more than 10,000 global customers, Brightmine, formerly XpertHR, is a leading provider of people data, analytics and insight for the...


  • Chennai, Tamil Nadu, India RELX Full time

    Senior Software Engineer II Would you like to be part of a team that delivers high-quality software to our customers Are you a highly visible champion with a 'can do' attitude and enthusiasm that inspires others About the Business At Cirium, our goal is to keep the world connected. We are the industry leader in aviation analytics;...

  • Senior Analyst

    1 week ago


    Chennai, Tamil Nadu, India Tiger Analytics Full time

    Job Title: Senior Analyst / MLE (Backend - ML Platform)India Locations: Chennai | Hyderabad | Bangalore Tiger Analytics is one of the fastest growing advanced analytics consulting and Engineering services firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring...


  • Chennai, Tamil Nadu, India AT&T Full time

    Job Description : About the Company: At AT&T, we're connecting the world through the latest tech, top-of-the-line communications and the best in entertainment. Our groundbreaking digital solutions provide intuitive and integrated experiences for millions of customers across online, retail and care channels. Join our mission to deliver compelling...


  • Chennai, Tamil Nadu, India RELX Full time

    Senior Software Engineer IIWould you like to be part of a team that delivers high-quality software to our customersAre you a highly visible champion with a 'can do' attitude and enthusiasm that inspires othersAbout the BusinessAt Cirium, our goal is to keep the world connected. We are the industry leader in aviation analytics; helping our customers...

  • Pyspark Dev

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data Knowledge of installing, configuring, debugging...

  • Databricks Engineer

    3 weeks ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Engineer

    1 month ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • Databricks Engineer

    1 month ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Engineer

    3 weeks ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • Data Engineer

    2 weeks ago


    chennai, India VIDPRO CONSULTANCY SERVICES Full time

    Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / DatabricksPrimary Roles and Responsibilities : - Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development...

  • Azure_Engineer

    2 months ago


    Chennai, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!Data Engineer Azure –[BLR/MUM/GUR/PUNE/CHENNAI]Job Description:If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Engineer -Azure, you will work in the...

  • Azure_Engineer

    3 weeks ago


    Chennai, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!Data Engineer Azure –[BLR/MUM/GUR/PUNE/CHENNAI]Job Description:If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Engineer -Azure, you will work in the...

  • Delivery Manager

    4 weeks ago


    Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations. Job Description: Must Have: 15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    About the RoleThis role performs complex research, design, and software development assignments within a software functional area or product line, and provides direct input to project plans, schedules, and methodology in the development of cross-functional software products. This role performs software design — typically across multiple systems; mentors...


  • Chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    About the RoleThis role performs complex research, design, and software development assignments within a software functional area or product line, and provides direct input to project plans, schedules, and methodology in the development of cross-functional software products. This role performs software design — typically across multiple systems; mentors...


  • Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations.Job Description:Must Have:15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations. Job Description: Must Have: 15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations.Job Description:Must Have:15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations.Job Description:Must Have:15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...


  • Chennai, India Thryve Digital Health LLP Full time

    We are looking for a Data Program/Delivery Manager for our Chennai/Hyderabad Locations.Job Description:Must Have:15+ years’ experience. Strong communication, problem solving and team management skills. Must have data engineering or analytics background and preferably with US healthcare experience. Exposure to product or experience working in onsite...

  • Azure Data Engineer

    2 months ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, India VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...

  • Azure Data Engineer

    2 months ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...

  • Senior Consultant

    2 months ago


    Bangalore,Gurgaon,Gurugram,Pune,Chennai,Kolkata, India VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...

  • Azure Data Engineer

    3 weeks ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...