Python Pyspark- Dbt

2 weeks ago

Chennai Tamil Nadu, India Virtusa Full time

Position Summary:
The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.

Minimum Qualifications:
8+ Years overall IT experience with minimum 5 years of work experience in below tech skills
Tech Skills:
Strong experience in Python Scripting and PySpark for data processing
Mandatory experience in DBT implementation
Proficiency in SQL, dealing with ETL big data
Experience in AWS Glue jobs
Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR)
Strong understanding of healthcare data systems and experience leading data engineering teams
Experience in Agile environments.
Excellent problem-solving skills and attention to detail.
Effective communication and collaboration skills.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Python/pyspark

    2 days ago

    Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    **Skills required**: Python & PySpark Machine Learning & AI Data Management & SQL Containerization Orchestration Problem-Solving & Algorithms **Education/Qualification**: Python/PySpark **Desirable skills**: CI/CD & DevOps, Big Data Processing **Years of experience**: 15+ Years **Position**:Python/PySpark** **Duties & Responsibilities**: - Use the...

  • Python Pyspark

    2 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    7 Years overall IT experience with minimum 5 years of work experience in below tech skills Tech Skills Strong experience in Python coding and PySpark for data processing Must have extensive development experience in PySpark and AWS Glue jobs Experience in AWS cloud platform and its data services S3 Redshift Lambda EMR Airflow Postgres SNS Event...

  • Snowflake Dbt Python

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    seven plus Years Snowflake Snowflake SQL Writing SQL queries against Snowflake Developing scripts Unix, Python, etc. to do Extract, Load, and Transform data Handson experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. Complex problem-solving...

  • Python Pyspark

    5 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 7+ in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life, professional and...

  • Python Pyspark

    2 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Junior data engineer Overall 6 in IT Experience Required technical skills with min 5 years of experience in Python PySpark SQL AWS Required Domain Healthcare Insurance Extensive data analysis skills and Good communication skills Experience working in framework development Experience working in agile **About Virtusa** Teamwork, quality of life, professional...

  • Python Pyspark

    4 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 8+ years in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life,...

  • Python Pyspark

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    osition Requirements: 10-12 years of experience in IT and data base/data warehouse domain Experience in writing sqls in Hive, Impala Exposure to scripting language like shell scripting, python is required. Strong SQL skills are essential; experience writing complex queries spanning multiple tables is required. Experience in AWS is plus. Working knowledge of...

  • Python Pyspark

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Position Requirements: 10-12 years of experience in IT and data base/data warehouse domain Experience in writing sqls in Hive, Impala Exposure to scripting language like shell scripting, python is required. Strong SQL skills are essential; experience writing complex queries spanning multiple tables is required. Experience in AWS is plus. Working knowledge of...

  • Snowflake Dbt

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Strong on DBT with Snowflake SQL. Snowflake SQL Writing SQL queries against Snowflake Developing scripts Unix, Python, etc. to do Extract, Load, and Transform data. Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. Complex...

  • Snowflake Dbt

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description: ETL Modernization Engineer (OSP Partner) This role is for an OSP provider resource to migrate legacy ETL pipelines (Informatica/Talend) to a modern data stack on Snowflake, dbt, and Fivetran, with strong DataOps, governance, and cost-aware design. Target experience: 7 to 8 years. Role Summary Lead end to end migration of legacy ETL workloads...