Python Pyspark

4 days ago

Andhra Pradesh, India Virtusa Full time

Data Engineer

Position Summary

Minimum Qualifications
6 Years overall IT experience with minimum 4 years of work experience in below tech skills
Tech Skills
Proficient in Python scripting and PySpark for data processing tasks
Strong SQL capabilities with hands on experience managing big data using ETL tools like Informatica
Experience with the AWS cloud platform and its data services including S3 Redshift Lambda EMR Airflow Postgres SNS and EventBridge
Skilled in BASH Shell scripting
Understanding of data lakehouse architecture particularly with Iceberg format is a plus
Preferred Experience with Kafka and Mulesoft API
Understanding of healthcare data systems is a plus
Experience in Agile methodologies
Strong analytical and problem solving skills
Effective communication and teamwork abilities

**Responsibilities**:
Develop and maintain data pipelines and ETL processes to manage large scale datasets
Collaborate to design test data architectures to align with business needs
Implement and optimize data models for efficient querying and reporting
Assist in the development and maintenance of data quality checks and monitoring processes
Support the creation of data solutions that enable analytical capabilities
Contribute to aligning data architecture with overall organizational solutions

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Mlse (Python/pyspark)

    6 days ago

    Noida, Uttar Pradesh, India Impetus Technologies Full time

    Noida, Uttar Pradesh, India;Gurgaon, Haryana, India;Hyderabad, Telangana, India;Bangalore, Karnataka, India;Indore, Madhya Pradesh, India Qualification : - 6-8 years of good hands on exposure with Big Data technologies - pySpark (Data frame and SparkSQL), Hadoop, and Hive - Good hands on experience of python and Bash Scripts - Good understanding of SQL and...

  • Gcp + Big Query + Python

    5 days ago

    Andhra Pradesh, India Virtusa Full time

    Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data requirements. Ensure data...

  • Gcp Python

    5 days ago

    Andhra Pradesh, India Virtusa Full time

    **Skills**:Knowledge of Google Cloud Platform Google Cloud GCP cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Pyspark DWH Data warehousing concepts & dimension modeling (Good to have) Python GIT Any GCP Certification Roles & Responsibilities: Perform data analytics, warehousing, ETL development Design & Build...

  • Python Machine Learning Engineer

    6 days ago

    Uttar Pradesh - Bangalore, Karnataka, India CIEL HR Full time

    HiGreetings of the Day We have a critical opening with our client for Python Machine Learning Engineer role for Bangalore Noida location Experience 5 to 8 yrsLocation Bangalore Noida- HybridMode of Employment Contract A leading product based MNC Job descriptionKey Skill Python Azure Kubernetes GitHub SQL Feature engineering JFrog PySpark ...

  • Azure Data Architect

    2 days ago

    Andhra Pradesh, India Virtusa Full time

    **Skill - Azure Data Lead / Arch** **Location - Hyderabad** **Work mode - 5 days office** **Work timings - 12 PM to 9 PM** **JD**: - Must have work experience in Azure Synapse, Python,Pyspark and ADF. - Strong in writing SQL query, stored procedure and functions with hands-on in Power BI. Relevant Experience in Power BI, SSIS and SSRS and SQL Server -...

  • Automation Architect

    2 weeks ago

    Noida, Uttar Pradesh, India Ericsson Full time

    **Join our Team**: - About this opportunity Ericsson is a global leader in telecommunications and technology, dedicated to driving innovation and shaping the future of communication. With a commitment to pushing the boundaries of what's possible, Ericsson is at the forefront of creating solutions that address the world's most pressing challenges. As a JAVA...

  • Principal Data Engineer

    6 days ago

    Uttar Pradesh - Bangalore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Machine Learning and Data Engineer PositionWe have a highly skilled Machine Learning and Data Engineer role available for our team. The ideal candidate will have a strong background in machine learning, data engineering, and cloud computing.The key responsibilities of this role include:Design, develop, and deploy machine learning models.Perform data...

  • Data Scientist 1

    2 days ago

    Noida, Uttar Pradesh, India Optum Full time

    Requisition # 2265202 SG 26 - India role (Data Scientist) Total Position # 1 Role and Responsibilities - 1. Interaction with key stakeholders and serve as data science contact/resource to support ongoing data exchange, analysis, reporting and interpretation of performance results; establish and maintain effective ongoing client relationships 2....

  • Software Engineering Associate Advisor Hih

    1 day ago

    Hyderabad, Telangana - Andhra Pradesh, India The Cigna Group Full time

    Software Engineering Associate DirectorPosition Summary The Software Engineering Associate Director provides hands on leadership management and thought leadership for a Delivery organization enabling Cigna s Technology teams This individual will lead a team based in our Hyderabad Innovation Hub to deliver innovative solutions supporting multiple business...

  • Data Scientist

    2 days ago

    Noida, Uttar Pradesh, India ScaleupAlly Full time

    **Job Information**: Date Opened - 04/09/2025 Job Type - Full time Industry - IT Services Work Experience - 3 - 6 years Salary - As per the company norms City - Noida Province - Uttar Pradesh Country - India Postal Code - 201301 **About Us**: - At ScaleupAlly, we believe that technology improves all aspects of lives. That is why we are geared...