Python Pyspark

2 days ago

Andhra Pradesh, India Virtusa Full time

Data Engineer

Position Summary

Minimum Qualifications
6 Years overall IT experience with minimum 4 years of work experience in below tech skills
Tech Skills
Proficient in Python scripting and PySpark for data processing tasks
Strong SQL capabilities with hands on experience managing big data using ETL tools like Informatica
Experience with the AWS cloud platform and its data services including S3 Redshift Lambda EMR Airflow Postgres SNS and EventBridge
Skilled in BASH Shell scripting
Understanding of data lakehouse architecture particularly with Iceberg format is a plus
Preferred Experience with Kafka and Mulesoft API
Understanding of healthcare data systems is a plus
Experience in Agile methodologies
Strong analytical and problem solving skills
Effective communication and teamwork abilities

**Responsibilities**:
Develop and maintain data pipelines and ETL processes to manage large scale datasets
Collaborate to design test data architectures to align with business needs
Implement and optimize data models for efficient querying and reporting
Assist in the development and maintenance of data quality checks and monitoring processes
Support the creation of data solutions that enable analytical capabilities
Contribute to aligning data architecture with overall organizational solutions

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Gcp + Big Query + Python

    3 days ago

    Andhra Pradesh, India Virtusa Full time

    Design and develop robust ETL pipelines using Python, PySpark, and GCP services. Build and optimize data models and queries in BigQuery for analytics and reporting. Ingest, transform, and load structured and semi-structured data from various sources. Collaborate with data analysts, scientists, and business teams to understand data requirements. Ensure data...

  • Gcp Python

    3 days ago

    Andhra Pradesh, India Virtusa Full time

    **Skills**:Knowledge of Google Cloud Platform Google Cloud GCP cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Pyspark DWH Data warehousing concepts & dimension modeling (Good to have) Python GIT Any GCP Certification Roles & Responsibilities: Perform data analytics, warehousing, ETL development Design & Build...

  • Aws Python

    2 weeks ago

    Andhra Pradesh, India Virtusa Full time

    Title: Developer (AWS Engineer) **Requirements**: Strong hands-on experience Proficient in Node.js and Python Seasoned developers capable of independently driving development tasks Ability to understand the existing system architecture and work towards the target architecture. Experience with data profiling activities, discover data quality challenges and...

  • Python Scripting

    5 days ago

    Andhra Pradesh, India Virtusa Full time

    Python Scripting Led Primary Skills Python scripting Data Scikit learn Py Spark Data mining, AI JD Design and build new tools as well as enhancements to existing our surveillance and monitoring tools for the compliance business community Develop solutions using Python, Hadoop, Spark, and HIVE/SQL Work on projects that require deep knowledge of Python and...

  • AWS Data Engineer

    2 hours ago

    Andhra Pradesh, India Inityinfotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerExperience :- 5+ yearsLocation : RemoteJob DescriptionDesign, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark...

  • GCP Data Engineer

    2 weeks ago

    andhra pradesh, India Virtusa Full time

    Design and develop robust ETL pipelines using Python, PySpark, and GCP services.Build and optimize data models and queries in BigQuery for analytics and reporting.Ingest, transform, and load structured and semi-structured data from various sources.Collaborate with data analysts, scientists, and business teams to understand data requirements.Ensure data...

  • MRSI Snowflake Data Migration

    15 hours ago

    Amaravati, Andhra Pradesh, India Growel Softech Private Limited Full time

    Job Description - 7+ years of hands-on experience in Python with a strong focus on data engineering and big data technologies. Role Overview The Python Big Data Engineer will design, develop, and optimize scalable data processing solutions using modern cloud and big data platforms. The role involves working with large datasets, implementing lakehouse...

  • AWS Data Engg(AWS+Python+Glue)

    1 week ago

    uttar pradesh, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TATA Consultancy Services!!Thank you for expressing your interest in exploring a career possibility with the TCS Family.Hiring For:- AWS Data Engg(AWS+Python+Glue)Location: Noida/ Kolkata/ Pune/ Bangalore/ Chennai/HyderabadExperience: 4 to 7yrs• Advanced working Scala ,SQL,Python/PySpark knowledge and experience working with...

  • Azure Data Architect

    1 hour ago

    Andhra Pradesh, India Virtusa Full time

    **Skill - Azure Data Lead / Arch** **Location - Hyderabad** **Work mode - 5 days office** **Work timings - 12 PM to 9 PM** **JD**: - Must have work experience in Azure Synapse, Python,Pyspark and ADF. - Strong in writing SQL query, stored procedure and functions with hands-on in Power BI. Relevant Experience in Power BI, SSIS and SSRS and SQL Server -...

  • EY - GDS Consulting - AI AND DATA - AWS - Senior Manager

    2 weeks ago

    andhra pradesh, India Legal operations Full time

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job...