Aws Databricks

3 days ago

Andhra Pradesh, India Virtusa Full time

Must have 7plus years of experience total IT experience in Data engineering DW area

Must have 3plus yrs of exposure on AWS ecosystem specifically DataBricks, Redshift Lambda Glue Starbust

Minimum 5 yrs of technical expertise with data models data mining and segmentation techniques

Expert on programming languages SQL Python Pyspark

Must be good at creating software and data pipelines that enable the ingestion transformation and transfer of large quantities of structured and unstructured research data from filesystems sources

Must be able to design and build database logic to automatically fetch and store data in various forms

Must be good at building processes supporting data transformation data structures metadata dependency and workload management

Must be able to identify design and implement internal process improvements automating manual processes, optimizing data delivery re designing infrastructure for greater scalability etc

Expert on data manipulation, processing and extracting value from large disconnected datasets

Excellent hands on experience on SQL database design

Working knowledge of message queuing stream processing and highly scalable big data data stores

Good to have hands on RAG Architecture

Good communication skills to interact with clients playing an onshore lead role

Should be comfortable to work in Agile methodology

AWS Data & Analytics Certification will be added advantage

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Databricks + Pyspark

    2 weeks ago

    Andhra Pradesh, India Virtusa Full time

    **Detailed Job Description for**Databricks + PySpark Developer**: - Data Pipeline Development: Design, implement, and maintain scalable and efficient data pipelines using PySpark and Databricks for ETL processing of large volumes of data. - Cloud Integration: Develop solutions leveraging Databricks on cloud platforms (AWS/Azure/GCP) to process and analyze...

  • Aws Architect

    14 hours ago

    Andhra Pradesh, India Virtusa Full time

    Good proficiency in Java. Preferable to have Python skills. Expert level skills in SQL queries in databases like Oracle, SQL Server Expertise in AWS Compute (Fargate), AWS Storage (S3), AWS Data Integration (preferably Glue), Lambda, Secrets Manager and AWS Core services. Excellent knowledge in Spark, Databricks Workflows and Pipelines. Good understanding of...

  • Java Aws Architect

    1 week ago

    Andhra Pradesh, India Virtusa Full time

    15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...

  • Infrastructure Engineering Advisor

    2 weeks ago

    Andhra Pradesh, India The Cigna Group Full time US$ 1,04,000 - US$ 1,30,878 per year

    INTRODUCTION TO EVERNORTH:Evernorth Health Services India, established in Hyderabad in 2024, is an innovation hub for Evernorth Health Services, the pharmacy, care and benefits division of The Cigna Group. The innovation hub will support innovation-focused areas, such as generative AI, product development, process improvement, analytics, and software...

  • Infrastructure Engineering Lead Analyst

    7 days ago

    Andhra Pradesh, India The Cigna Group Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    INTRODUCTION TO EVERNORTH:Evernorth Health Services India, established in Hyderabad in 2024, is an innovation hub for Evernorth Health Services, the pharmacy, care and benefits division of The Cigna Group. The innovation hub will support innovation-focused areas, such as generative AI, product development, process improvement, analytics, and software...

  • Data Modelling Architect

    1 week ago

    Andhra Pradesh, India Virtusa Full time

    12+ years of Architecting & Developing Experience working in Big Data Technologies using Apache Hadoop, Spark & SQL etc. 5+ years of strong Development Coding experience using Spark with Python Minimum 3+ Years experience working on Databricks on AWS based Cloud Services 5+ years of strong experience in Big Data design, modelling & Development such as star...

  • High Salary! Cloud Engineering Senior Advisor- Hih

    1 day ago

    Hyderabad, Telangana - Andhra Pradesh, India The Cigna Group Full time

    We are seeking a highly skilled Databricks Platform Infrastructure and Admin Engineer with experience in GPU computing to join our team The ideal candidate will have a strong background in managing and optimizing cloud-based data platforms with a focus on Databricks and GPU acceleration The Databricks Platform Infrastructure and Admin Engineer will be...

  • Digital Data Platform Engineering Lead

    2 weeks ago

    Andhra Pradesh, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    10 years of hands-on experience in Spark, Kafka, Python, Hive, Snowflake, Databricks, AWSLead architecture of big data platforms for enterprise-scale analyticsDevelop, test, and optimize complex ETL workflowsCollaborate with Data Scientists and Business SMEs on ML pipelinesEnforce data quality, lineage, and observability best practicesMentor engineers and...

  • Data Engineering t- HIH

    9 hours ago

    Andhra Pradesh, India The Cigna Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Application Development Sr.Analyst – Data EngineeringPosition OverviewWe're seeking a versatile Data Engineer to contribute to all aspects of our customer data platform. You'll work on various data engineering tasks, from designing data pipelines to implementing data integration solutions, playing a crucial role in enhancing our data infrastructure.Roles &...

  • HIH - Evernorth - Software Engineering Senior Advisor

    2 weeks ago

    Andhra Pradesh, India The Cigna Group Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Position OverviewIn this role, you will utilize your experience as a Lead/Senior Software Engineer – Data Engineering to help design, develop, monitor, troubleshoot and optimize data pipelines on Databricks (AWS) platform.The hire will be responsible for solutioning and productionizing data storage and retrieval problems to support better performance and...