Bigdata - Scala, Spark

2 weeks ago

Andhra Pradesh, India Virtusa Full time

Responsible for **Design, Build & deployment the Solution in Bigdata**.
- Minimum **6 to 8 Years of experience **in **Big Data **and Data Engineering using **Scala or Java. (Python good to have)**:

- Deep knowledge in **Spark & Scala API Experience is required**.
- Good experience in **Hadoop, Big Data, Hadoop centric Schedulers**:

- **Big Data and reporting System integration **through API knowledge is added advantage.
- Understanding of data structures, data modelling and software architecture
- Responsible for full software Development Life Cycle.
- Responsible for the on-time delivery of high-quality code with low rates of production defects.
- Research and recommend Technology to improve the current systems.
- Communicate status and risk to stakeholders and escalate as appropriate.
- Flexible and able to manage time effectively.
- Ability to learn new skills quickly with little supervision and ensuring the details of high priority.
- Excellent communication (verbal and written) and interpersonal skills with the ability to communicate well at all levels.
- Efficiently and effectively manage work, time, and resources.
- Strong problem solving and program execution skills while being process orientated.
- Self-motivating and delivery focused individual.
- Designing and developing Scala related data pipelines and REST API.
- Ability to write robust code in Scala.
- Excellent communication skills
- Ability to work in a team.
- Outstanding analytical and problem-solving skills
- Banking domain knowledge is an Add-on Advantage
- Knowledge of Regulatory Reporting domain will be a strong plus.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Java Spark

    1 week ago

    Andhra Pradesh, India Virtusa Full time

    **6+ years**of Experience in **Spark ETL on Bigdata**: - Must have **good Database knowledge**and should be able to write the queries **Spark ETL on Big Data**: - Good to have Knowledge in Spark SQL. - Good to have understanding on Regulatory reporting. - Design & implementation of scalable & fault tolerant ETL Pipelines on Bigdata Platform to store &...

  • Cloud Platform Architect

    11 hours ago

    Andhra Pradesh, India Virtusa Full time

    1. Cloud platform AWS EMR, Lambda, EC2 2. Technologies : Python/Scala with Spark 3. Snowflake (good to have) 4. Airflow (good to have) 5. EMR Serverless (good to have) 1. Cloud platform : AWS EMR, Lambda, EC2 2. Technologies : Python/Scala with Spark 3. Snowflake (good to have) 4. Airflow (good to have) 5. EMR Serverless (good to have) 1. Cloud...

  • Bigdata Pyspark

    2 weeks ago

    Andhra Pradesh, India Virtusa Full time

    Overall 10+ years of experience in Datawarehouse and Hadoop platform. MUST have experience with Python/PySpark and Hive in Big Data environments Should have strong skills in writing complex SQL Queries and good understanding of Data warehouse concepts. exposure to migration of legacy Data warehouse platform to Hadoop platform experience will be a big...

  • Data Testing

    4 days ago

    Andhra Pradesh, India Virtusa Full time

    Completed GCP certification Good communication skills Should have very good experience on preparing test scenarios, suite, test cases. Should have solid experience on test coverage, test execution and reporting. Should have good knowledge on data mapping (source, target, transformation, filter, etc) Should have experience on DbVisulizer or beeline or...

  • Big Data Developer

    4 days ago

    uttar pradesh, India Coforge Full time

    We are seeking a highly skilled and experienced Senior Big Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS & Scala Mandatory. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.Key Responsibilities:Architect and...

  • Sr. Manager- Data Engineering

    2 weeks ago

    uttar pradesh, India EXL Full time

    Looking for Manager Data Engineering :12+ years total experince in data engineering and analytics.2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.Exposure in analyzing...

  • Big Data Developer

    4 days ago

    Noida, Uttar Pradesh, India, Ghaziabad Coforge Full time

    We are seeking a highly skilled and experienced Senior Big Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS & Scala Mandatory. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.Key Responsibilities:Architect and...

  • Lead Data Engineer

    1 day ago

    uttar pradesh, India Trantor Full time

    7+years experienceStrong experience in Azure services (Data Factory, Synapse, ADLS, Blob Storage, Event Hubs, Databricks)Proficiency in SQL (including performance tuning).Strong programming skills (Python / Scala / Java).Data Modeling, Metadata Management, and Data Quality expertise.Experience with Hadoop & Spark for distributed data processing.Experience in...

  • Sr. Manager- Data Engineering

    2 weeks ago

    Noida, Uttar Pradesh, India, Ghaziabad EXL Full time

    Looking for Manager Data Engineering :12+ years total experince in data engineering and analytics.2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.Exposure in analyzing...

  • AWS Data Engineer

    6 days ago

    uttar pradesh, India Coforge Full time

    We are seeking a skilled Data Engineer (AWS- Scala Mandatory) to join our dynamic team. This role involves building and maintaining robust data pipelines, designing scalable databases, and collaborating with stakeholders to deliver high-quality data solutions.ResponsibilitiesBuild and maintain data pipelines using AWS Glue, Python, EMR/Spark, and...