Big Data

Skills from Primary Skill Cluster Big Data
Pyspark
Hadoop
Skills outside Primary Skill Cluster
**Job Description**:
Responsibilities: We would be looking at Big Data + Spark professional. S/he should have excellent knowledge of SQL.
Citi data lake is on Cloudera Hadoop with Hive.

Other scripting knowledge like Python etc. are added advantage.
Designs data integrations, Data Security and data quality framework.
Write code to develop, maintain, and optimize data pipelines, as well as to implement data storage solutions and data processing systems
Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Works closely with a team of frontend and backend engineers, product managers, and analysts.
Defines data assets (data models) jobs to populate data models.
Designs and evaluates open source and vendor tools for data lineage.
Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Design efficient, scalable processes to acquire, manipulate and project data
Participate actively in all facets of the Agile process
Contribute to the SDC codebase directly by taking on development tasks

Required Skills: Experience with Agile process methodology, CI/CD automation, Test Driven Development.
Hands on experience in programming languages Python and Java, Data Modeling, Data visualization, relational and non-relational databases as well as strong SQL knowledge.
Knowledge of best practices and IT operations in an always-up, always-available service
Experience with or knowledge of Agile Software Development methodologies
Excellent problem solving and troubleshooting skills
Process oriented with great documentation skills
Excellent oral and written communication skills with a keen sense of customer service

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.