Big Data

2 months ago

Bengaluru Karnataka, India Virtusa Full time

Skills from Primary Skill Cluster Big Data
Pyspark
Hadoop
Skills outside Primary Skill Cluster
**Job Description**:
Responsibilities: We would be looking at Big Data + Spark professional. S/he should have excellent knowledge of SQL.
Citi data lake is on Cloudera Hadoop with Hive.

Other scripting knowledge like Python etc. are added advantage.
Designs data integrations, Data Security and data quality framework.
Write code to develop, maintain, and optimize data pipelines, as well as to implement data storage solutions and data processing systems
Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Works closely with a team of frontend and backend engineers, product managers, and analysts.
Defines data assets (data models) jobs to populate data models.
Designs and evaluates open source and vendor tools for data lineage.
Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Design efficient, scalable processes to acquire, manipulate and project data
Participate actively in all facets of the Agile process
Contribute to the SDC codebase directly by taking on development tasks

Required Skills: Experience with Agile process methodology, CI/CD automation, Test Driven Development.
Hands on experience in programming languages Python and Java, Data Modeling, Data visualization, relational and non-relational databases as well as strong SQL knowledge.
Knowledge of best practices and IT operations in an always-up, always-available service
Experience with or knowledge of Agile Software Development methodologies
Excellent problem solving and troubleshooting skills
Process oriented with great documentation skills
Excellent oral and written communication skills with a keen sense of customer service

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Big Data Architect

    6 months ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data

    6 months ago

    Bengaluru, Karnataka, India Quess IT Staffing Full time

    **About Us** “Magna Infotech, now Quess IT Staffing, is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions...

  • Big Data Developer

    2 months ago

    Karnataka, India Amossys Consulting Services Full time

    Position Title: Data Engineer Experience Required: 5+ years Employment Type: Full-time Employment Mode: Hybrid Location: Bangalore, Pune, Trivandrum. Industry: Banking & Insurance sector Job Summary: We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate...

  • Big data developer

    2 months ago

    Karnataka, India Amossys Consulting Services Full time

    Position Title: Data Engineer Experience Required: 5+ years Employment Type: Full-time Employment Mode: Hybrid Location: Bangalore, Pune, Trivandrum. Industry: Banking & Insurance sector Job Summary: We are looking for a skilled Data Engineer with hands-on experience in Py Spark and Big Data platforms to join our growing team. The ideal...

  • Big Data Tester

    6 months ago

    Bengaluru, Karnataka, India Talent On Technology Full time

    Reviews and refines software requirements. - Drafts and executes test plans and test cases. - Identifies and drafts steps to reproduce defects utilizing our defect tracking system, JIRA. - Enters and tracks defects to closure. - Utilizes testing tools to increase the effectiveness of testing. - Operate within the SAFe Agile methodology. Who we have in...

  • Big Data Developer

    2 months ago

    Karnataka, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...

  • Big Data and Gcp

    6 months ago

    Bengaluru, Karnataka, India Manage Captive Solutions Full time

    **Who We Are** Manage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable...

  • Big Data Tester

    6 months ago

    Bengaluru, Karnataka, India Zuplon Full time

    **Big Data Tester (Manual + Automation)** **Preferred**: Prior Apple Experience - Advanced SQL - Required - python - Required - Full Stack-Java - Required - REST API Test Automation - Required - JUnit - Required - Unix Shell scripting - Nice To Have - Cloud Computing - Nice To Have - AWS- Nice To Have - Big Data Analytics - Nice To Have **Role...

  • Big Data Solutions

    6 months ago

    Bengaluru, Karnataka, India HCT INFOTECH Full time

    Big Data Solutions **About the Role** **Duration**:6 months **Location:Bangalore** **Timings: Notice Period**: (Immediate Joiner - Required)**Experience: 4-5 Years** **Must have skill sets**: - Strong development and coding experience in object-oriented programming languages. - Solid understanding of Micro-services Architecture and performance-oriented...

  • Big Data Developer

    3 weeks ago

    Karnataka, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    3 weeks ago

    Karnataka, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and Mumbai Experience : 5 to 14 years Relevant : should be 4+ yrs for Junior and 7+ yrs for Senior Primary skills : Spark, SQL,Hive Develop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Tester

    6 months ago

    Bengaluru, Karnataka, India Trident consulting Full time

    **Role**:SDET(Big Data) **Location**:Chennai/Bangalore/Hyderabad - Hybrid(3 days onsite/Week, Onsite from Day 1) **Type**:Fulltime **Skills**: - Strong SQL design and debugging skills - Big data Hadoop knowledge - Excellent hand on - Python automation - he should be able to automate his own test case and execute. **About Trident**: Trident Consulting is...

  • Big Data Architect

    6 months ago

    Bengaluru, Karnataka, India Virtusa Full time

    Position: Big data architect - Location: BLR - Primary skills: Big data hadoop spark & aws - Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases...

  • Big Data Architect

    2 months ago

    Bengaluru, Karnataka, India AiDash Full time

    **About AiDash** We are a Series C climate tech startup backed by leading investors (including National Grid Partners, G2 Venture Partners, Lightrock, BGV, Marubeni, among others), and by our customers-turned-advocates (Duke Energy & National Grid Partners, among others)! We have been recognized by Forbes two years in a row as one of “America’s Best...

  • Big Data Solution Architect

    6 months ago

    Bengaluru, Karnataka, India EPAM Systems Full time

    RESPONSIBILITIES - Design data analytics solutions by utilising the big data technology stack - Create and present solution architecture documents with deep technical details - Work closely with business in identifying solution requirements and key case-studies/scenarios for future solutions - Conduct solution architecture review/audit, calculate and present...

  • Big Data Gcp

    1 month ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Hands-on experience in ETL and DB testing, Data migration, Report validations - GCP Big Query knowledge - Pyspark /Python experience - Expert in writing/understanding complex SQL queries - Advanced knowledge if Bigdata concepts and technologies (Hive, Impala, Pentaho, HBase, Hadoop etc.) - Exposure to the Property and Auto insurance business domain,...

  • Data Engineer

    2 months ago

    Karnataka, India Tehno Right Full time

    Job Profile and Role:As a Data Engineer at Tehno Right, you will be responsible for designing and maintaining large-scale data pipelines, architectures, and data sets. You will work with Postgres and SQL, building and optimizing 'big data' data pipelines, and performing root cause analysis on internal and external data and processes to answer specific...

  • Big Data Mentor

    1 month ago

    Bengaluru, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah family has crossed over 6M+ students and is continuously raising its bar in the field of education, giving everything that students need with best-in-class faculty to support them in achieving their dreams. Observing the financial implications of many enrolling in expensive online courses, PhysicsWallah focuses on providing...

  • Big Data Testing

    6 months ago

    Bengaluru, Karnataka, India Virtusa Full time

    5+ years of hands-on software Big Data testing experience in developing test cases and test plans with extensive knowledge of automated testing and architecture Hands-on experience in REST APIs test automation using Java /python/ node.js, TestNG, Rest Assured or similar Hands-on experience in Performance and Load Testing tools such as JMeter, Gatling or...

  • Big Data Administrator

    4 months ago

    Bengaluru, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Job Description: We are seeking an experienced Big Data Administrator to join our team. The ideal candidate will be responsible for managing and maintaining our big data infrastructure, ensuring optimal performance, security, and reliability. This role involves working closely with data engineers, data...