Sre-big Data

2 weeks ago


Bengaluru Karnataka, India ANZ Banking Group Full time

**Req ID**: 63816
**Department**: Tech CDIS Cloud, Data and Analytics
**Division**: Technology
**Location**: Bengaluru
About the role

As an SRE, you will work as part of a team with a mission to ensure the health of the EBD (Enterprise Big Data) platform, thus making the right data accessible to our people and customers through tools and channels to drive faster and more informed decision making, removing friction, and ultimately delivering a world class customer experience.

What will your day look like

Design, develop and maintain a secure, robust and scalable Data Ecosystem on the Enterprise Big Data (EBD) Platform.

Develop and enhance batch ingestion frameworks and streaming solutions needed to build a Data Lake platform on Hadoop.

Design and develop complex orchestration logic including automated alert management as part of building robust data pipelines with utmost focus towards resiliency and reconciliation.

Design and develop industry standard observability using tools such as splunk/Grafana/Prometheus etc.

Proven record of automation, specifically on data consistency, data quality and reconciliation, including testing.

Develop robust CI/CD pipelines with secops integration using tools such as Bamboo or Github actions.

Ability to solve ambiguous and complex engineering problems.

Work collaboratively within and across teams, Tech Areas and Domains.

Utilise tools and practices to build, verify and deploy solutions in the most efficient ways, we place a high emphasis on Software Fundamentals.

What will you bring?

4+years of experience with relevant Big Data Engineering

Programming experience in one or more of Java, Scala or Python

Expertise in at least one commercial distribution of Hadoop

Experience with most of Big Data Stack including Spark, Hive, YARN, Kafka, Hbase, Oozie, Control M etc.

Good experience in automating manual activities, data quality checks and resiliency.

Strong Linux/Unix skills

Ideally you have experience working as a SRE/Devops engineer.

Familiarity with Docker

Experience with secure Hadoop cluster using Kerberos

Experience with CI/CD tools (Jenkins, GitHub Actions or Bamboo).

Experience in Splunk or any other enterprise observability tool and dashboarding

So, why join us?

ANZ is a place where big things happen as we work together to provide banking and financial services across more than 30 markets. With more than 7,500 people, our Bengaluru team is the bank’s largest technology, data & operations centre outside Australia. In operation for over 33 years, the centre is critical in delivering the bank’s strategy and making an impact for our millions of customers around the world. Our Bengaluru team not only drives the transformation initiatives of the bank, it also drives a culture that makes ANZ a great place to be. We’re proud that people feel they can be themselves at ANZ and 90% of our people feel they belong.

We know our people need different things to be great in their role, so we offer a range of flexible working options, including hybrid work (where the role allows it). Our people also enjoy a range of benefits including access to health and wellbeing services.

Job Posting End Date

23/04/2024, 11.59pm, (Melbourne Australia)


  • Data SRE

    3 hours ago


    Bengaluru, Karnataka, India netskope software pvt Full time

    Apply for Data SRE, Career Progress Consultants in Bengaluru/ Bangalore for 5 - 8 Year of Experience on

  • Data SRE

    16 hours ago


    Bengaluru/ Bangalore, India netskope software pvt.ltd Full time

    Apply for Data SRE, Career Progress Consultants in Bengaluru/ Bangalore for 5 - 8 Year of Experience on TimesJobs.com.

  • Big Data

    2 months ago


    Bengaluru, India Source-right Full time

    Roles: **Responsibilities**: Required Qualifications: SRE: HDInsight: - At least 2 devs with strong Spark background - Performance tuning for Spark, Hive and Hadoop jobs. - Troubleshoot production issues, identify the root-cause, and provide mitigation. - Build tools and services to improve the debuggability/supportability. - Monitoring cluster health for...

  • Platform Sre

    2 weeks ago


    Bengaluru, Karnataka, India CME Management Full time

    **Description** **SRE Infrastructure Cloud Engineer** **We are seeking a talented and experienced SRE Infrastructure Cloud Engineer to join our team. This role offers the opportunity to transform the infrastructure and work in a dynamic, fast-paced environment, developing and maintaining performant and scalable infrastructures. As a key contributor to the...

  • Platform Sre

    2 weeks ago


    Bengaluru, Karnataka, India CME Group Full time

    **Description** **SRE Infrastructure Cloud Engineer** **We are seeking a talented and experienced SRE Infrastructure Cloud Engineer to join our team. This role offers the opportunity to transform the infrastructure and work in a dynamic, fast-paced environment, developing and maintaining performant and scalable infrastructures. As a key contributor to the...

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...


  • Bengaluru/ Bangalore, India timesjobs Full time

    Hiring For Data Tier SREs:Data Tier SREsDesired Profile Skills:Experience with AWS or GCP, EC2 (GCE), IAM,S3 (GS), Docker, Kubernetes pods, Jenkins, Prometheus, CI/CD tools, automation using python or/and Golang or/and shell scripting, understanding of networking fundamentals, data management technologies including relational and non-relational...

  • Big Data

    5 days ago


    Bengaluru, Karnataka, India Quess IT Staffing Full time

    **About Us** “Magna Infotech, now Quess IT Staffing, is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions...

  • Big Data Tester

    2 days ago


    Bengaluru, Karnataka, India Talent On Technology Full time

    Reviews and refines software requirements. - Drafts and executes test plans and test cases. - Identifies and drafts steps to reproduce defects utilizing our defect tracking system, JIRA. - Enters and tracks defects to closure. - Utilizes testing tools to increase the effectiveness of testing. - Operate within the SAFe Agile methodology. Who we have in...

  • Sre

    4 days ago


    Bengaluru, Karnataka, India Kyndryl Full time

    Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The...

  • DevOps/sre

    5 days ago


    Bengaluru, Karnataka, India Rakuten Full time

    **Company Description**: **Scope**: Team’s overall mission is to boost-up each business unit’s revenue by standardizing operations, maximizing productivity, and providing high quality service to our customers (Internal/external). **Responsibilities**: Design, develop SLA, SLO, SLI of services within the Business Unit. Involve in automation of routine...

  • Big Data and Gcp

    3 weeks ago


    Bengaluru, Karnataka, India Manage Captive Solutions Full time

    **Who We Are** Manage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable...

  • Big Data Tester

    2 weeks ago


    Bengaluru, Karnataka, India Zuplon Full time

    **Big Data Tester (Manual + Automation)** **Preferred**: Prior Apple Experience - Advanced SQL - Required - python - Required - Full Stack-Java - Required - REST API Test Automation - Required - JUnit - Required - Unix Shell scripting - Nice To Have - Cloud Computing - Nice To Have - AWS- Nice To Have - Big Data Analytics - Nice To Have **Role...

  • SRE Consultant

    4 days ago


    Bengaluru, Karnataka, India Wipro Full time

    Job Title: Lead Cloud/SRE Consultant: Location: Pune/Bangalore Expected to drive and contribute to research, design, documentation, and modifications to software specifications throughout the production life cycle with optimal technical solutions across the Cloud Infrastructure platforms stack and also Work with the Engineering, Product, Delivery and...

  • Big Data Architect

    2 months ago


    Bengaluru, Karnataka, India Databricks Full time

    CSQ125R30 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Big Data Tester

    1 week ago


    Bengaluru, Karnataka, India Trident consulting Full time

    **Role**:SDET(Big Data) **Location**:Chennai/Bangalore/Hyderabad - Hybrid(3 days onsite/Week, Onsite from Day 1) **Type**:Fulltime **Skills**: - Strong SQL design and debugging skills - Big data Hadoop knowledge - Excellent hand on - Python automation - he should be able to automate his own test case and execute. **About Trident**: Trident Consulting is...

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Position: Big data architect - Location: BLR - Primary skills: Big data hadoop spark & aws - Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases...

  • Associate Sre

    4 days ago


    Bengaluru, Karnataka, India Acceldata Full time

    Bengaluru, KarnatakaWork Type: Full Time About Acceldata Acceldata is an enterprise Data Observability organization that was first to the market, having coined the term 'Data Observability' in 2018. Founded by industry veterans who have spent decades in the AI, Analytics, and Data Monitoring space, Acceldata is a startup in the hypergrowth phase. Having...

  • sre

    3 days ago


    Bengaluru, Karnataka, India Virtusa Full time

    SRE - CREQ186098 Description Deployment of Gateway and Service Mesh components. Driving Go/No-Go Meeting on biweekly basis. Operational Work Perf/ Stability / Capacity TestingFMEA Recommendation from the testing andFMEA to improve the systems. Participation in Identity failover to represent Traffic. Scaling of Traffic Systems Monitoring the system and...


  • Bengaluru, Karnataka, India EPAM Systems Full time

    RESPONSIBILITIES - Design data analytics solutions by utilising the big data technology stack - Create and present solution architecture documents with deep technical details - Work closely with business in identifying solution requirements and key case-studies/scenarios for future solutions - Conduct solution architecture review/audit, calculate and present...