Sre-big Data

3 weeks ago

Bengaluru Karnataka, India ANZ Banking Group Full time

**Req ID**: 63816
**Department**: Tech CDIS Cloud, Data and Analytics
**Division**: Technology
**Location**: Bengaluru
About the role

As an SRE, you will work as part of a team with a mission to ensure the health of the EBD (Enterprise Big Data) platform, thus making the right data accessible to our people and customers through tools and channels to drive faster and more informed decision making, removing friction, and ultimately delivering a world class customer experience.

What will your day look like

Design, develop and maintain a secure, robust and scalable Data Ecosystem on the Enterprise Big Data (EBD) Platform.

Develop and enhance batch ingestion frameworks and streaming solutions needed to build a Data Lake platform on Hadoop.

Design and develop complex orchestration logic including automated alert management as part of building robust data pipelines with utmost focus towards resiliency and reconciliation.

Design and develop industry standard observability using tools such as splunk/Grafana/Prometheus etc.

Proven record of automation, specifically on data consistency, data quality and reconciliation, including testing.

Develop robust CI/CD pipelines with secops integration using tools such as Bamboo or Github actions.

Ability to solve ambiguous and complex engineering problems.

Work collaboratively within and across teams, Tech Areas and Domains.

Utilise tools and practices to build, verify and deploy solutions in the most efficient ways, we place a high emphasis on Software Fundamentals.

What will you bring?

4+years of experience with relevant Big Data Engineering

Programming experience in one or more of Java, Scala or Python

Expertise in at least one commercial distribution of Hadoop

Experience with most of Big Data Stack including Spark, Hive, YARN, Kafka, Hbase, Oozie, Control M etc.

Good experience in automating manual activities, data quality checks and resiliency.

Strong Linux/Unix skills

Ideally you have experience working as a SRE/Devops engineer.

Familiarity with Docker

Experience with secure Hadoop cluster using Kerberos

Experience with CI/CD tools (Jenkins, GitHub Actions or Bamboo).

Experience in Splunk or any other enterprise observability tool and dashboarding

So, why join us?

ANZ is a place where big things happen as we work together to provide banking and financial services across more than 30 markets. With more than 7,500 people, our Bengaluru team is the bank’s largest technology, data & operations centre outside Australia. In operation for over 33 years, the centre is critical in delivering the bank’s strategy and making an impact for our millions of customers around the world. Our Bengaluru team not only drives the transformation initiatives of the bank, it also drives a culture that makes ANZ a great place to be. We’re proud that people feel they can be themselves at ANZ and 90% of our people feel they belong.

We know our people need different things to be great in their role, so we offer a range of flexible working options, including hybrid work (where the role allows it). Our people also enjoy a range of benefits including access to health and wellbeing services.

Job Posting End Date

23/04/2024, 11.59pm, (Melbourne Australia)

  • Big Data

    3 days ago

    Bengaluru, India Source-right Full time

    Roles: **Responsibilities**: Required Qualifications: SRE: HDInsight: - At least 2 devs with strong Spark background - Performance tuning for Spark, Hive and Hadoop jobs. - Troubleshoot production issues, identify the root-cause, and provide mitigation. - Build tools and services to improve the debuggability/supportability. - Monitoring cluster health for...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Big Data Architect

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time

    CSQ125R30 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • SRE Engineer

    2 weeks ago

    Bengaluru / Bangalore, Chennai, India Macropace Technologies Full time

    SRE Engineer7 - 10 YearsNP - 30 DaysPermanentUST GlobalJOb DescriptionEnsuring application migrations from on-prem data centers to Microsoft Azure are successful • Consulting and providing expertise ontechnical solution options, and contributing to decision-making discussions in areas such as serverless computing, containerized workloads, and big data •...

  • Big Data Mentor

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah family has crossed over 6M+ students and is continuously raising its bar in the field of education, giving everything that students need with best-in-class faculty to support them in achieving their dreams. Observing the financial implications of many enrolling in expensive online courses, PhysicsWallah focuses on providing...

  • Big Data Architect

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Mentor

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah family has crossed over 6M+ students and is continuously raising its bar in the field of education, giving everything that students need with best-in-class faculty to support them in achieving their dreams. Observing the financial implications of many enrolling in expensive online courses, PhysicsWallah focuses on providing...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Sre/src Support

    3 days ago

    Bengaluru, Karnataka, India CGI Full time

    4-5 + years of experience on SRE/SRC Support Extensive experience in troubleshooting the issues including analyzing the log files Excellent knowledge of database (PL/SQL, Oracle, DB2) Excellent Knowledge of Tomcat, Apaches, WAS, and IIS Extensive experience on Linux systems, JSON, BOT Support Application and infrastructure proactive event monitoring using...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyPrimary Location Bangalore, Karnataka, India Job Type...

  • Big Data Architect

    Found in: Talent IN 2A C2 - 5 days ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd. Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirementsCollaborate with stakeholders to understand their data and analytics needsCreate and maintain data models, data flow diagrams, and data integration strategiesDevelop and implement data ingestion, processing, and storage solutions using Big Data technologiesOptimize data...

  • Big Data Architect

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Primary Location Bangalore, Karnataka,...

  • Big Data Analyst

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Corporate Resources Full time

    Job DescriptionBig data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insightsReporting and presenting on data insightsHandson knowledge of scripting and using Big data toolsData analysis and processingIndustryIT-Software / Software ServicesFunctional AreaIT Software - Application Programming,...

  • Big Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, AnsibleJob DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Developer

    Found in: Talent IN C2 - 2 weeks ago

    Bengaluru, India BigShyft Full time

    JobDescription:We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities:Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and other...

  • Big data architect

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....