Bigdata Administrator

3 months ago


Hyderabad, India Experian Full time
Job Description

Must Have skills:

Deep understanding of Linux, networking fundamentals and security.

Experience working with AWS cloud platform and infrastructure

Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR)

Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc.

Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN.

Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc.

Deep understanding of Hive (Tez), Hive LLAP, Presto and Spark compute engines.

Ability to understand query plans and optimize performance for complex SQL queries on Hive and Spark.

Solid professional coding experience with at least one scripting language - Shell, Python etc.

Experience working with Data Analysts, Data Scientists and at least one of these related analytical applications like SAS, R-Studio, JupyterHub, H2O etc.

Able to read and understand code (Java, Python, R, Scala), but expertise in at least one scripting language.

 


Qualifications

Nice to have skills:

Experience at EMR & Terraform

Experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages

Experience with workflow management tools like Airflow, Oozie etc.

Python programming experience.

Knowledge in analytical libraries like Pandas, Numpy, Scipy and PyTorch etc.

Implementation history of Packer, Ansible, Chef, Jenkins or any other similar tooling.

Prior working knowledge of Active Directory and Windows OS based VDI platforms like Citrix, AWS Workspaces etc.

 



Additional Information

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here


  • Cloud Support Engineer

    5 months ago


    Hyderabad, India AWS India - Telangana Full time

    Amazon Web Services is the global market leader and technology forerunner in the Cloud business. As a member of the AWS Support team in Amazon Web Services Private Limited (AWS India), you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services...


  • Hyderabad, India Oracle Full time

    oTech Team within SaaS Engineering and Oracle Applications Labs (OAL) runs the Oracle software that runs Oracle. oTech is responsible for implementing, running, and improving nearly all of Oracle’s Enterprise and Cloud Applications. We use Oracle’s business requirements as a “test bed” for innovation. We often are ahead of the standard product...


  • Hyderabad, Telangana, India UnitedHealth Group Full time

    About the Role:As a Data Engineering Manager at UnitedHealth Group, you will play a key role in developing and implementing data engineering solutions that support business growth and improve health outcomes. This is an exciting opportunity to work with a talented team of professionals who share your passion for data-driven decision making.Key...


  • Hyderabad, Telangana, India UnitedHealth Group Full time

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best.Our Culture is guided by diversity and inclusion, with talented peers,...


  • Hyderabad, Telangana, India AWS India - Telangana Full time

    Bachelor’s degree OR equivalent experience in a technical position - 0-1 years of experience in Linux/Windows Systems administration OR Database design and Optimization OR BigData Analysis OR Network administration OR Dev-ops. - Troubleshooting / Support experience - Programming / scripting experience (Java, Perl, Ruby, C#, and/or PHP) - Excellent oral and...


  • Hyderabad, India JPMorgan Chase & Co. Full time

    There’s nothing more exciting than being at the center of a rapidly growing field in technology and applying your skillsets to drive innovation and modernize the world's most complex and mission-critical systems. As a Software Engineer III at JPMorgan Chase within the Employee Compute, you serve as a seasoned member of an agile team to design and deliver...


  • Hyderabad, Telangana, India AWS India - Telangana Full time

    About the RoleWe are seeking a highly skilled Cloud Support Engineer to join our team at AWS India - Telangana. As a Cloud Support Engineer, you will be responsible for providing exceptional support to our customers, helping them to get the most out of our cloud services.Key ResponsibilitiesLearn and use groundbreaking cloud technologies to provide...


  • Hyderabad, Telangana, India Experian Full time

    Key Responsibilities:As a highly skilled AWS & Linux Administrator, you will be responsible for designing, deploying, and managing large-scale Big Data clusters on the AWS cloud platform. Your expertise in Linux, networking fundamentals, and security will be essential in ensuring the stability and performance of our Big Data infrastructure.Must-Have...


  • Hyderabad, India Oracle Full time

    oTech Team within SaaS Engineering and Oracle Applications Labs (OAL) runs the Oracle software that runs Oracle. oTech is responsible for implementing, running, and improving nearly all of Oracle’s Enterprise and Cloud Applications. We use Oracle’s business requirements as a “test bed” for innovation. We often are ahead of the standard product...


  • Hyderabad, India UnitedHealth Group Full time

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion,...


  • Hyderabad, Telangana, India AISPL - Telangana Full time

    0-1 years of experience in Linux Systems administration OR Database design and Optimization OR BigData Analysis OR Network administration OR Dev-ops. - Troubleshooting / Support experience - Programming / scripting experience (Java, Perl, Ruby, C#, and/or PHP) - Excellent oral and written communication skills - Self-starter who is excited about...


  • Hyderabad, Telangana, India AWS India - Telangana - J42 Full time

    Bachelor’s degree OR equivalent experience in a technical position - 0-1 years of experience in Linux/Windows Systems administration OR Database design and Optimization OR BigData Analysis OR Network administration OR Dev-ops. - Troubleshooting / Support experience - Programming / scripting experience (Java, Perl, Ruby, C#, and/or PHP) - Excellent oral and...


  • Hyderabad, Telangana, India AWS India - Delhi Full time

    Bachelor’s degree OR equivalent experience in a technical position - 0-1 years of experience in Linux/Windows Systems administration OR - Database design and Optimization OR BigData Analysis OR Network - administration OR Dev-ops. - Troubleshooting / Support experience - Programming / scripting experience (Java, Perl, Ruby, C#, and/or PHP) - Excellent oral...


  • Hyderabad, Telangana, India AWS India - Telangana Full time

    Bachelor’s degree OR equivalent experience in a technical position - 0-1 years of experience in Linux/Windows Systems administration OR - Database design and Optimization OR BigData Analysis OR Network - administration OR Dev-ops. - Troubleshooting / Support experience - Programming / scripting experience (Java, Perl, Ruby, C#, and/or PHP) - Excellent oral...

  • Sr Talend Developer

    3 months ago


    Hyderabad, India DATAECONOMY Full time

    PositionTitle:Senior TalendDeveloperLocation:Hyderabad/PuneJobType:FulltimeDepartment:IT/SoftwareDevelopmentJobSummary:Weare seeking a highly skilled Senior Talend Developer to join ourdynamic team. The ideal candidate will have deep expertise in dataintegration and ETL processes with a focus on the Talend suite. Youwill be responsible for designing...


  • hyderabad, India Tata Consultancy Services Full time

    AWS Cloud Engineer-AWS Admin-4to10yrs-HyderabadJob Description -AWS Cloud Engineer: Be a key contributor in managing and implementing the solutions (Compute, Database, Networking, Storage, Security etc.) on AWS Cloud. About the role: • Manage and implement the solution across all AWS services (IaaS/PaaS/AI/ML/ BigData /Database/Tools). • Be well versed...


  • Hyderabad, India Tata Consultancy Services Full time

    AWS Cloud Engineer-AWS Admin-4to10yrs-HyderabadJob Description -AWS Cloud Engineer: Be a key contributor in managing and implementing the solutions (Compute, Database, Networking, Storage, Security etc.) on AWS Cloud. About the role: • Manage and implement the solution across all AWS services (IaaS/PaaS/AI/ML/ BigData /Database/Tools). • Be well versed...


  • hyderabad, India Tata Consultancy Services Full time

    AWS Cloud Engineer-AWS Admin-4to10yrs-Hyderabad Job Description - AWS Cloud Engineer: Be a key contributor in managing and implementing the solutions (Compute, Database, Networking, Storage, Security etc.) on AWS Cloud. About the role: • Manage and implement the solution across all AWS services (IaaS/PaaS/AI/ML/ BigData /Database/Tools). • Be well...


  • Hyderabad, India Tata Consultancy Services Full time

    AWS Cloud Engineer-AWS Admin-4to10yrs-Hyderabad Job Description - AWS Cloud Engineer: Be a key contributor in managing and implementing the solutions (Compute, Database, Networking, Storage, Security etc.) on AWS Cloud. About the role: • Manage and implement the solution across all AWS services (IaaS/PaaS/AI/ML/ BigData /Database/Tools). • Be well...


  • Hyderabad, Telangana, India Oracle Full time

    **Oracle Infrastructure Expert Wanted**We are seeking a highly skilled and experienced Cloud Infrastructure Engineer Performance to join our world-class team at Oracle. This is an exciting opportunity to work with cutting-edge technology and contribute to the development, implementation, and support of Oracle's global infrastructure.**Job Summary**In this...