Bigdata Administrator

**Key skills**:

- Deep understanding of Linux, networking and security fundamentals.
- Experience working with AWS cloud platform and infrastructure.
- Experience working with infrastructure as code with Terraform or Ansible tools.
- Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR).
- Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc.
- Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN.
- Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc.
- Deep understanding of Hive (Tez), Hive LLAP, Presto and Spark compute engines.
- Ability to understand query plans and optimize performance for complex SQL queries on Hive and Spark.
- Experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages
- Solid professional coding experience with at least one scripting language - Shell, Python etc.
- Able to read and understand code (Java, Python, R, Scala), but expertise in at least one scripting languages like Python or Shell.
- Nice to have skills:

- Experience with workflow management tools like Airflow, Oozie etc.
- Knowledge in analytical libraries like Pandas, Numpy, Scipy, PyTorch etc.
- Implementation history of Packer, Chef, Jenkins or any other similar tooling.
- Prior working knowledge of Active Directory and Windows OS based VDI platforms like Citrix, AWS Workspaces etc.

**Mandatory Skill**:

- Strong Linux and Strong AWS experience and Strong active directory

**Experience**:

- 5-8 Years of relevant experience
- Ready to join immediately.

**Job Types**: Full-time, Contractual / Temporary
Contract length: 6-12 months

Pay: ₹353,596.25 - ₹1,000,000.00 per year

Schedule:

- Day shift

Work Location: In person