Data Systems Engineer

1 week ago


Pune, Maharashtra, India Circana Full time

Data Systems Engineer - Hadoop Admin

Circana, a leading advisor on consumer behavior, is seeking an experienced Data Systems Engineer to join our team. As a Hadoop Administrator, you will play a crucial role in maintaining and ensuring the reliability of our Hadoop Platforms.

With a proven track record in Hadoop Administration and Linux/Unix experience, you will be responsible for keeping Hadoop and other production systems running efficiently. This includes monitoring applications, software, hardware, and network components to ensure 24/7 uninterrupted support.

Key Responsibilities:

  • Install, configure, and manage MapR and ODP Apache Hadoop Clusters with Ambari
  • Experience with installing and configuring components such as HDFS, MapReduce, TEZ, Hive, Yarn, Sqoop, Oozie, HBase, Scala, Spark, Kafka in Hadoop ecosystems
  • Worked with Ambari and MCS (MapR) for monitoring and administrating Hadoop Multi Node Clusters
  • Expert in administrating and managing ODP Apache Hadoop Cluster with Ambari, DR, and MapR
  • Experience in administrating Linux/Unix systems to deploy Hadoop Clusters
  • Expertise in monitoring multiple Hadoop Clusters environments using Ambari Metrics, MCS, and Grafana
  • Configuring Name Node, Data Node, Resource Manager, and HiveServer2 High Availability and Clusters service coordination using Zookeeper
  • Performing Backup, Disaster Recovery, Root Cause Analysis for Hadoop and Troubleshooting Hadoop Cluster issues
  • Importing and Exporting Data between Relational Database Systems (RDBMS) and HDFS using Sqoop
  • Hands-on Experience in Configuring Kerberos for Authentication
  • Experience in maintaining and monitoring the MapR and Ambari
  • Proficient in performing Minor and Major Upgrades, Commissioning, and Decommissioning of data nodes on Hadoop Cluster
  • Experience in integrating Hadoop Cluster components with LDAP, Active Directory, and enabling SSL for Hadoop Cluster Components
  • Experiencing writing Hive queries using Hive Query Language HiveQL
  • Strong working knowledge in writing queries in SQL
  • Experience in monitoring the kerberized Hadoop Cluster using Grafana
  • Experience in Installation, Configuration, Backup, Recovery, Maintenance, Support of Linux
  • Extensive knowledge on Hadoop Application Frameworks like Hive and Spark
  • Experience with System Integration, Capacity Planning, Performance Tuning, System Monitoring, System Security, and Load Balancing
  • Excellent Knowledge on YUM and RPM Package Administration for Installing, Upgrading, and Checking dependencies
  • Very good knowledge on Python Familiar with Java
  • Knowledge on Sudoers Configuration and administration on Red Hat Linux Environment

We are looking for someone with 5+ years of Hadoop Administration and Linux/Unix experience. The successful candidate will have demonstrated success in communication, collaboration, and motivation of cross-functional departments to achieve exceptional service.

Tech Requirements:

  • Hadoop Distribution: MapR, Apache Hadoop (ODP), Cloudera/Hortonworks
  • Hadoop Ecosystem: HDFS, MapReduce, YARN, Hive, Sqoop, Zookeeper, HBase, Spark
  • Configuration Management: Ambari, MapR, and Cloudera Manager
  • Security: LDAP, AD SSL, and Kerberos
  • Languages: SQL, Shell Scripting, bash, Spark SQL, HiveQL
  • Databases: MySQL, PostgreSQL
  • Monitoring Tools: Ambari, Grafana, Kibana
  • Package Management: RPM, YUM
  • Networking and Protocols: LAN, WAN, TCP/IP, NFS, LDAP, DNS
  • Operating Systems: RHEL, Oracle Enterprise Linux, CentOS, Ubuntu
  • Job Scheduling Tools: Crontab, Airflow, Oozie

About Circana

Circana is a global company committed to diversity, equity, and inclusion. We believe in the strength that diversity brings to our business, employees, clients, and communities. Our shared behaviors sit at the core of our organization, including staying curious, seeking clarity, owning outcomes, centering on clients, being a challenger, championing inclusivity, and committing to each other.

Estimated Salary Range: $120,000 - $160,000 per year



  • Pune, Maharashtra, India NTT DATA Full time

    Job DescriptionMake a difference with NTT DATAWe are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Networking Managed Services Engineer (L2) is a developing...

  • Data Systems Engineer

    4 weeks ago


    Pune, Maharashtra, India Rohini IT Consulting LLP Full time

    Rohini IT Consulting LLP seeks a highly skilled Data Systems Engineer to design, implement, and maintain large-scale data processing systems.Key Responsibilities:- Design and develop scalable data pipelines using Star/Snowflake schema design and data modeling.- Collaborate with cross-functional teams to implement data warehouse technologies (e.g., Snowflake,...


  • Pune, Maharashtra, India VARITE Inc. Full time

    Data EngineerJob Title: Data EngineerWe are seeking an experienced Data Engineer with a strong background in data analytics, ETL processes, and Hadoop data systems.Key Responsibilities:Develop and maintain ETL processes to extract, transform, and load data from various sources.Design and implement data models to ensure data accuracy, consistency, and...


  • Pune, Maharashtra, India Persistent Systems Full time

    Role Overview:A Cloud Data Engineer at Persistent Systems designs and builds scalable, efficient data pipelines to support business needs. They work collaboratively with analysts, engineers, and planners to create reliable data solutions.Job Type: Full Time EmploymentLocation: All PSL LocationsExperience: 6-12 YearsAbout the Role:The ideal candidate will...


  • Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...


  • Pune, Maharashtra, India RS Consulting Full time

    About RS ConsultingRS Consulting is a cutting-edge AI and Data Engineering Startup based in Pune.Competitive Salary: ₹1500000 - ₹2500000 per annumWe are seeking an experienced Senior Data Systems Engineer to join our team. As a key member of our data engineering group, you will play a crucial role in designing and implementing large-scale Big Data...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    We are seeking an experienced Senior Data Systems Engineer to join our team at Tata Consultancy Services. This role will involve designing, building, and optimizing systems for data collection, storage, access, and analytics at scale in the Google Cloud Platform (GCP) environment.The ideal candidate will have 5-10 years of experience in data engineering and...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Chief Data Architect

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data-driven solutions for over 50 years in the US.Our global centre of excellence in Pune delivers mission-critical data services to our clients using a proprietary cloud-based technology platform and leveraging proprietary business & consumer databases.We are headquartered in Dallas, TX, USA.The...


  • Pune, Maharashtra, India NewVision Software Full time

    NewVision Software is seeking a skilled Senior Data Systems Engineer to lead our cloud architecture initiatives. With a strong background in software development and data modeling, this individual will drive the design and implementation of scalable data systems that support our business goals.As a Cloud Architect Lead, you will be responsible for leading...


  • Pune, Maharashtra, India NTT DATA Full time

    Job TitleA Digital Engineering Sr. Engineer position is available at NTT DATA in Remote, India.About the RoleWe are seeking an experienced Digital Engineering Sr. Engineer to join our team. The ideal candidate will have a strong background in digital engineering and be able to work independently with minimal supervision.About the CompanyNTT DATA is a $30...


  • Pune, Maharashtra, India T-Systems Full time

    Job OverviewWe are seeking a seasoned Chief Data Privacy Officer to join our team at T-Systems. This is a fantastic opportunity to leverage your expertise in data privacy and security to drive business growth while ensuring compliance with regulatory requirements.Estimated Salary:€120,000 - €180,000 per annum, depending on...


  • Pune, Maharashtra, India Rohini IT Consulting LLP Full time

    Job Title: Senior Data Systems Engineer PositionAbout Rohini IT Consulting LLP: We are a leading provider of innovative technology solutions. Our team is passionate about leveraging data to drive business growth and improve operational efficiency.Salary Range: $150,000 - $200,000 per yearJob Description: Data Engineers play a vital role in designing,...


  • Pune, Maharashtra, India NTT DATA Full time

    About the JobThis exciting opportunity is for a highly skilled Data Centre Backup Engineer to join our team at NTT DATA. As a key member of our data centre operations team, you will be responsible for driving best practices, innovation and process improvements across multiple data centre locations.Key Responsibilities include:Installation and configuration...


  • Pune, Maharashtra, India MICHELIN Full time

    We are seeking a seasoned Data Quality Engineer to join our MICHELIN team. As a key player in our data management and processing domain, you will be responsible for ensuring the quality of our data entering the Data Lake.In this role, you will oversee and integrate data from various sources, guaranteeing its accuracy and relevance for our Data Analysts and...


  • Pune, Maharashtra, India N Human Resources & Management Systems Full time

    Job Title: Embedded Systems Software EngineerJob Summary: We are seeking a motivated Embedded Systems Software Engineer to assist in designing, developing, and maintaining firmware for embedded systems. The ideal candidate is passionate about embedded development and eager to learn with a solid understanding of C/C programming.Key Responsibilities:Firmware...


  • Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full time

    Job OverviewN-Systems Technologies Pvt Ltd is seeking an experienced Azure Databricks Engineer to join our team. The successful candidate will have a minimum of 5 years of experience in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.About the RoleWe are looking for a skilled professional who can...

  • Senior Data Architect

    3 weeks ago


    Pune, Maharashtra, India Persistent Systems Full time

    About Persistent SystemsPersistent Systems is a leading technology services company that enables its clients to deliver mission-critical solutions by providing innovative, reliable, and efficient technology services.Job Title: Senior Data ArchitectEstimated Salary: $120,000 - $180,000 per yearThis role requires a strong background in data engineering, with...


  • Pune, Maharashtra, India Persistent Systems Full time

    We are seeking a seasoned Data Driven AI Model Architect to join our team at Persistent Systems. This is a full-time position with a competitive salary of $250,000 - $300,000 per year.About the RoleAs a Data Driven AI Model Architect, you will be responsible for developing and implementing cutting-edge AI/ML models using Python, with a strong emphasis on...