Data Systems Engineer
1 week ago
Data Systems Engineer - Hadoop Admin
Circana, a leading advisor on consumer behavior, is seeking an experienced Data Systems Engineer to join our team. As a Hadoop Administrator, you will play a crucial role in maintaining and ensuring the reliability of our Hadoop Platforms.
With a proven track record in Hadoop Administration and Linux/Unix experience, you will be responsible for keeping Hadoop and other production systems running efficiently. This includes monitoring applications, software, hardware, and network components to ensure 24/7 uninterrupted support.
Key Responsibilities:
- Install, configure, and manage MapR and ODP Apache Hadoop Clusters with Ambari
- Experience with installing and configuring components such as HDFS, MapReduce, TEZ, Hive, Yarn, Sqoop, Oozie, HBase, Scala, Spark, Kafka in Hadoop ecosystems
- Worked with Ambari and MCS (MapR) for monitoring and administrating Hadoop Multi Node Clusters
- Expert in administrating and managing ODP Apache Hadoop Cluster with Ambari, DR, and MapR
- Experience in administrating Linux/Unix systems to deploy Hadoop Clusters
- Expertise in monitoring multiple Hadoop Clusters environments using Ambari Metrics, MCS, and Grafana
- Configuring Name Node, Data Node, Resource Manager, and HiveServer2 High Availability and Clusters service coordination using Zookeeper
- Performing Backup, Disaster Recovery, Root Cause Analysis for Hadoop and Troubleshooting Hadoop Cluster issues
- Importing and Exporting Data between Relational Database Systems (RDBMS) and HDFS using Sqoop
- Hands-on Experience in Configuring Kerberos for Authentication
- Experience in maintaining and monitoring the MapR and Ambari
- Proficient in performing Minor and Major Upgrades, Commissioning, and Decommissioning of data nodes on Hadoop Cluster
- Experience in integrating Hadoop Cluster components with LDAP, Active Directory, and enabling SSL for Hadoop Cluster Components
- Experiencing writing Hive queries using Hive Query Language HiveQL
- Strong working knowledge in writing queries in SQL
- Experience in monitoring the kerberized Hadoop Cluster using Grafana
- Experience in Installation, Configuration, Backup, Recovery, Maintenance, Support of Linux
- Extensive knowledge on Hadoop Application Frameworks like Hive and Spark
- Experience with System Integration, Capacity Planning, Performance Tuning, System Monitoring, System Security, and Load Balancing
- Excellent Knowledge on YUM and RPM Package Administration for Installing, Upgrading, and Checking dependencies
- Very good knowledge on Python Familiar with Java
- Knowledge on Sudoers Configuration and administration on Red Hat Linux Environment
We are looking for someone with 5+ years of Hadoop Administration and Linux/Unix experience. The successful candidate will have demonstrated success in communication, collaboration, and motivation of cross-functional departments to achieve exceptional service.
Tech Requirements:
- Hadoop Distribution: MapR, Apache Hadoop (ODP), Cloudera/Hortonworks
- Hadoop Ecosystem: HDFS, MapReduce, YARN, Hive, Sqoop, Zookeeper, HBase, Spark
- Configuration Management: Ambari, MapR, and Cloudera Manager
- Security: LDAP, AD SSL, and Kerberos
- Languages: SQL, Shell Scripting, bash, Spark SQL, HiveQL
- Databases: MySQL, PostgreSQL
- Monitoring Tools: Ambari, Grafana, Kibana
- Package Management: RPM, YUM
- Networking and Protocols: LAN, WAN, TCP/IP, NFS, LDAP, DNS
- Operating Systems: RHEL, Oracle Enterprise Linux, CentOS, Ubuntu
- Job Scheduling Tools: Crontab, Airflow, Oozie
About Circana
Circana is a global company committed to diversity, equity, and inclusion. We believe in the strength that diversity brings to our business, employees, clients, and communities. Our shared behaviors sit at the core of our organization, including staying curious, seeking clarity, owning outcomes, centering on clients, being a challenger, championing inclusivity, and committing to each other.
Estimated Salary Range: $120,000 - $160,000 per year
-
Senior Network Systems Engineer
1 month ago
Pune, Maharashtra, India NTT DATA Full timeJob DescriptionMake a difference with NTT DATAWe are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Networking Managed Services Engineer (L2) is a developing...
-
Data Systems Engineer
4 weeks ago
Pune, Maharashtra, India Rohini IT Consulting LLP Full timeRohini IT Consulting LLP seeks a highly skilled Data Systems Engineer to design, implement, and maintain large-scale data processing systems.Key Responsibilities:- Design and develop scalable data pipelines using Star/Snowflake schema design and data modeling.- Collaborate with cross-functional teams to implement data warehouse technologies (e.g., Snowflake,...
-
Data Systems Engineer
1 week ago
Pune, Maharashtra, India VARITE Inc. Full timeData EngineerJob Title: Data EngineerWe are seeking an experienced Data Engineer with a strong background in data analytics, ETL processes, and Hadoop data systems.Key Responsibilities:Develop and maintain ETL processes to extract, transform, and load data from various sources.Design and implement data models to ensure data accuracy, consistency, and...
-
Cloud Data Engineer Specialist
4 days ago
Pune, Maharashtra, India Persistent Systems Full timeRole Overview:A Cloud Data Engineer at Persistent Systems designs and builds scalable, efficient data pipelines to support business needs. They work collaboratively with analysts, engineers, and planners to create reliable data solutions.Job Type: Full Time EmploymentLocation: All PSL LocationsExperience: 6-12 YearsAbout the Role:The ideal candidate will...
-
Senior Data Protection Engineer
2 weeks ago
Pune, Maharashtra, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...
-
Senior Data Systems Engineer
1 week ago
Pune, Maharashtra, India RS Consulting Full timeAbout RS ConsultingRS Consulting is a cutting-edge AI and Data Engineering Startup based in Pune.Competitive Salary: ₹1500000 - ₹2500000 per annumWe are seeking an experienced Senior Data Systems Engineer to join our team. As a key member of our data engineering group, you will play a crucial role in designing and implementing large-scale Big Data...
-
Principal Data Architect
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...
-
Senior Data Systems Engineer
6 days ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are seeking an experienced Senior Data Systems Engineer to join our team at Tata Consultancy Services. This role will involve designing, building, and optimizing systems for data collection, storage, access, and analytics at scale in the Google Cloud Platform (GCP) environment.The ideal candidate will have 5-10 years of experience in data engineering and...
-
Data Analytics Engineer
2 days ago
Pune, Maharashtra, India Data Dynamics Full timeAbout Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...
-
Chief Data Architect
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. has been a leading provider of data-driven solutions for over 50 years in the US.Our global centre of excellence in Pune delivers mission-critical data services to our clients using a proprietary cloud-based technology platform and leveraging proprietary business & consumer databases.We are headquartered in Dallas, TX, USA.The...
-
Senior Data Systems Engineer
2 weeks ago
Pune, Maharashtra, India NewVision Software Full timeNewVision Software is seeking a skilled Senior Data Systems Engineer to lead our cloud architecture initiatives. With a strong background in software development and data modeling, this individual will drive the design and implementation of scalable data systems that support our business goals.As a Cloud Architect Lead, you will be responsible for leading...
-
Digital Engineering Sr. Engineer
2 weeks ago
Pune, Maharashtra, India NTT DATA Full timeJob TitleA Digital Engineering Sr. Engineer position is available at NTT DATA in Remote, India.About the RoleWe are seeking an experienced Digital Engineering Sr. Engineer to join our team. The ideal candidate will have a strong background in digital engineering and be able to work independently with minimal supervision.About the CompanyNTT DATA is a $30...
-
Chief Data Privacy Officer
2 weeks ago
Pune, Maharashtra, India T-Systems Full timeJob OverviewWe are seeking a seasoned Chief Data Privacy Officer to join our team at T-Systems. This is a fantastic opportunity to leverage your expertise in data privacy and security to drive business growth while ensuring compliance with regulatory requirements.Estimated Salary:€120,000 - €180,000 per annum, depending on...
-
Senior Data Systems Engineer Position
1 day ago
Pune, Maharashtra, India Rohini IT Consulting LLP Full timeJob Title: Senior Data Systems Engineer PositionAbout Rohini IT Consulting LLP: We are a leading provider of innovative technology solutions. Our team is passionate about leveraging data to drive business growth and improve operational efficiency.Salary Range: $150,000 - $200,000 per yearJob Description: Data Engineers play a vital role in designing,...
-
Data Centre Backup Engineer
1 week ago
Pune, Maharashtra, India NTT DATA Full timeAbout the JobThis exciting opportunity is for a highly skilled Data Centre Backup Engineer to join our team at NTT DATA. As a key member of our data centre operations team, you will be responsible for driving best practices, innovation and process improvements across multiple data centre locations.Key Responsibilities include:Installation and configuration...
-
Data Quality Engineer for Big Data Systems
2 weeks ago
Pune, Maharashtra, India MICHELIN Full timeWe are seeking a seasoned Data Quality Engineer to join our MICHELIN team. As a key player in our data management and processing domain, you will be responsible for ensuring the quality of our data entering the Data Lake.In this role, you will oversee and integrate data from various sources, guaranteeing its accuracy and relevance for our Data Analysts and...
-
Embedded Systems Software Engineer
1 month ago
Pune, Maharashtra, India N Human Resources & Management Systems Full timeJob Title: Embedded Systems Software EngineerJob Summary: We are seeking a motivated Embedded Systems Software Engineer to assist in designing, developing, and maintaining firmware for embedded systems. The ideal candidate is passionate about embedded development and eager to learn with a solid understanding of C/C programming.Key Responsibilities:Firmware...
-
Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full timeJob OverviewN-Systems Technologies Pvt Ltd is seeking an experienced Azure Databricks Engineer to join our team. The successful candidate will have a minimum of 5 years of experience in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.About the RoleWe are looking for a skilled professional who can...
-
Senior Data Architect
3 weeks ago
Pune, Maharashtra, India Persistent Systems Full timeAbout Persistent SystemsPersistent Systems is a leading technology services company that enables its clients to deliver mission-critical solutions by providing innovative, reliable, and efficient technology services.Job Title: Senior Data ArchitectEstimated Salary: $120,000 - $180,000 per yearThis role requires a strong background in data engineering, with...
-
Data Driven AI Model Architect
6 days ago
Pune, Maharashtra, India Persistent Systems Full timeWe are seeking a seasoned Data Driven AI Model Architect to join our team at Persistent Systems. This is a full-time position with a competitive salary of $250,000 - $300,000 per year.About the RoleAs a Data Driven AI Model Architect, you will be responsible for developing and implementing cutting-edge AI/ML models using Python, with a strong emphasis on...