Hadoop Cluster Architect

2 months ago


Chennai, Tamil Nadu, India Rigel networks Full time
Job Title: Hadoop Administrator
Location: Remote

About the Role:

We are seeking a highly skilled Hadoop Administrator to join our team at Rigel networks. As a Hadoop Administrator, you will be responsible for managing and optimizing our Hadoop clusters to ensure efficient data processing and resource management.

Key Responsibilities:

- Design, deploy, and manage Hadoop clusters to support scalable and reliable data processing.
- Utilize Hadoop ecosystem tools such as Hive, Pig, and MapReduce to optimize data processing and resource management.
- Oversee Hadoop cluster performance, ensuring efficient data processing and resource utilization.
- Implement and maintain Spark environments for large-scale data processing and analytics.
- Develop and manage Python/Java applications for various operational needs.
- Collaborate with cross-functional teams to understand requirements and provide technical solutions.
- Communicate effectively with stakeholders to ensure alignment and timely delivery of projects.

Required Skills and Qualifications:

- Hadoop: Expertise in deploying, managing, and scaling Hadoop clusters.
- Spark: Proficiency in deploying and managing Spark applications for big data processing.
- Programming: Strong skills in Python and Java for application development and automation.
- Communication: Excellent verbal and written communication skills to effectively collaborate with team members and stakeholders.

Preferred Qualifications:

- AWS certifications (e.g., AWS Certified Solutions Architect).
- Experience with CI/CD pipelines and DevOps practices.
- Familiarity with additional cloud platforms or container orchestration tools.

  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Tata Consultancy Services is a global leader in the technology arena, committed to empowering young techies and fostering growth.Job OverviewWe are seeking an experienced Senior Hadoop Cluster Architect to join our team. As a key member of our infrastructure team, you will be responsible for designing, deploying, and managing large-scale Hadoop...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Join TCS as a Hadoop Cluster Administrator and contribute to the growth of our global technology leadership. Salary Range: ₹2,500,000 - ₹5,000,000 per annum.About UsTata Consultancy Services (TCS) is a pioneering force in the technology industry, empowering young techies to excel. We are committed to delivering top-notch services and solutions that cater...


  • Chennai, Tamil Nadu, India SPG CONSULTING AND SOLUTIONS SERVICES PVT LTD Full time

    About the Role:We are seeking a highly skilled Data Engineer with expertise in Hadoop to join our team at SPG Consulting and Solutions Services Pvt Ltd. In this role, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop.Your primary focus will be on managing and operating Hadoop clusters,...


  • Chennai, Tamil Nadu, India VIDPRO CONSULTANCY SERVICES Full time

    Vidpro Consultancy Services is seeking an experienced Cloud-Native Architect to lead the development of cloud-native platforms that enable data integration, batch processing, real-time streaming, and model inferencing. The ideal candidate will have extensive experience in AI/ML engineering, data engineering, and platform development across multi-cloud hybrid...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Company Overview">Tata Consultancy Services is a global leader in the technology arena, continuously feeding the fire of young techies and pushing the boundaries of innovation.">About the Job">We are looking for an experienced Hadoop Administrator to join our team. As a key member of our infrastructure team, you will be responsible for installing and...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    We are seeking a highly skilled Windows Server System Architect to join our team at Tata Consultancy Services. As a Windows Server System Architect, you will be responsible for designing and implementing large-scale Windows Server infrastructure environments.About the RoleAs a Windows Server System Architect, your primary responsibility will be to design and...

  • Big Data Architect

    4 weeks ago


    Chennai, Tamil Nadu, India ADVANSOFT Full time

    Job Title: Big Data ArchitectWe are looking for an experienced Big Data Architect to join our team at AdvanSoft.Estimated Salary: 7,000,000 - 32,000,000 INR per annum (approximately $90,000-$420,000 USD)About the RoleThe successful candidate will be responsible for designing and implementing scalable data pipelines that integrate raw data from various...

  • Senior Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India 1HResource Solutions Full time

    Job Description:About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at 1HResource Solutions in Chennai. As a Senior Data Architect, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.Key Responsibilities:Designing, developing, and maintaining large-scale...

  • Kafka Architect

    5 days ago


    Chennai, Tamil Nadu, India Accord Innovations Full time

    Accord Innovations is seeking a highly skilled Kafka Architect to join our team. As a key member of our engineering department, you will play a critical role in designing and implementing scalable, fault-tolerant systems.The ideal candidate will have a strong understanding of distributed systems and event-driven architectures, with experience in deploying...


  • Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About Krishpar Technologies Pvt. Ltd.We are seeking a highly skilled Big Data Solution Architect to join our team in Chennai or Bangalore.Salary: ₹15,00,000 - ₹25,00,000 per annumJob Description:The successful candidate will design and develop scalable big data solutions using Pyspark on Hadoop, Hive, and/or Kafka, HBase, MongoDB, and other relevant...

  • Cloud Data Architect

    3 weeks ago


    Chennai, Tamil Nadu, India UnitedHealth Group Full time

    UnitedHealth Group is a global organization dedicated to improving health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. With a culture guided by diversity and inclusion, our team offers talented peers, comprehensive benefits and career development opportunities.Job SummaryWe are seeking an...


  • Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job OverviewHirexa Solutions is seeking a highly skilled Data Pipeline Architect to design and implement efficient data pipelines using Scala and Spark.About the RoleThis is an exceptional opportunity for experienced professionals with strong expertise in big data technologies, scalable data processing, and API development.The ideal candidate will have 6+...


  • Chennai, Tamil Nadu, India Truetech Full time

    Job Title: Data Solutions ArchitectWe are seeking a highly skilled Data Solutions Architect to join our team at Truetech. As a key member of our big data engineering group, you will design and develop scalable, high-performance data solutions using Scala, Java, and Apache Spark.The ideal candidate will have strong experience with ETL processes, SQL, Hadoop,...


  • Chennai, Tamil Nadu, India Wipro Full time

    About the RoleWe are seeking a skilled Elasticsearch Developer to join our team at Wipro. As an Elasticsearch Solutions Architect, you will be responsible for designing and implementing high-performance, scalable, and resilient search solutions using Elasticsearch.Key Responsibilities:Elasticsearch Cluster ManagementDesign, configure, and maintain...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...


  • Chennai, Tamil Nadu, India BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Job Overview:BRISKWIN IT SOLUTIONS PRIVATE LIMITED is looking for a highly skilled Big Data Technology Expert to join our team. As a key member of our technology department, you will be responsible for designing, developing, and implementing big data solutions using Hadoop, Spark, and related technologies.Responsibilities:Design and develop big data...


  • Chennai, Tamil Nadu, India BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    About the Role:We are seeking an experienced engineer with hands-on knowledge of Bigdata, Scala, and Spark SQL as well as SQL/NoSQL databases.The ideal candidate will be proficient in Hadoop Distributed File System (HDFS), Spark, Scala, the Hadoop ecosystem, including Yarn, Hive, and Kafka.Highly skilled in writing Spark programs using RDD, Spark SQL, Spark...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Job DescriptionVirtusa is seeking an experienced Cloud Infrastructure Architect to develop and maintain scalable cloud-based systems.About the Role:Design, implement, and manage cloud infrastructure on a large scaleDevelop software systems and automated solutions for operational aspectsCollaborate with cross-functional teams to ensure smooth system...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job DescriptionWe are looking for a skilled Cloud Data Architect Specialist to join our team at Tata Consultancy Services. As a Cloud Data Architect, you will be responsible for designing and implementing data pipelines and data lakes/warehouses in a cloud environment, preferably Azure.About the RoleDesign and develop metadata-driven data pipelines to...


  • Chennai, Tamil Nadu, India PeopleLogic Full time

    We are a multi-national company providing IT services. Our organization delivers software and consultancy services across various industries, including Finance, Education, Insurance, Retail, Energy, Life Science, and Healthcare.Key Requirements:6-10 years of experience in distributed systems architecture and HCI platform management.Strong understanding of OS...