Current jobs related to Big Data Infrastructure Specialist - Pune, Maharashtra - beBeeData


  • Pune, Maharashtra, India beBeeData Full time ₹ 19,09,025 - ₹ 25,95,450

    Job Title: Big Data Infrastructure ArchitectWe are seeking an experienced Big Data Infrastructure Architect to join our team. This is a key role for designing and implementing large-scale data processing systems, collaborating with cross-functional teams, and delivering data solutions.Responsibilities:Lead data engineering teams to design and implement...


  • Pune, Maharashtra, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Lead Data Infrastructure Specialist About the Role:We are seeking a highly skilled and experienced Lead Data Infrastructure Specialist to join our team. As a key member of our data architecture team, you will play a pivotal role in designing and implementing large-scale data infrastructure solutions.Key Responsibilities:Design and implement robust...

  • Big Data Specialist

    2 weeks ago


    Pune, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Expert - Big Data SpecialistDescription:We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.Main Responsibilities:Data Solutions: Design and implement robust...


  • Pune, Maharashtra, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Big Data EngineerCome work at a place where innovation and collaboration come together to support the most exciting missions in the world.Job Description:We are seeking a talented Big Data Engineering Specialist to deliver roadmap features of our Enterprise TruRisk Platform which would help customers to measure, communicate and eliminate cyber risks...


  • Pune, Maharashtra, India beBeeCloudDataStrategist Full time ₹ 21,00,000 - ₹ 42,00,000

    We are seeking an experienced Cloud Data Strategist to design and implement scalable big data solutions on cloud platforms. The ideal candidate will have deep hands-on expertise in cloud-based big data technologies, a strong background in the software development life cycle (SDLC), and experience in microservices and backend development. Key...


  • Pune, Maharashtra, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWelcome to this exciting opportunity to lead our team in the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of cloud technologies.Main Responsibilities:Implement infrastructure via code, focusing on scalability, security, and efficiency, and provide...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Data Engineer

    1 week ago


    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...


  • Pune, Maharashtra, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionAs a Data Specialist, you will be responsible for processing and analyzing large datasets using cutting-edge tools and technologies.The ideal candidate will have expertise in Big Data and the ability to work with complex data systems.


  • Pune, Maharashtra, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Big Data ArchitectJob DescriptionWe are seeking an experienced Enterprise Big Data Architect to lead the design, development and deployment of large-scale big data systems. As a key member of our team, you will be responsible for architecting and implementing scalable, secure and high-performance big data solutions using Hadoop, Spark,...

Big Data Infrastructure Specialist

2 weeks ago


Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

Big Data Administration Job Opportunity

Our organization is seeking a skilled Hadoop Administrator to manage the installation, configuration, monitoring, and maintenance of Hadoop clusters.

The ideal candidate will work closely with data engineers, software developers, and system administrators to ensure the performance, availability, and security of our big data infrastructure.

Responsibilities include managing the day-to-day operations of Hadoop ecosystems including HDFS, YARN, Hive, HBase, and other related technologies.

Additionally, you will be responsible for troubleshooting issues, optimizing performance, and implementing best practices for data storage and processing.

Candidates should have a strong understanding of distributed computing principles and be familiar with Linux system administration.

Experience with automation tools, scripting languages, and cloud platforms is highly desirable.

  • Administer and monitor big data infrastructure & jobs, manage user access, data storage, and cluster health;
  • Implement security controls and performance tuning;
  • Work with data engineers to support data lake operations;
  • Administration of Bigdata ecosystem;
  • Hadoop Cluster configuration and security;
  • Active member or contributor to open-source Apache Hadoop projects;
  • Capacity planning, performance tuning;
  • Scripting background in automation, configuration management;
  • HDFS maintenance and support;
  • Onboarding users onto the platform;
  • Supporting deployments of parcels;
  • Analysis and optimization of workloads, performance monitoring, tuning, and automation;
  • Ability to support large-scale Production Hadoop environments in any of the Hadoop distributions;
  • Proficiency in Designing, Capacity planning, and cluster setup for Hadoop;
  • Experience with RDBMS technologies and SQL language; Oracle, SQL Server, and MySQL;
  • Good understanding of the workings of Apache Sentry, SSSD or Centrify or Quest QA, and AD linkage to HDFS;
  • Experience in any of the Scripting Language (Perl, Shell, Python);
  • Product knowledge of Hadoop distributions such as Cloudera, Hortonwork. or MapR.;
  • Administration, maintenance, control, and optimization of Hadoop capacity, security, configuration, process scheduling, and errors;
  • Extensive Linux skills;
  • Knowledge of NoSQL platforms;
  • Addressing challenges of query execution across a distributed database platform on modern;
  • Proficiency with at least one of the following : Java, Python, or Perl;
  • Experience in tool Integration, automation, configuration management in GIT, Jira platforms;
  • Excellent oral and written communication, presentation skills, analytical and problem-solving skills;
  • Self-driven, ability to work independently and as part of a team;
  • Heavily process-oriented and good communication skills;
  • Development or administration of any NoSQL technologies;
  • Development/scripting experience on Configuration management and provisioning tools e.g., Puppet, Chef;
  • Development, Implementation, or deployment experience on the Hadoop ecosystem (HDFS, MapReduce, Hive, Hbase);
  • Cloudera Hadoop Administrator Certification is preferred.