Big Data admin-Hadoop, Spark, Nifi, Impala

21 hours ago

Pune, Maharashtra, India Cortex Consultants Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Work Experience: 4 to 6 years Official Notice Period – Immediate to 15 days Excellent communication skills Job Location – PuneShift Timing: Regular shift & UK shift (Should be flexible)
Job Description The RolePlan, manage, and oversee all aspects of a Production Environment for Big Data Platforms.Define strategies for Application Performance Monitoring, Optimization in Prod environmentRespond to Incidents and improvise platform based on feedback and measure the reduction of incidents over time.Ensures that batch production scheduling and process are accurate and timely.Able to create and execute queries to big data platform and relational data tables to identify process issues or to perform mass updates, preferred.Performs ad hoc requests from users such as data research, file manipulation/transfer, research of process issues, etc.Take a holistic approach to problem solving, by connecting the dots during a production event through the various technology stack that makes up the platform, to optimize meantime to recover.Engage in and improve the whole lifecycle of services—from inception and design, through deployment, operation and refinement.Analyze ITSM activities of the platform and provide feedback loop to development teams on operational gaps or resiliency concerns.Support services before they go live through activities such as system design consulting, capacity planning and launch reviews.Support the application CI/CD pipeline for promoting software into higher environments through validation and operational gating, and lead in DevOps automation and best practices.Maintain services once they are live by measuring and monitoring availability, latency and overall system health.Scale systems sustainably through mechanisms like automation and evolving systems by pushing for changes that improve reliability and velocity.Work with a global team spread across tech hubs in multiple geographies and time zones.Ability to share knowledge and explain processes and procedures to others. RequirementsExperience in Linux and Knowledge on ITSM/ITIL.Experience in the Big Data technologies (Hadoop, Spark, Nifi, Impala)2+ years of Experience in running Big Data production systems.Good to have experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven,Solid grasp of SQL or Oracle fundamentalsExperience with scripting, pipeline management, and software design.Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.Ability to help debug and optimize code and automate routine tasks.Ability to support many different stakeholders. Experience in dealing with difficult situations and making decisions with a sense of urgency is needed.Appetite for change and pushing the boundaries of what can be done with automation.Experience in working across development, operations, and product teams to prioritize needs and to build relationships are a must.Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort is desired.Good Handle on Change Management and Release Management aspects of Software

  • Sr. Spark Big Data Developer

    16 hours ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Sr. Spark Big Data DeveloperPFB the detailed JD:�� Experience: 5 to 7+ years (Hands-on)�� Notice Period: 0-30 DaysMust Have: Proficiency in at least one of the following programming languages:Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end datastorage/processing pipeline...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Developer

    12 hours ago

    Pune, Maharashtra, India Uplers Full time ₹ 60,000 - ₹ 1,80,000 per year

    Experience: yearsSalary: Confidential (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Office (Pune)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive)**(*Note: This is a requirement for one of Uplers' client - Nexus Cognitive)**What do you need for...

  • Hadoop Admin

    18 hours ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 2,00,000 - ₹ 10,00,000 per year

    Position - Hadoop AdminExperience: 4 to 7 YearsJob Description: -4+ years of hands-on experience - Hadoop, System administration with sound knowledgeIn Unix based Operating System internals. Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution. Linux experience (RedHat, CentOS, Ubuntu). Experience in setting up and supporting...

  • Big Data Architect-Hadoop/DevOps

    2 weeks ago

    Pune, Maharashtra, India Emergys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from-office)Notice Period:Immediate to 30 DaysExperience:8+ YearsMust Have Skills:Hadoop Ecosystem Expertise – Strong hands-on experience with HDFS, Hive, Spark, YARN, Ranger, and Cloudera/Hortonworks/CDP platforms.DevOps & Automation – Proven ability to build CI/CD pipelines , automate cluster management, and deploy using...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Hadoop Admin

    7 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from-office)Notice Period:Immediate to 30 DaysExperience:2+ YearsMust Have Skills:Strong Hadoop Administration– Hands-on experience managing and supporting Hadoop clusters (Cloudera CDP/CDH, Hortonworks HDP).Linux/Unix System Administration– Expertise in RedHat, CentOS, Ubuntu, with deep knowledge of OS internals.Cluster Security...

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Senior Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes