Big Data Pyspark Developer

14 hours ago

Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

Big data-Pyspark Developer-Hadoop

Skillset required: 1. Excellent knowledge of UNIX/LINUX OS. 2. Knowing of core java is a plus but not mandatory. 3. Good understanding of OS concepts, process management and resource scheduling. 4. Basics of networking, CPU, memory and storage. 5. Good hold of shell scripting. 1. Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs. 2. Implementing, managing and administering the overall hadoop infrastructure. 3. Knowledge all the components in the Hadoop ecosystem like Apache Spark, Apache Hive, HBase, Kafka, Sqoop, Yarn, Zookeeper etc. 4. Takes care of the day-to-day running of Hadoop clusters. 5. Candidate will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected. 6. Candidate is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster. 7. Ensure that the hadoop cluster is up and running all the time. 8. Monitoring the cluster connectivity and performance. 9. Manage and review Hadoop log files. 10. Backup and recovery tasks 11. Resource and security management 12. Troubleshooting application errors and ensuring that they do not occur again

  • Big Data/Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data Developer Experience: 4 to 10 Years Notice Period- 0-60 Days Location-Bengaluru Required Skill Set_ Hadoop, PySpark, Spark SQL, HIVE Job Description Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. Strong SQL experience. Should be able to develop, tweak queries and work on performance enhancement....

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCS TCS is hiring for Big Data (PySpark & Scala)Location: - Pune/Mumbai/Chennai/BangaloreDesired Experience Range: 4 - 6 YearsMust-HavePySpark HiveGood-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data

    4 days ago

    Bengaluru, Karnataka, India TEKNIKOZ Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Greetings from TeknikozExperience : 5-7 YearsSkill Required: Digital: Big Data and Hadoop Ecosystems~Digital: Python~Digital: PySparkSpecific activities required:Lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their resume with the following details to Current CTC Expected CTC Location

  • Java Developer with PySpark

    1 week ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Java Developer with PySparkLocation:BangaloreExperience:5- 6+ YearsWork Mode:Hybrid (4 days WFO - 1 Day -WFH)Job Description:We are looking for a highly skilled and experiencedJava Developer with PySparkexpertise to join our dynamic team. The ideal candidate will have a strong background in backend development, big data processing, and cloud-native...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    BigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...