Big Data Developer

4 weeks ago

Bengaluru, India Maimsd Technology Full time

Job Description Big Data Developer - Spark/Hadoop We are seeking an experienced Big Data Developer with expertise in Hadoop, Spark, and Kafka to take complete ownership of the software development lifecycle, from requirement gathering to final deployment. This role is ideal for a proactive individual who can translate business use cases into robust, scalable, and efficient big data solutions. You'll work across multiple projects, coordinate with QA/support teams, and ensure high-quality deliverables. Key Responsibilities - Stakeholder Engagement: Engage with stakeholders to understand use cases and translate them into functional and technical specifications (FSD & TSD). - Solution Implementation: Implement scalable, efficient big data solutions. - Cross-Project Coordination: Work across multiple projects, coordinating with QA/support engineers for test case preparation. - Quality Assurance: Ensure deliverables meet high-quality standards. - SQL & Code Optimization: Write and validate SQL queries and develop optimized code for data processing workflows. - Testing & Documentation: Write unit tests and maintain documentation to ensure code quality and maintainability. - Job Scheduling & Automation: Schedule and automate jobs via shell scripts. - Performance Tuning: Optimize performance and resource usage in a distributed system, writing production-grade code. - Communication & Collaboration: Effectively coordinate with business users, developers, and testers, and manage dependencies across teams. Key Skills Required Must Have: - Hadoop - Spark (core & streaming) - Hive - Kafka - Shell Scripting - SQL - TSD/FSD documentation Good to Have: - Airflow - Scala - Cloud platforms (AWS/Azure/GCP) - Agile methodology General Requirements - Employment Type: Permanent - Notice Period: Immediate or Max 15 days - Strong analytical and problem-solving skills. - Ability to work in a dynamic, agile environment. This role is both technically challenging and rewarding, offering the opportunity to work on large-scale, real-time data processing systems.

  • Big Data Developer

    3 days ago

    Bengaluru, India Talent Worx Full time

    We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate...

  • Big data developer

    5 days ago

    Bengaluru, India Sourcebae Full time

    ???? Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala ???? Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...

  • Big data developer

    6 days ago

    Bengaluru, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    7 days ago

    Bengaluru, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    7 days ago

    Bengaluru, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    6 days ago

    Bengaluru, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    1 week ago

    Bengaluru, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Itss-big Data/hadoop/splunk Developer-humjp00032981

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 325776 We are currently seeking a ITSS-Big Data/Hadoop/Splunk Developer-HUMJP00032981 to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Azure Data Factory, Azure Synapse, and Databricks **About NTT DATA

  • Big Data Developer

    7 days ago

    Bengaluru, India Sourcebae Full time

    🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to...

  • Big Data Developer

    7 days ago

    Bengaluru, India Sourcebae Full time

    🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to...