Big Data Developer

3 weeks ago

Bengaluru, Karnataka, India Maimsd Technology Full time
Job Description

Big Data Developer - Spark/Hadoop

We are seeking an experienced Big Data Developer with expertise in Hadoop, Spark, and Kafka to take complete ownership of the software development lifecycle, from requirement gathering to final deployment. This role is ideal for a proactive individual who can translate business use cases into robust, scalable, and efficient big data solutions. You'll work across multiple projects, coordinate with QA/support teams, and ensure high-quality deliverables.

Key Responsibilities

- Stakeholder Engagement: Engage with stakeholders to understand use cases and translate them into functional and technical specifications (FSD & TSD).
- Solution Implementation: Implement scalable, efficient big data solutions.
- Cross-Project Coordination: Work across multiple projects, coordinating with QA/support engineers for test case preparation.
- Quality Assurance: Ensure deliverables meet high-quality standards.
- SQL & Code Optimization: Write and validate SQL queries and develop optimized code for data processing workflows.
- Testing & Documentation: Write unit tests and maintain documentation to ensure code quality and maintainability.
- Job Scheduling & Automation: Schedule and automate jobs via shell scripts.
- Performance Tuning: Optimize performance and resource usage in a distributed system, writing production-grade code.
- Communication & Collaboration: Effectively coordinate with business users, developers, and testers, and manage dependencies across teams.

Key Skills Required

Must Have:

- Hadoop
- Spark (core & streaming)
- Hive
- Kafka
- Shell Scripting
- SQL
- TSD/FSD documentation

Good to Have:

- Airflow
- Scala
- Cloud platforms (AWS/Azure/GCP)
- Agile methodology

General Requirements

- Employment Type: Permanent
- Notice Period: Immediate or Max 15 days
- Strong analytical and problem-solving skills.
- Ability to work in a dynamic, agile environment.

This role is both technically challenging and rewarding, offering the opportunity to work on large-scale, real-time data processing systems.

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Recro Full time

    Role Overview: Spark/Scala Developer (Big Data) We are seeking experienced Big Data Engineers with strong expertise in Scala and Apache Spark to join our team. The ideal candidate will be responsible for designing and implementing scalable data solutions, optimizing performance, and translating business requirements into technical deliverables. Key...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in Big Data, Hadoop Sound...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: BangaloreExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data, HadoopSound Knowledge in big...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Job Description** LOOKING FOR IMMEDIATE JOINERS ONLY**QualificationDegree – Graduates/Postgraduate in CSE or related fieldJob Descriptions for Big data or Cloud EngineerPosition Summary:We are looking for candidates with hands on experience in Big Data or Cloud Technologies.Must have technical Skills3-6 Years of experienceExpertize and hands-on experience...

  • Big Data Developer

    3 days ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- 5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)- 3+ years of exp in writing Advanced SQLs- Pyspark is mandatory.- 3+ years of exp with building dimensional data...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Job Description** LOOKING FOR IMMEDIATE JOINERS ONLY**QualificationDegree – Graduates/Postgraduate in CSE or related fieldJob Descriptions for Big data or Cloud EngineerPosition Summary:We are looking for candidates with hands on experience in Big Data or Cloud Technologies.Must have technical Skills3-6 Years of experienceExpertize and hands-on experience...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Impetus Full time

    Job Description ** LOOKING FOR IMMEDIATE JOINERS ONLY** Qualification Degree – Graduates/Postgraduate in CSE or related field Job Descriptions for Big data or Cloud Engineer Position Summary: We are looking for candidates with hands on experience in Big Data or Cloud Technologies. Must have technical Skills 3-6 Years of experience Expertize and...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Job Description ** LOOKING FOR IMMEDIATE JOINERS ONLY** Qualification Degree – Graduates/Postgraduate in CSE or related field Job Descriptions for Big data or Cloud Engineer Position Summary: We are looking for candidates with hands on experience in Big Data or Cloud Technologies. Must have technical Skills 3-6 Years of experience Expertize and...

  • Senior Big Data Developer

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a highly skilled Data Engineer to join our team. The successful candidate will have extensive experience in big data and data-related technologies, with a strong understanding of distributed computing principles.Key Responsibilities:Design and develop large-scale data processing systems using Apache Spark and Python.Work with...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India Optimum Solutions Pte Ltd Full time

    - 5+ years of experience as a Data Engineer/Big Data Engineer.- Strong expertise in Apache Spark with Scala or Java.- Hands-on experience in building Microservices-based architectures.- Proficiency in designing and managing ETL/ELT data pipelines.- Experience with relational and NoSQL databases.- Familiarity with data analytics platforms and real-time data...