Big Data Developer

3 weeks ago

Bengaluru Chennai Pune, India Progressive Video Private Limited Full time
Job Description

We are seeking an experienced Big Data Developer with 57 years of hands-on expertise in designing, developing, and optimizing large-scale data processing systems. The ideal candidate will have strong proficiency in Scala, Hadoop, Hive, and Spark, along with a solid understanding of distributed computing and data engineering best practices.

Key Responsibilities

- Design, develop, and maintain big data solutions leveraging Hadoop, Hive, Spark, and Scala.
- Build scalable and reliable data pipelines to ingest, transform, and process structured and unstructured data.
- Optimize data processing workflows for performance, scalability, and cost efficiency.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
- Implement best practices for data governance, security, and compliance.
- Troubleshoot and resolve performance, data quality, and scalability issues in big data applications.
- Contribute to architectural decisions and provide technical guidance to junior developers.

Required Skills & Qualifications

- Experience: 57 years in big data development or data engineering roles.
- Technical Skills:
- Proficiency in Scala for data processing and application development.
- Strong experience with Apache Spark (batch & streaming).
- Hands-on expertise in Hadoop ecosystem (HDFS, YARN, MapReduce).
- Proficient in Hive for data warehousing and querying.
- Knowledge of SQL and performance tuning techniques.
- Experience with distributed computing concepts and large-scale data processing.
- Strong understanding of data structures, algorithms, and design patterns.
- Familiarity with version control (Git), CI/CD, and Agile methodologies.

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are looking for a highly skilled Big Data Developer to join our team. In this role, you will be responsible for developing and fine-tuning programs/applications using Python/PySpark/Scala on Big Data/Hadoop Platform.The ideal candidate will have strong knowledge of Big Data/Hadoop Platform and experience with Spark, PySpark, Python,...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Big Data Developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big data developer

    6 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    6 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big data developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic...

  • Big Data Developer

    20 hours ago

    pune, India UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...