Big Data Developer

2 days ago

Bengaluru Chennai Pune, India Progressive Video Private Limited Full time
Job Description

We are seeking an experienced Big Data Developer with 57 years of hands-on expertise in designing, developing, and optimizing large-scale data processing systems. The ideal candidate will have strong proficiency in Scala, Hadoop, Hive, and Spark, along with a solid understanding of distributed computing and data engineering best practices.

Key Responsibilities

- Design, develop, and maintain big data solutions leveraging Hadoop, Hive, Spark, and Scala.
- Build scalable and reliable data pipelines to ingest, transform, and process structured and unstructured data.
- Optimize data processing workflows for performance, scalability, and cost efficiency.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
- Implement best practices for data governance, security, and compliance.
- Troubleshoot and resolve performance, data quality, and scalability issues in big data applications.
- Contribute to architectural decisions and provide technical guidance to junior developers.

Required Skills & Qualifications

- Experience: 57 years in big data development or data engineering roles.
- Technical Skills:
- Proficiency in Scala for data processing and application development.
- Strong experience with Apache Spark (batch & streaming).
- Hands-on expertise in Hadoop ecosystem (HDFS, YARN, MapReduce).
- Proficient in Hive for data warehousing and querying.
- Knowledge of SQL and performance tuning techniques.
- Experience with distributed computing concepts and large-scale data processing.
- Strong understanding of data structures, algorithms, and design patterns.
- Familiarity with version control (Git), CI/CD, and Agile methodologies.

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    1 day ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    23 hours ago

    Chennai, Tamil Nadu, India beBeeBigData Full time ₹ 9,00,000 - ₹ 12,00,000

    We're seeking experienced Big Data Developers with strong Python skills to contribute to our team's success.Key Responsibilities:Design and develop scalable data pipelines using PySpark and Python.Collaborate with cross-functional teams to implement data processing solutions.Develop expertise in Hadoop, Hive, Spark, and other Big Data technologies.Implement...

  • Big Data Developer

    3 days ago

    Pune, Maharashtra, India Impetus Full time

    Location : Indore, Pune, Bangalore, Gurugram, NoidaNotice period : Can join Immediately or Currently serving days )3-6 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL)Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, Lambda, RedShift, S3, etc.)Good hands on experience of...

  • Big Data Developer

    4 weeks ago

    Pune, Maharashtra, India Impetus Full time

    Location : Indore, Pune, Bangalore, Gurugram, NoidaNotice period : Can join Immediately or Currently serving ( 30- 45 days )- 3-6 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL)- Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, Lambda, RedShift, S3, etc.)- Good hands on...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Recro Full time

    Role Overview: Spark/Scala Developer (Big Data) We are seeking experienced Big Data Engineers with strong expertise in Scala and Apache Spark to join our team. The ideal candidate will be responsible for designing and implementing scalable data solutions, optimizing performance, and translating business requirements into technical deliverables. Key...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Impetus Full time

    Location : Indore, Pune, Bangalore, Gurugram, Noida Notice period : Can join Immediately or Currently serving ( 30- 45 days ) 3-6 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL) Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, Lambda, RedShift, S3, etc.) Good hands on...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in Big Data, Hadoop Sound...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: BangaloreExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data, HadoopSound Knowledge in big...