Big Data Developer

5 days ago

Chennai, Tamil Nadu, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex challenges.

Job Title: Big Data Developer
Employment Type: Full-Time Employee (FTE)
Location: PAN India
Experience: 6+ years

About the Role:

We are seeking a highly skilled Big Data Developer with strong expertise in Spark and Scala to join our dynamic team. The ideal candidate will have hands-on experience with cloud platforms such as AWS, Azure, or GCP for big data processing and storage solutions. You will play a critical role in designing, developing, and maintaining scalable data pipelines and backend services using modern big data technologies.

Key Responsibilities:
  • Develop, optimize, and maintain large-scale data processing pipelines using Apache Spark and Scala.
  • Implement and manage cloud-based big data storage and processing solutions on Azure Data Lake Storage (DLS) and Azure Databricks.
  • Collaborate with cross-functional teams to understand data requirements and deliver scalable backend services using Java and Spring Boot framework.
  • Ensure best practices in data security, performance optimization, and code quality.
  • Troubleshoot and resolve production issues related to big data workflows and backend services.
  • Continuously evaluate emerging technologies and propose enhancements to current systems.
Must-Have Qualifications:
  • 6+ years of experience in Big Data development.
  • Strong expertise in Apache Spark and Scala for data processing.
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, with a strong focus on Azure Data Lake Storage (DLS) and Azure Databricks.
  • Proficient in backend development using Java and Spring Boot framework.
  • Experience in designing and implementing scalable and fault-tolerant data pipelines.
  • Solid understanding of big data architectures, ETL processes, and data modeling.
  • Excellent problem-solving skills and ability to work in an agile environment.
Preferred Skills:
  • Familiarity with containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of streaming technologies such as Kafka.
  • Experience with CI/CD pipelines and automated testing frameworks.
What We Offer:
  • Competitive salary of based on experience and skills.
  • Flexible working options with PAN India presence.
  • Opportunity to work with cutting-edge big data technologies in a growing and innovative company.
  • Collaborative and supportive work culture with career growth opportunities.

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Net2Source Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    Big Data Developer Skills Required: Big Data & Hadoop Ecosystem, Python, PySpark Experience: 5-10 Years Share your updated resume now.

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    4+ years of hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scriptingShould be comfortable with Unix File system as well as HDFS commandsShould have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB Should be flexibleShould have good...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Developer

    1 day ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:Bangalore, ChennaiExperience:5+Must...

  • Big Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineering Developer

    3 days ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Applications Development Senior Programmer/Lead Analyst is an senior level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Big Data Developer

    2 days ago

    Chennai, Tamil Nadu, India Grid Dynamics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data DeveLoperResponsibilitiesDesign and implement data pipelines for migration from HDFS/Hive to cloud object storage (e.g., S3, Ceph).Optimize Spark (and optionally Flink) jobs for performance and scalability in a Kubernetes environment.Ensure data consistency, schema evolution, and governance with Apache Iceberg or equivalent table formats.Support...

  • Big Data Lead Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Synechron Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Big Data Lead Engineer - Hadoop - Spark & GCP (BigQuery/DataProc) with Java & Python ExpertiseJob SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutionsThis full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • Big Data Lead Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Synechron Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Lead Engineer — Hadoop, Spark & GCP (BigQuery/DataProc) with Java & Python Expertise Job Summary Synechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions. This full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...