Big Data Developer

4 days ago

tamil nadu, India IntraEdge Full time

Job Title: Big Data Developer (Java/Python)

Location: Chennai, Bangalore, Gurugram

Experience Required: 5+ years (5 to 15 yrs)

Joining: Immediate or Early Joiners Preferred

Employment Type: Full-time

Job Summary:

We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate will have a strong background in designing and implementing large-scale data processing systems and a solid understanding of modern data technologies. Candidates who are available to join immediately or at short notice will be given preference.

Key Responsibilities:

  • Design, develop, and maintain scalable Big Data solutions using Hadoop ecosystem, Spark, and other distributed frameworks.
  • Build and optimize data pipelines for batch and real-time data processing.
  • Collaborate with data scientists, analysts, and other developers to integrate data-driven solutions into production.
  • Write efficient, testable, and reusable code using Java or Python.
  • Work closely with DevOps teams to deploy and monitor applications on cloud/on-prem infrastructure.
  • Ensure data integrity, security, and performance tuning of large-scale data systems.

Technical Skills:

  • Strong programming skills in Java or Python (both is a plus).
  • Hands-on experience with Big Data technologies such as Hadoop, Hive, HDFS, Spark, Kafka, etc.
  • Familiarity with data modeling, ETL pipelines, and data warehousing concepts.
  • Good understanding of SQL and NoSQL databases.
  • Experience with cloud platforms such as AWS, GCP, or Azure is a plus.
  • Knowledge of CI/CD tools and containerization (Docker/Kubernetes) is desirable.

Required Qualifications:

  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
  • Minimum 5 years of experience in Big Data development with strong coding background in Java or Python.
  • Strong problem-solving skills and ability to work independently or in a team.
  • Excellent communication and collaboration skills.

Nice to Have:

  • Experience with data lakes, lakehouses, or real-time analytics.
  • Exposure to tools like Airflow, NiFi, or similar workflow orchestration tools.

Why Join Us?

  • Opportunity to work with cutting-edge Big Data technologies.
  • Collaborative and innovative work environment.
  • Competitive compensation and benefits.
  • Immediate onboarding for early joiners.

  • Big Data Developer

    4 days ago

    tamil nadu, India Tata Consultancy Services Full time

    4+ years of hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scriptingShould be comfortable with Unix File system as well as HDFS commandsShould have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB Should be flexibleShould have good...

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India CIEL HR Full time

    Job Responsibilities Responsible for administering big data systems like EMR HDFS YARN Spark Hive Oozie and others Work closely with development teams at the design phase of big data jobs and pipelines to improve operational efficiency Troubleshoot big data systems for capacity bottlenecks of memory CPU OS storage and network Performance tuning...

  • Strategic Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana - Chennai, Tamil Nadu, India beBeeDeveloper Full time ₹ 12,00,000 - ₹ 20,00,000

    Big Data Developer PositionWe seek a highly skilled Big Data Developer to spearhead our team's data strategy.

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India CIEL HR Full time

    Big Data Engineer Location Chennai Experience 5 - 10 Years Work Mode Work from office Interview 3 Rounds in total 2 Technical 1 Manager - Final round will be an F2F in Chennai office Primary Skills Hadoop Hive Spark Scala Sql

  • Urgent Search Big Data Developer

    2 weeks ago

    Hyderabad, Telangana - Chennai, Tamil Nadu, India Diverse Lynx Full time

    BIG DATA DEVELOPER EXPERIENCE - 4 LOCATION - CHENNAI HYDERABAD Experience in Python Spark and Hive Understanding of data warehousing and data modeling techniques Knowledge of industry-wide analytical and visualization tools Tableau and R Strong data engineering skills on the Azure Cloud Platform is essential Streaming frameworks like Kafka Knowledge of...

  • Aws Big Data Architect

    1 week ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    As an AWS Data Architect), you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. - AWS experts with strong experience in working with modern data...

  • Gcp Big Data Architect

    1 week ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    -As an Architect, you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - GCP experts with strong experience in working with modern data...

  • Data Engineer

    4 days ago

    tamil nadu, India Suventure Full time

    Skills Required: Python, Dataproc, dataflow, GCP Cloud Run, Agile Software Development, DataForm,TERRAFORM, Big Query, Data Fusion, GCP, Cloud SQL, KAFKAExperience Required: Bachelor's degree in Computer Science, Engineering, or a related technical field 5+ years of SQL development experience 5+ years of analytics/data product development experience required...

  • Data QA

    7 days ago

    Chennai, Tamil Nadu, India Retentia technology private limited Full time

    Job Description**Skills Hierarchy**: - Data (ETL, SQL, Big Data) - Programming Language: Java (1st Preference)/Python - Data Visualization Testing: Tableau/PowerBI/Looker - Performance Testing: J-meter (1st Preference)/Load Runner - Automation Testing (Selenium - POM, BDD) - Release Management (Git) - **Responsibilities**: - Design, Develop and maintains...

  • Trainer – AI/ML/Data Science

    4 days ago

    tamil nadu, India Movate Full time

    Job Title: Trainer – AI/ML/Data Science (Data Focus)Job Location: Chennai (MEPZ – Tambaram)Experience: 4–5 YearsWork Mode: Full-Time, Work from OfficeJob Description:We are seeking a passionate and experienced Trainer in AI/ML/Data Science with a strong focus on data engineering and big data technologies. The ideal candidate will have hands-on...