Big Data Developer

5 hours ago

Chennai, India IntraEdge Full time

Job Title: Senior Big Data Engineer (Python)

Experience: 5+ Years

Locations: Chennai, Bangalore, Gurugram

Employment Type: Full-Time

Notice Period: Immediate to 30 Days Preferred

Job Summary

We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing efficient, scalable, and maintainable code.

Key Responsibilities

- Design, develop, and maintain scalable big data pipelines using Python and other data processing tools.
- Work with distributed data processing frameworks like Spark, Hadoop, Hive, or similar.
- Implement ETL processes for structured and unstructured data from various sources.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs.
- Optimize data workflows and ensure data quality, integrity, and security.
- Deploy solutions on cloud platforms (AWS/GCP/Azure) and automate data workflows.
- Monitor data pipelines, troubleshoot issues, and ensure high availability and performance.

Required Skills & Qualifications

- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Minimum 5 years of hands-on experience in Big Data engineering roles.
- Strong proficiency in Python for data processing and scripting.
- Experience with Apache Spark, Hadoop ecosystem (Hive, HDFS, HBase), Kafka.
- Solid understanding of data warehousing concepts and data modeling.
- Hands-on experience with SQL and NoSQL databases.
- Familiarity with cloud data platforms like AWS (EMR, S3, Glue), Azure, or Google Cloud.
- Good understanding of CI/CD, containerization (Docker, Kubernetes), and version control (Git).

Preferred Skills (Nice to Have)

- Experience with Airflow or other workflow orchestration tools.
- Knowledge of real-time data processing (e.g., Spark Streaming, Flink).
- Exposure to data governance, data lineage, and catalog tools.

Why Join Us?

- Opportunity to work on cutting-edge Big Data solutions with global clients.
- Collaborative and innovation-driven work culture.
- Competitive compensation and career growth opportunities.
- Flexible work environment with hybrid (based on role).

  • Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are looking for a highly skilled Big Data Developer to join our team. In this role, you will be responsible for developing and fine-tuning programs/applications using Python/PySpark/Scala on Big Data/Hadoop Platform.The ideal candidate will have strong knowledge of Big Data/Hadoop Platform and experience with Spark, PySpark, Python,...

  • Big Data Developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big data developer

    2 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    1 day ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    4 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big data developer

    2 hours ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big data developer

    2 hours ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics...