Big Data Developer

4 days ago

Chennai, India IntraEdge Full time

Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing efficient, scalable, and maintainable code.Key Responsibilities- Design, develop, and maintain scalable big data pipelines using Python and other data processing tools.- Work with distributed data processing frameworks like Spark, Hadoop, Hive, or similar.- Implement ETL processes for structured and unstructured data from various sources.- Collaborate with data scientists, analysts, and other engineering teams to understand data needs.- Optimize data workflows and ensure data quality, integrity, and security.- Deploy solutions on cloud platforms (AWS/GCP/Azure) and automate data workflows.- Monitor data pipelines, troubleshoot issues, and ensure high availability and performance.Required Skills & Qualifications- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.- Minimum 5 years of hands-on experience in Big Data engineering roles.- Strong proficiency in Python for data processing and scripting.- Experience with Apache Spark, Hadoop ecosystem (Hive, HDFS, HBase), Kafka.- Solid understanding of data warehousing concepts and data modeling.- Hands-on experience with SQL and NoSQL databases.- Familiarity with cloud data platforms like AWS (EMR, S3, Glue), Azure, or Google Cloud.- Good understanding of CI/CD, containerization (Docker, Kubernetes), and version control (Git).Preferred Skills (Nice to Have)- Experience with Airflow or other workflow orchestration tools.- Knowledge of real-time data processing (e.g., Spark Streaming, Flink).- Exposure to data governance, data lineage, and catalog tools.Why Join Us?- Opportunity to work on cutting-edge Big Data solutions with global clients.- Collaborative and innovation-driven work culture.- Competitive compensation and career growth opportunities.- Flexible work environment with hybrid (based on role).

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are looking for a highly skilled Big Data Developer to join our team. In this role, you will be responsible for developing and fine-tuning programs/applications using Python/PySpark/Scala on Big Data/Hadoop Platform.The ideal candidate will have strong knowledge of Big Data/Hadoop Platform and experience with Spark, PySpark, Python,...

  • Big data developer

    7 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    6 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big data developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic...

  • Big Data Developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Developer

    3 days ago

    Chennai, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...