Sr. Python Bigdata Developer

2 days ago

Chennai, Tamil Nadu, India Jinrai Technologies Private Limited Full time ₹ 16,00,000 - ₹ 30,00,000 per year

Job Title: Senior Python Big Data Developer

Location: Chennai / Sholinganallur / Bengaluru Bellandur RMZ – Ecoworld

Employment Type: Full-time

Experience Level: Senior (4-10 year)

About the Role

We are looking for a Senior Python Big Data Developer with strong experience in Python, Spark, and Hadoop ecosystems for one of our leading MNC clients to join the data engineering team. The ideal candidate will build scalable data pipelines, optimize data processing workflows, and deliver high-quality, production-ready code. This role requires hands-on expertise with Big Data tools, ETL/ELT pipelines, and data manipulation frameworks such as PySpark and Pandas.

Key Responsibilities

  • Design, develop, and maintain end-to-end Big Data pipelines using Python, PySpark, and Hadoop technologies.
  • Perform coding, testing, debugging, and performance tuning for large-scale data processing applications.
  • Build and optimize data ingestion, transformation, and aggregation workflows using HDFS, Hive, Spark, and Kafka.
  • Work extensively with Pandas, PySpark, and Polars for data manipulation, cleansing, and analysis.
  • Develop ETL/ELT frameworks and ensure data accuracy, consistency, and integrity across systems.
  • Collaborate with data architects, analysts, and business teams to translate business requirements into technical solutions.
  • Integrate data pipelines with Enterprise Data Warehouse (EDW) and support reference/master data management processes.
  • Support data reporting and visualization needs using tools like Tableau, Dataiku, or MicroStrategy (MSTR).
  • Manage and automate workflows through Control-M or similar job orchestration tools.
  • Utilize SQL and Bash scripting for data management, validation, and process automation.
  • Conduct code reviews, ensure best coding practices, and participate in technical design discussions.

Required Skills & Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Technology.
  • 5–10 years of professional experience as a Python Developer or Big Data Engineer.
  • Advanced proficiency in Python programming and object-oriented design.

Strong experience with:

  • Apache Spark / PySpark for distributed data processing.
  • Pandas / Polars for large-scale data manipulation.
  • SQL (complex queries, optimization, and performance tuning).
  • Hands-on experience with Hadoop ecosystem tools: HDFS, Hive, Kafka, Spark, Bash scripting.
  • Proven experience building ETL/ELT data pipelines in on-premise Hadoop environments.
  • Familiarity with Enterprise Data Warehouse (EDW) and Reference Data Management concepts.
  • Knowledge of job orchestration/scheduling tools (e.g., Control-M, Autosys).
  • Excellent analytical, problem-solving, and debugging skills.
  • Strong verbal and written communication skills with the ability to work cross-functionally.

What We Offer

  • Opportunity to work on large-scale enterprise data platforms.
  • Exposure to cutting-edge Big Data and analytics technologies.
  • Collaborative and learning-focused work culture.
  • Competitive compensation and benefits package.
  • Long-term career growth in data engineering and analytics

If interested then please send your cv at

Job Type: Full-time

Benefits:

Flexible schedule

Work Location: In person

Job Type: Full-time

Work Location: In person

Job Type: Full-time

Pay: ₹1,600, ₹3,000,000.00 per year

Work Location: In person

  • Python developer

    1 hour ago

    Chennai, Tamil Nadu, India python Full time ₹ 3,00,000 - ₹ 5,00,000 per year

     If you are passionate about technology, constantly seeking to learn and improve skill set, then you are the type of person we are looking forTheIndianMed is an online platform for traditional Indian Medicinal Practitioners (AYUSH). We help people find alternative and better health choices and help them live a healthier life by adopting Indian Medicine...

  • Solution Architect – Bigdata

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly experienced Sr. Architect with 16+ years of experience to join our team.The ideal candidate will have expertise in Python, Splunk, Spark, Hadoop, Data & Solution Architect, Integration Architect, and Solution Design & Architecture.This hybrid role requires a deep understanding of technical architecture and the ability to design and...

  • BigData and Hadoop Ecosystems

    5 hours ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overall Minimum 6+ years of post-college working experience as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing (Added Skill)Minimum 3+ Years of experience Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools.Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.Strong conceptual and creative...

  • Sr. Python+Golang Developer

    9 hours ago

    Chennai, Tamil Nadu, India Axiom Software Solutions Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Sr. Python + Golang DeveloperLocation: Remote / FlexibleType: Full-timeSalary: CompetitiveJob Description:We are seeking a highly skilled Sr. Python + Golang Developer to join our dynamic team. The ideal candidate will have extensive experience in developing robust backend systems and will be comfortable working with both Python and Golang. The...

  • Bigdata Developer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are seeking a highly skilled and motivated Python , AWS, Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and...

  • Bigdata Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are seeking a highly motivated and enthusiastic Intermediate Software Developer to join our growing engineering team. This role is ideal for a recent individual with 3-5 years of experience who is eager to learn and grow within a fast-paced environment. You will work on exciting projects involving large-scale data processing, analytics, and software...

  • Sr. BOT Developer

    1 week ago

    Chennai, Tamil Nadu, India Gainwell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description Sr. BOT Developer (Chatbot, AIML, Javascript) Date: Sep 13, 2025Location: Bangalore, KA, IN, 560100; Chennai, TN, IN, 600032Req ID: 31973Work Mode: Remote IndiaSummary As a Sr. BOT Developer (Chatbot, AIML, Python) at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and...

  • Big Data Developer

    5 hours ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:Bangalore, ChennaiExperience:5+Must...

  • Python Fullstack Developer-Immediate Joiners

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position: Python Fullstack DeveloperJob Location: ChennaiExperience:...

  • Sr. Python Developer

    1 week ago

    Chennai, Tamil Nadu, India Early Career Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...