Sr. Python Bigdata Developer

5 days ago

Chennai, Tamil Nadu, India Jinrai Technologies Private Limited Full time ₹ 16,00,000 - ₹ 30,00,000 per year

Job Title: Senior Python Big Data Developer

Location: Chennai / Sholinganallur / Bengaluru Bellandur RMZ – Ecoworld

Employment Type: Full-time

Experience Level: Senior (4-10 year)

About the Role

We are looking for a Senior Python Big Data Developer with strong experience in Python, Spark, and Hadoop ecosystems for one of our leading MNC clients to join the data engineering team. The ideal candidate will build scalable data pipelines, optimize data processing workflows, and deliver high-quality, production-ready code. This role requires hands-on expertise with Big Data tools, ETL/ELT pipelines, and data manipulation frameworks such as PySpark and Pandas.

Key Responsibilities

  • Design, develop, and maintain end-to-end Big Data pipelines using Python, PySpark, and Hadoop technologies.
  • Perform coding, testing, debugging, and performance tuning for large-scale data processing applications.
  • Build and optimize data ingestion, transformation, and aggregation workflows using HDFS, Hive, Spark, and Kafka.
  • Work extensively with Pandas, PySpark, and Polars for data manipulation, cleansing, and analysis.
  • Develop ETL/ELT frameworks and ensure data accuracy, consistency, and integrity across systems.
  • Collaborate with data architects, analysts, and business teams to translate business requirements into technical solutions.
  • Integrate data pipelines with Enterprise Data Warehouse (EDW) and support reference/master data management processes.
  • Support data reporting and visualization needs using tools like Tableau, Dataiku, or MicroStrategy (MSTR).
  • Manage and automate workflows through Control-M or similar job orchestration tools.
  • Utilize SQL and Bash scripting for data management, validation, and process automation.
  • Conduct code reviews, ensure best coding practices, and participate in technical design discussions.

Required Skills & Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Technology.
  • 5–10 years of professional experience as a Python Developer or Big Data Engineer.
  • Advanced proficiency in Python programming and object-oriented design.

Strong experience with:

  • Apache Spark / PySpark for distributed data processing.
  • Pandas / Polars for large-scale data manipulation.
  • SQL (complex queries, optimization, and performance tuning).
  • Hands-on experience with Hadoop ecosystem tools: HDFS, Hive, Kafka, Spark, Bash scripting.
  • Proven experience building ETL/ELT data pipelines in on-premise Hadoop environments.
  • Familiarity with Enterprise Data Warehouse (EDW) and Reference Data Management concepts.
  • Knowledge of job orchestration/scheduling tools (e.g., Control-M, Autosys).
  • Excellent analytical, problem-solving, and debugging skills.
  • Strong verbal and written communication skills with the ability to work cross-functionally.

What We Offer

  • Opportunity to work on large-scale enterprise data platforms.
  • Exposure to cutting-edge Big Data and analytics technologies.
  • Collaborative and learning-focused work culture.
  • Competitive compensation and benefits package.
  • Long-term career growth in data engineering and analytics

If interested then please send your cv at

Job Type: Full-time

Benefits:

Flexible schedule

Work Location: In person

Job Type: Full-time

Work Location: In person

Job Type: Full-time

Pay: ₹1,600, ₹3,000,000.00 per year

Work Location: In person

  • BigData and Hadoop Ecosystems

    3 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overall Minimum 6+ years of post-college working experience as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing (Added Skill)Minimum 3+ Years of experience Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools.Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.Strong conceptual and creative...

  • Sr. Python+Golang Developer

    3 days ago

    Chennai, Tamil Nadu, India Axiom Software Solutions Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Sr. Python + Golang DeveloperLocation: Remote / FlexibleType: Full-timeSalary: CompetitiveJob Description:We are seeking a highly skilled Sr. Python + Golang Developer to join our dynamic team. The ideal candidate will have extensive experience in developing robust backend systems and will be comfortable working with both Python and Golang. The...

  • TCS Hiring for Bigdata Role

    6 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Greetings From Tata Consultancy ServicesTCS has always been in the spotlight for being adept in "the next big technologies". What we can offer you is a space to explore varied technologies and quench your techie soul.As a Developer, you will capture data to translate and transform it into a processing language and build industry specific solutions based on...

  • Sr Python Developer

    2 days ago

    Chennai, Tamil Nadu, India Hunarstreet Technologies Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Company Overview: Hunarstreet Technologies is a leading staffing and recruiting company in India, dedicated to connecting talented professionals with top-tier organizations. With a mission to bridge the gap between employers and candidates, we strive to provide exceptional services that cater to the unique needs of our clients across various industries. Role...

  • Python Full Stack Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Heron Strategic Consulting Pvt Ltd Full time ₹ 1,12,100 - ₹ 20,03,772 per year

    Dear Candidates,Greetings from Guiding ConsultingWe have an open position for Python Developer with our client in Chennai. Here we are sharing the job description for your reference. If your experience and skills match with the requirements, kindly respond with your updated resume.Job Title: Sr Python DeveloperLocation: ChennaiKey Responsibilities: Design,...

  • Pyspark - Machine Learning

    3 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    7+ years of experience in Big Data with strong expertise in Spark and ScalaMandatory Skills: Big Data Primarily Spark and ScalaStrong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys,Good to Have : Agile Methodology and Banking ExpertiseStrong Communication SkillsNot limited to Spark batch, need Spark streaming experienceNo SQL DB...

  • Sr. Python Developer

    3 days ago

    Chennai, Tamil Nadu, India Photon Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    DescriptionKey Responsibilities:Develop, test, and maintain applications using FastAPI.Design and implement database models and schemas using SQLAlchemy.Integrate user-facing elements developed by front-end developers with server-side logic.Optimize applications for maximum speed and scalability.Collaborate with the team to define, design, and ship new...

  • Sr Developer

    2 weeks ago

    Chennai, Tamil Nadu, India TransUnion Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    TransUnion's Job Applicant Privacy NoticeWhat We'll Bring:This is role is for a Sr. Developer to work on building global platforms that are hosted across multiple countries in both public and private cloud environments. We value people who are passionate around solving business problems through innovation and engineering practices. We embrace a culture of...

  • Sr Developer

    1 week ago

    Chennai, Tamil Nadu, India TransUnion Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    TransUnion's Job Applicant Privacy NoticeWhat We'll Bring:This is role is for a Sr. Developer to work on building global platforms that are hosted across multiple countries in both public and private cloud environments. We value people who are passionate around solving business problems through innovation and engineering practices. We embrace a culture of...

  • Sr. Python Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Workforce Next Pvt Ltd Full time ₹ 15,00,000 - ₹ 24,00,000 per year

    Job Title: Python Lead DeveloperLocation: Chennai and HyderabadExperience: 9+ YearsJob Type: Full-Time / ContractDomain: [Add "Healthcare" if applicable]Job Summary:We are seeking a highly skilled Python Lead Developer with extensive experience in backend development, API integration, and cloud technologies. The ideal candidate will have strong leadership...