Senior Python Developer(Big Data)

2 days ago

Kolkata, West Bengal, India Xfusion Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

About the Role

We are seeking a Senior Python Developer to lead the development of scalable, high-performance backend systems and data-driven applications. You will work on building robust services, APIs, and data workflows that power real-time and batch applications.

This role is ideal for a seasoned developer who thrives on solving complex problems, building reliable software, and working across data and engineering teams. Youll play a key role in designing and developing Python-based systems that interface with big data frameworks, cloud platforms, and analytics tools.

Key Responsibilities

  • Design and develop robust Python-based backend services and microservices.
  • Build RESTful APIs and integrations with third-party systems and internal tools.
  • Work with data workflows involving ingestion, transformation, and validation.
  • Develop and maintain ETL/ELT pipelines using Python, SQL, and Airflow.
  • Collaborate with DevOps teams to deploy, monitor, and scale applications in cloud environments (AWS, Azure, GCP).
  • Optimize code for performance, scalability, and maintainability.
  • Write unit and integration tests, participate in code reviews, and follow CI/CD best practices.
  • Work with cloud storage, databases, and data lake technologies like S3, Parquet, and DuckDB.
  • Collaborate with data scientists, analysts, and engineers to enable data access and modeling.

Required Skills & Qualifications

  • 7+ years of experience in backend software development, primarily in Python.
  • Strong understanding of OOP, modular design, and Python design patterns.
  • Experience with web frameworks (e.g., Flask, FastAPI, Django).
  • Hands-on experience with data processing tools like Pandas, SQLAlchemy, PyArrow.
  • Proficiency with SQL and database technologies (PostgreSQL, DuckDB, etc.).
  • Experience with Airflow for workflow orchestration.
  • Knowledge of building scalable, distributed applications and microservices.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and containerization tools (Docker, Kubernetes).
  • Solid understanding of version control (Git), testing frameworks (PyTest), and CI/CD pipelines.
  • Excellent problem-solving, debugging, and communication skills.

Preferred Skills (Nice to Have)

  • Experience with data processing frameworks like Apache Spark or Vaex.
  • Familiarity with data storage formats and tools like Parquet, Iceberg.
  • Exposure to data streaming platforms (Kafka, Kinesis, Flink).
  • Experience integrating backend systems with AI/ML pipelines or BI platforms.
  • Understanding of security standards and compliance (GDPR, HIPAA, SOC2).
  • Background in metadata-driven or event-driven architectures.

  • Big Data Developer

    2 weeks ago

    Kolkata, West Bengal, India newAmps Consulting Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    SalaryAs per the industry standardLocationKolkataJob InformationDescriptionA Big Data Developer needs to have a knowledge of core Java, SQL, and any scripting language along with good interpersonal skills. Big data developer is responsible for the actual coding or programming of Hadoop, Hive, Kafka & InfluxDB Applications.Skills required to become a Big data...

  • Senior Python Developer

    2 weeks ago

    Kolkata, West Bengal, India CLIRNET Full time ₹ 12,00,000 - ₹ 60,00,000 per year

    Job Title: Senior Python Developer (AI & API Development)About the RoleWe are looking for aSenior Python Developerwith a passion forAI research and API developmentto join our growing team. In this role, you will be responsible for building scalable, high-performance APIs and contributing to AI/ML research and implementation. You will work closely with data...

  • Senior Data Engineer

    3 days ago

    Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Greetings from TCSJob Title: Senior Data EngineerRequired Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)Experience Range: 8+ yearsJob DescriptionROLE AND MISSION DESCRIPTIONMain tasksMaster Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQLMaintain the platform in operational...

  • Big Data Developer with Cloud

    2 weeks ago

    Kolkata, West Bengal, India ERM Placement Services (p) Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role & responsibilities4-7 years of data engineering experience in handling large data volumes.Solid experience in Apache Spark and SQL .Good Knowledge of Azure cloud, Airflow, and databricks.Basic Knowledge of Python and shell scripting is requiredGood to have Exposure to setting up CI/CD pipelines.Understanding of Agile methodology, using JiraGood...

  • Python Developer

    2 weeks ago

    Kolkata, West Bengal, India Estalvis Advisors Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 10,00,000 per year

    Job Title:Senior Python DeveloperDepartment:Technology (Centralized)Location:Innovation Tower, West BengalExperience Required:8 YearsCompensation:₹8 – 10 LPAJob OverviewWe are looking for a highly skilledSenior Python Developerto join our centralized technology team. The ideal candidate will bring strong expertise inPython (mandatory)and have additional...

  • Senior Python Developer

    2 days ago

    Kolkata, West Bengal, India Klizo Solutions Pvt Ltd Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We Are Hiring: Python Developer (Django or FastAPI)Location:Newtown, Kolkata (Near City Centre 2)Company: Klizo Solutions Pvt. Ltd.Website: Job Type: Full-time, In-OfficeWorking Days: Monday to Friday (Fixed weekends off)About Klizo SolutionsKlizo Solutions is a product-based IT company founded by serial entrepreneur Joseph Ricard. With innovative projects...

  • Senior Data Scientist

    5 days ago

    Kolkata, West Bengal, India b1310e58-0fe5-404c-9136-1e5faf8cdc67 Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities:Collect, analyze, and interpret large datasets to gain insights and inform business decisions.Develop and implement machine learning models and algorithms to solve complex problems.Design and implement data visualizations to communicate findings to stakeholders.Collaborate with cross-functional teams to identify business needs and develop...

  • Python Developer

    5 days ago

    Kolkata, West Bengal, India Soul Ai Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    We are seeking skilled Python Developers with a minimum of 1 year of development experience to join us as freelancers and contribute to impactful projects.Key Responsibilities:Write clean, efficient code for data processing and transformation.Debug and resolve technical issues.Evaluate and review code to ensure quality and complianceRequired...

  • Data Scientist

    7 days ago

    Kolkata, West Bengal, India HR4U Consulting Full time ₹ 2,20,000 - ₹ 24,00,000 per year

    Collect, clean, and preprocess large structured and unstructured datasets.Develop and implement machine learning and statistical models to solve business problems.Perform exploratory data analysis (EDA) to identify trends, correlations, and patterns.Design and execute data experiments to test hypotheses and validate models.Communicate findings through...

  • Python + Pyspark + SQL

    1 week ago

    Kolkata, West Bengal, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Our Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...