Python Data Engineer

21 hours ago

Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Job Description

Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets. We are looking for a Python Data Engineer with deep expertise in API development, big data processing, and cloud deployment. The ideal candidate will have experience with FastAPI, PySpark, and DevOps pipelines, and be capable of leading a team while delivering high-performance, scalable data-driven applications.

Key Responsibilities
  • API Development: Design, build, and maintain scalable APIs using FastAPI and RESTful principles.
  • Big Data Processing: Develop efficient data pipelines using PySpark to process and analyze large-scale datasets.
  • Full-Stack Integration: Collaborate with frontend teams to implement end-to-end feature integration and ensure seamless user experiences.
  • CI/CD Pipelines: Create and manage CI/CD workflows using GitHub Actions and Azure DevOps to support reliable and automated deployments.
  • Containerization: Build and deploy containerized applications using Docker for both development and production environments.
  • Team Leadership: Lead and mentor a team of engineers; conduct code reviews and provide technical guidance to ensure best practices and quality standards.
  • Code Optimization: Write clean, maintainable, and high-performance Python code with a focus on scalability and reusability.
  • Cloud Deployment: Deploy, monitor, and maintain applications in Azure or other cloud platforms ensuring high availability and resilience.
  • Cross-Functional Collaboration: Work with product managers, designers, and other stakeholders to transform business requirements into technical solutions.
  • Documentation: Maintain clear and comprehensive documentation for APIs, systems, and workflows to support ongoing development and maintenance.

Requirements

  • Programming: Advanced proficiency in Python, with hands-on experience in FastAPI and REST API development.
  • Big Data: Expertise in PySpark and large-scale data processing techniques.
  • DevOps Tools: Strong knowledge of GitHub Actions, Azure DevOps, and Docker.
  • Cloud Platforms: Experience with Azure or similar cloud environments for deployment and scaling.
  • System Integration: Demonstrated experience in backend-to-frontend integration.
  • Leadership: Proven track record of leading and mentoring software development teams.
  • Collaboration: Excellent communication skills

    Note: We are looking for immediate joiners only - who can join us in less than a month.

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data & AI Engineer Lead

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Snowflake, Python, Airflow Engineer

    17 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 346757NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake, Python, Airflow Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Team...

  • Senior Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Python Developer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 344658NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Python Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Design, implement, test, and maintain...

  • Sr Data Engineer

    21 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Python Developer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Design, implement, test, and maintain serverside applications, automation, or data pipelines using Python Design, implement, test, and maintain serverside applications, automation, or data pipelines using Python Strong proficiency in Python 3.x and idiomatic Python (async patterns, type hints, context managers). Experience with at least one web framework:...

  • Data Analyst

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design, develops, and maintains various user-friendly dashboards Analyze and translate non-technical user requirements into written report specifications Develop and execute queries, scripts, and data manipulation tasks using SQL, Python, or other relevant tools. Analyze large datasets to identify trends, patterns, and correlations, drawing meaningful...

  • Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Duties:At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.Strong Application development experience in Scala/Python. Strong Database SQL experience,...