Pyspark Data Engineer

22 hours ago


Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Role: Data Engineer with Mandatory Pyspark Knowledge

Required Technical Skill Set: Python , Pyspark, BigQuery

Desired Experience Range: 5+ yrs

Desired Experience: 0-60 Days

Location: Bangalore, Pune, Chennai, Gurugram

Desired Competencies (Technical/Behavioral Competency)

  • Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications.
  • Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery.
  • Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders.
  • Execute the unit testing to produce defect-free software.
  • Ensuring test coverage and creating test methods.
  • Creating documentation on modules/enhancements developed.
  • Experience on
    Airflow
    ,
    Python
    coding,
    BigQuery
    concepts.
  • Functional knowledge of billing automations.
  • Ensure high quality code standards, security, & performance optimization.
  • Agile Methodology and prior experience of implementation with Agile way of working.
  • Stay with current trends and new technologies.

Kindly attach your updated resumes for screening

Thanks & Regards

Snigdha Samaptika

BFSI TAG Team



  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description: Experiance:5 to 7 YearsWe are seeking a highly skilled and motivated Oracle + PySpark Data Engineer/Analyst to join our team. The ideal candidate will be responsible for leveraging the Oracle database and PySpark to manage, transform, and analyze data to support our business's decision-making processes. This role will play a crucial part...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...


  • Bengaluru, Karnataka, India EduRun Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer | 10-12 Years Experience | Must Have: Proven expertise in building scalable batch and streaming data pipelines using Databricks (PySpark) and Snowflake.Lead the design, implementation, and optimization of application data stores using PostgreSQL, DynamoDB, and advanced SQL.Strong programming skills in SQL, Python, and PySpark for...


  • Bengaluru, Karnataka, India NatWest Group Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per year

    Join us as a Data EngineerWe're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secureDay-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insightsIf you're...

  • Data Engineer

    6 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 345819NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role:...

  • Python Pyspark

    2 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Greetings from Tata Consultancy Services (TCS)Location : Chennai, Bangalore, Pune, DelhiExperience : 5-10 YearsRole: Python Pyspark DeveloperRequired Skill set Python, Pyspark, Scala, SparkMust HaveStrong analytical skills in conducting sophisticated statistical analysis using bureau/vendor data, customer performances.Working experience in languages PySpark...


  • Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...

  • Pyspark developer

    4 days ago


    Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...


  • Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 14,00,000 per year

    Req ID: 345817NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....