Pyspark designer

4 weeks ago

Bengaluru Karnataka India, Karnataka Tata Consultancy Services Full time

We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have:


- Over 5 years’ experience designing and developing ETL integration patterns using Python and Spark.

- 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a plus).

- Proven ability to create and maintain data integration pipelines, including migrating data (DB2 to Amazon S3).

- Experience handling structured, semi-structured, and unstructured data formats (CSV, XML, HTML, SQL, JSON).

- Strong analytical and database skills (complex queries, query optimization, debugging, indexes).

- Familiarity with source control (Git, Bitbucket) and CI tools (Jenkins).

- Ability to support enterprise data platforms and collaborate with cross-functional teams.


Years of Experience: 7 - 12 years.


Location: Bengaluru , Pune.

  • Pyspark developer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Pyspark DeveloperVirtual Interview Date-11th October 2025Desired Experience: 4-11 yearsJob Location: Bangalore / Chennai / HyderabadRequire skillset: Big Data, Hadoop, Spark, Hive ,PysparkJob Description:-Must Have Technical Qualifications:SparkHadoopHiveNice to Have Qualifications:Data Engineer CertificationExperience...

  • Data Engineer – Databricks

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • Senior Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Luxoft Full time

    Project descriptionWe need a Senior Python and Pyspark Developer to work for a leading investment bank client.ResponsibilitiesDevelop software applications based on business requirementsMaintain software applications and make enhancements according to project specificationsParticipate in requirement analysis, design, development, testing, and implementation...

  • Azure databricks, PySpark

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...

  • Pyspark

    2 weeks ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • PySpark Developer

    5 days ago

    Bengaluru, Karnataka, India INFOBELL IT SOLUTIONS PVT LTD Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title : PySpark DeveloperLocation : Bangalore (Work from Office)Experience : 5+ YearsNotice Period : Immediate Joiners PreferredAbout Us : Infobell IT is a technology-driven organization specializing in product engineering, AI, cloud modernization, and data analytics. We collaborate with leading global enterprises to deliver scalable and...

  • Java Developer with PySpark

    1 week ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Java Developer with PySparkLocation:BangaloreExperience:5- 6+ YearsWork Mode:Hybrid (4 days WFO - 1 Day -WFH)Job Description:We are looking for a highly skilled and experiencedJava Developer with PySparkexpertise to join our dynamic team. The ideal candidate will have a strong background in backend development, big data processing, and cloud-native...

  • Software Engineer, PySpark

    5 days ago

    Bengaluru, Karnataka, India NatWest Group Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    Software Engineer, PySpark, VP Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software Engineer You'll be designing, producing, testing and implementing working software, working across the lifecycle of the system Hone your existing software engineering skills and advance your career...

  • Big Data/Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL-Kolkata/Pune/Mumbai/Bangalore/BBSR

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQLJOB LOCATION : Kolkata/Pune/Mumbai/Bangalore/BBSREXPERIENCE REQUIREMENT : 4+Technical Skill Set :Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLMust have:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud...