Pyspark designer

4 days ago

Bengaluru Karnataka India, Karnataka Tata Consultancy Services Full time

We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have:


- Over 5 years’ experience designing and developing ETL integration patterns using Python and Spark.

- 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a plus).

- Proven ability to create and maintain data integration pipelines, including migrating data (DB2 to Amazon S3).

- Experience handling structured, semi-structured, and unstructured data formats (CSV, XML, HTML, SQL, JSON).

- Strong analytical and database skills (complex queries, query optimization, debugging, indexes).

- Familiarity with source control (Git, Bitbucket) and CI tools (Jenkins).

- Ability to support enterprise data platforms and collaborate with cross-functional teams.


Years of Experience: 7 - 12 years.


Location: Bengaluru , Pune.

  • Azure databricks, PySpark

    4 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...

  • Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark

    1 week ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • PySpark Developer

    4 days ago

    Bengaluru, Karnataka, India INFOBELL IT SOLUTIONS PVT LTD Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title : PySpark DeveloperLocation : Bangalore (Work from Office)Experience : 5+ YearsNotice Period : Immediate Joiners PreferredAbout Us : Infobell IT is a technology-driven organization specializing in product engineering, AI, cloud modernization, and data analytics. We collaborate with leading global enterprises to deliver scalable and...

  • Java Developer with PySpark

    1 week ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Java Developer with PySparkLocation:BangaloreExperience:5- 6+ YearsWork Mode:Hybrid (4 days WFO - 1 Day -WFH)Job Description:We are looking for a highly skilled and experiencedJava Developer with PySparkexpertise to join our dynamic team. The ideal candidate will have a strong background in backend development, big data processing, and cloud-native...

  • Software Engineer, PySpark

    4 days ago

    Bengaluru, Karnataka, India NatWest Group Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    Software Engineer, PySpark, VP Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software Engineer You'll be designing, producing, testing and implementing working software, working across the lifecycle of the system Hone your existing software engineering skills and advance your career...

  • Big Data/Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL-Kolkata/Pune/Mumbai/Bangalore/BBSR

    4 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQLJOB LOCATION : Kolkata/Pune/Mumbai/Bangalore/BBSREXPERIENCE REQUIREMENT : 4+Technical Skill Set :Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLMust have:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud...

  • Software Engineer, PySpark

    4 days ago

    Bengaluru, Karnataka, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Engineer, PySpark, AVP Join us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It's a chance to hone your existing technical skills and advance your career We're offering...

  • Software Engineer, PySpark and AWS

    5 days ago

    Bengaluru, Karnataka, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Engineer, PySpark and AWS, AVP Join us as a Software Engineer, PySpark and AWSThis is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It's a chance to hone your existing technical skills and advance your career ...