Pyspark designer

5 days ago


Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have:

  • Over 5 years' experience designing and developing ETL integration patterns using Python and Spark.

  • 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a plus).

  • Proven ability to create and maintain data integration pipelines, including migrating data (DB2 to Amazon S3).

  • Experience handling structured, semi-structured, and unstructured data formats (CSV, XML, HTML, SQL, JSON).

  • Strong analytical and database skills (complex queries, query optimization, debugging, indexes).

  • Familiarity with source control (Git, Bitbucket) and CI tools (Jenkins).

  • Ability to support enterprise data platforms and collaborate with cross-functional teams.

Years of Experience: years.

Location: Bengaluru , Pune.


  • Pyspark Lead

    7 days ago


    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...

  • Pyspark Developer

    4 days ago


    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark

    3 hours ago


    Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • Pyspark Architect

    1 week ago


    Bengaluru, Karnataka, India Talent Worx Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...


  • Bengaluru, Karnataka, India ONOC Full time ₹ 1,00,00,000 - ₹ 1,40,00,000 per year

    We're Hiring – Developer (Python | PySpark)Location: Chennai / BangaloreCTC: ₹13 – 14 LPAExperience: 8 – 10 YearsNotice Period: Max 20 DaysKey Responsibilities:Design, develop & maintain scalable data pipelines using PySpark on cloud (AWS / Azure / GCP)Write complex, optimized SQL queries for data extraction, transformation & analysisBuild automation...


  • Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...


  • Bengaluru, Karnataka, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Join us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at senior analyst levelWhat you'll...


  • Bengaluru, Karnataka, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Join us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutionsIt's a chance to hone your existing technical skills and advance your career while building a wide...


  • Bengaluru, Karnataka, India Altimetrik Full time ₹ 1,50,000 - ₹ 2,50,000 per year

    ,Greeting from Altimetrik We are looking for a highly skilled and experienced Data Engineer join our dynamic team.Technical Skills & Qualifications:Mandatory Skills : Python, Pyspark ,SQL , ETL , Spark ,Hive, Data Ware House/Datamart design , AWS/AZUREExperience : 5 to 10 yrs only . 5+ MandatoryLocation : Bangalore only.Educational Qualification:Bachelors...


  • Bengaluru, Karnataka, India RBS Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Join us as a Data Engineer, PySparkThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data...