SourceBae | Pyspark Developer | bangalore

3 weeks ago


bangalore, India SourceBae Full time

Job Title:

Senior Pyspark Developer


Job Description:

5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine.


We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally, knowledge of Databricks is highly desirable. The PySpark Developer will be responsible for designing, implementing, and optimizing data pipelines and ensuring data quality and performance.


Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using PySpark.

• Collaborate with cross-functional teams to gather requirements and deliver data solutions.

• Optimize and tune PySpark jobs for performance and scalability.

• Implement data quality checks and ensure data integrity.

• Troubleshoot and resolve issues related to data processing and performance.

• Work with Databricks to manage and optimize data workflows (nice to have).

• Develop and maintain documentation for data pipelines and processes.

• Stay updated with the latest trends and technologies in big data and analytics.


Nice to Have:

• Experience with Databricks for managing and optimizing data workflows.

• Knowledge of data streaming frameworks such as Kafka.


Experience Range :

5 - 8 years


Educational Qualifications :

B.Tech/B.E


If Intrested. Please submit your CV to or share it via WhatsApp at 8827565832


Stay updated with our latest job opportunities and company news by following us on LinkedIn: :


  • Pyspark Developer

    3 weeks ago


    bangalore, India SourceBae Full time

    Job Title:Senior Pyspark DeveloperJob Description:5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine.We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...

  • Pyspark developer

    2 weeks ago


    Bangalore, India SourceBae Full time

    Job Title: Senior Pyspark Developer Job Description: 5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine. We are seeking a skilled Py Spark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using Py Spark....


  • bangalore, India SourceBae Full time

    Title: Java Developer Location: India (Chennai, Bangalore, Kochi )- Hybrid Position Summary: Our dynamic team is seeking a Full Stack Developer proficient in SOLID principles and experienced in developing distributed, Event Driven applications. The ideal candidate should be a skilled programmer with expertise in at least one of the following languages: Java,...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - Angular Experience: 7+ years Work Location: Bangalore/Mangalore Education Qualification: BE/B.Tech/MCA/M.Sc/M.Tech Core Technical Expertise: Must have : NgRx and RxJs Job description: Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above). Deep understanding and hands-on...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - AngularExperience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise:Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with NgRx...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - Angular Experience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise: Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with...


  • bangalore, India SourceBae Full time

    GoLang Developer Location: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact,...


  • bangalore, India SourceBae Full time

    GoLang DeveloperLocation: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact, we’d...


  • bangalore, India SourceBae Full time

    TC Architect (10+ years of experience) Location - Hyderabad, Pune, Chennai, Bangalore/ Mode - Hybrid Profile: Teamcenter Solution Architect Experience: Solution design, development in Teamcenter PLM, AWC; customization in client and server, SOA client development Skills: ITK, RAC, C++ based SOA services, REST APIs, Java, XML, XSLT, BMIDE Modules: Structure...


  • bangalore, India SourceBae Full time

    Job Title: AWS Platform EngineerLocation: Bangalore / RemoteExperience: 7+ yearsAbout the Role:We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security, scalability,...


  • bangalore, India SourceBae Full time

    Job Title: AWS Platform Engineer Location: Bangalore / Remote Experience: 7+ years About the Role: We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security,...

  • Pyspark Developer

    3 weeks ago


    bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. - 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. - Must have...

  • Pyspark Developer

    1 month ago


    Bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. Must have...

  • Pyspark Developer

    1 month ago


    bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    3 weeks ago


    bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent...

  • Pyspark Developer

    3 weeks ago


    bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. Must have...

  • Pyspark Developer

    1 month ago


    bangalore, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    1 month ago


    Bangalore City, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...


  • bangalore, India Tata Consultancy Services Full time

    JD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...


  • Bangalore, India Tata Consultancy Services Full time

    JD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, Data Frames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence...