Pyspark

8 hours ago

Bengaluru, India Riverforest Connections Full time

Position Purpose
- For the projects which are implemented on Data SSC platform, we need senior developer for python
- pyspark development to migrate project from spark/scala to python-pyspark._

**Responsibilities**

**Direct Responsibilities**

Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

Develop and maintain highly scalable, high performance code

Develop/Integrate the code adhering to CI/CD

Provide solutions relevant to existing technology architecture.

Manage & Support the storage platform for the project

Create tests and ensure code coverage is met as per the agreed standards

**Contributing Responsibilities**

To work with members of DataSSC in establishing the best practises related to python-pyspark development

**Technical & Behavioral Competencies**

1. Deep experience in developing data processing task using pyspark such as reading data from external sources, merge data, perform data enrichment and load into target destinations

2. Experience to Big Data ecosystem components (Hive, ZooKeeper, Oozie, HDFS etc.)

3. Produce unit tests and document for pyspark transformations and helper methods

4. Preferred to have ETL background

5. Good knowledge in Unix Shell scripting

6. CI/CD with knowledge of Git Hub and Jenkins

7. Ability to learn new concepts, technologies and tools quickly

8. Solid understanding of Agile Sprint methodologies

9. Ability to communicate effectively in both a technical and non-technical manner

**Skills Required**:
pyspark

**Location**

Mumbai / Chennai / Bangalore/Bengaluru

**Years Of Experience**

4 to 9 Years

  • Pyspark consultant

    3 days ago

    Bengaluru, Karnataka, India Talan Enterprises Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company name- DeloittePySpark Consultantexperience yrsSkills Required- Pyspark,python,Aws3 ,Hadoop,sql,ci/cd

  • Pyspark-gurgaon

    1 week ago

    Bengaluru, Karnataka, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 5 to 14 years **Location**: Gurgaon **Drive Date: 1st Feb 25 (In-Person)** - Design, develop, maintain efficient and scalable solutions using PySpark - Ensure data quality and integrity by implementing robust testing, validation and cleansing processes - Integrate data from various sources, including databases, APIs,...

  • Pyspark

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • Python, Pyspark

    8 hours ago

    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • Pyspark Developer

    3 days ago

    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark Architect

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Pyspark Developer

    3 days ago

    Bengaluru, Karnataka, India Nuvento Systems Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for immediate joiner | Work from HomeKey skills:Pyspark, Apache Spark, AWS, Databricks, Scala, Java

  • Python,pyspark with Aws

    1 day ago

    Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...

  • Pyspark Developer

    3 days ago

    Bengaluru, Chennai, Pune, India Tekskills Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    JOB SUMMARY:Experience 6+years (relevant minimum 5+ years)Detailed job description - Skill Set:Candidate should have good hands on experience in Pyspark preferrable more than 7 years.Should have very good understanding of Agile development methodologies and excellent team handling experience.Mandatory Skills - Pyspark, Python, Agile

  • Pyspark

    3 days ago

    Bengaluru, Karnataka, India Hero Moto Corp Full time

    » **Date**:14 Jul 2025 **Location**: Bengaluru, KA, IN, 560038 **Company**:Hero Motocorp **Function** - Digital & Information Technologies **Pay Band** - E4 to M2 **Role** - PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills...