Pyspark

2 days ago

Bengaluru, India Riverforest Connections Full time

Position Purpose
- For the projects which are implemented on Data SSC platform, we need senior developer for python
- pyspark development to migrate project from spark/scala to python-pyspark._

**Responsibilities**

**Direct Responsibilities**

Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

Develop and maintain highly scalable, high performance code

Develop/Integrate the code adhering to CI/CD

Provide solutions relevant to existing technology architecture.

Manage & Support the storage platform for the project

Create tests and ensure code coverage is met as per the agreed standards

**Contributing Responsibilities**

To work with members of DataSSC in establishing the best practises related to python-pyspark development

**Technical & Behavioral Competencies**

1. Deep experience in developing data processing task using pyspark such as reading data from external sources, merge data, perform data enrichment and load into target destinations

2. Experience to Big Data ecosystem components (Hive, ZooKeeper, Oozie, HDFS etc.)

3. Produce unit tests and document for pyspark transformations and helper methods

4. Preferred to have ETL background

5. Good knowledge in Unix Shell scripting

6. CI/CD with knowledge of Git Hub and Jenkins

7. Ability to learn new concepts, technologies and tools quickly

8. Solid understanding of Agile Sprint methodologies

9. Ability to communicate effectively in both a technical and non-technical manner

**Skills Required**:
pyspark

**Location**

Mumbai / Chennai / Bangalore/Bengaluru

**Years Of Experience**

4 to 9 Years

  • Pyspark Professional

    2 weeks ago

    Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Immediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. PysparkExperience in Cloud platform, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, ScalaPerformance Turing Optimize SQL, PySpark for performanceAirflow workflow scheduling tool for...

  • Pyspark Developer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark Developer

    5 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark Developer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Hyderabad, Bangalore, Chennai, Kolkata, Pune Must Have: Data Engineer, Python developer with specialty...

  • Pyspark Developer

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Hyderabad, Bangalore, Chennai, Kolkata, Pune Must Have: Data Engineer, Python developer with specialty...

  • Pyspark-gurgaon

    1 week ago

    Bengaluru, Karnataka, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 5 to 14 years **Location**: Gurgaon **Drive Date: 1st Feb 25 (In-Person)** - Design, develop, maintain efficient and scalable solutions using PySpark - Ensure data quality and integrity by implementing robust testing, validation and cleansing processes - Integrate data from various sources, including databases, APIs,...

  • Pyspark

    1 week ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • Pyspark Developer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark Developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark Developer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Hyderabad, Bangalore, Chennai, Kolkata, Pune Must Have: Data Engineer, Python developer with...