Pyspark
19 hours ago
Position Purpose
- For the projects which are implemented on Data SSC platform, we need senior developer for python
- pyspark development to migrate project from spark/scala to python-pyspark._
**Responsibilities**
**Direct Responsibilities**
Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns
Develop and maintain highly scalable, high performance code
Develop/Integrate the code adhering to CI/CD
Provide solutions relevant to existing technology architecture.
Manage & Support the storage platform for the project
Create tests and ensure code coverage is met as per the agreed standards
**Contributing Responsibilities**
To work with members of DataSSC in establishing the best practises related to python-pyspark development
**Technical & Behavioral Competencies**
1. Deep experience in developing data processing task using pyspark such as reading data from external sources, merge data, perform data enrichment and load into target destinations
2. Experience to Big Data ecosystem components (Hive, ZooKeeper, Oozie, HDFS etc.)
3. Produce unit tests and document for pyspark transformations and helper methods
4. Preferred to have ETL background
5. Good knowledge in Unix Shell scripting
6. CI/CD with knowledge of Git Hub and Jenkins
7. Ability to learn new concepts, technologies and tools quickly
8. Solid understanding of Agile Sprint methodologies
9. Ability to communicate effectively in both a technical and non-technical manner
**Skills Required**:
pyspark
**Location**
Mumbai / Chennai / Bangalore/Bengaluru
**Years Of Experience**
4 to 9 Years
-
Pyspark Developer
4 weeks ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Hyderabad, Bangalore, Chennai, Kolkata, Pune Must Have: Data Engineer, Python developer with specialty...
-
Pyspark Developer
4 weeks ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Hyderabad, Bangalore, Chennai, Kolkata, Pune Must Have: Data Engineer, Python developer with specialty...
-
Pyspark-gurgaon
1 week ago
Bengaluru, Karnataka, India Cognizant Full time**Skill**: Pyspark **Experience**: 5 to 14 years **Location**: Gurgaon **Drive Date: 1st Feb 25 (In-Person)** - Design, develop, maintain efficient and scalable solutions using PySpark - Ensure data quality and integrity by implementing robust testing, validation and cleansing processes - Integrate data from various sources, including databases, APIs,...
-
Pyspark Developer
2 weeks ago
Bengaluru, India Tata Consultancy Services Limited Full timeJob Description Title- Pyspark Developer Job Description Must-Have - Minimum 6-8years of experience in build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python; - Minimum 5 years of extensive experience in design, build and deployment of Python-based applications; - Design and develop ETL integration patterns using Python on Spark....
-
Databricks+Pyspark
2 days ago
Bengaluru, India Tata Consultancy Services Full timeDatabricks+Pyspark Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before...
-
Pyspark developer
9 hours ago
Bengaluru, India Tata Consultancy Services Full timeThe ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code.Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to...
-
Pyspark developer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS! TCS is hiring for Pyspark Developer Virtual Interview Date-11th October 2025 Desired Experience: 4-11 years Job Location: Bangalore / Chennai / Hyderabad Require skillset: Big Data, Hadoop, Spark, Hive ,Pyspark Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Nice to Have Qualifications: Data Engineer Certification...
-
Pyspark developer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS! TCS is hiring for Pyspark Developer Virtual Interview Date-11th October 2025 Desired Experience: 4-11 years Job Location: Bangalore / Chennai / Hyderabad Require skillset: Big Data, Hadoop, Spark, Hive ,Pyspark Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Nice to Have Qualifications: Data Engineer Certification...
-
Pyspark developer
2 days ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS! TCS is hiring for Pyspark Developer Virtual Interview Date-11th October 2025 Desired Experience: 4-11 years Job Location: Bangalore / Chennai / Hyderabad Require skillset: Big Data, Hadoop, Spark, Hive ,Pyspark Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Nice to Have Qualifications: Data Engineer Certification...
-
Pyspark developer
2 days ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS! TCS is hiring for Pyspark Developer Virtual Interview Date-11th October 2025 Desired Experience: 4-11 years Job Location: Bangalore / Chennai / Hyderabad Require skillset: Big Data, Hadoop, Spark, Hive ,Pyspark Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Nice to Have Qualifications: Data Engineer Certification...
