Big Data, Python, Pyspark- C11
3 days ago
**Responsibilities**:
- Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
- Serve as advisor or coach to new or lower level analysts
- Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
- Has the ability to operate with a limited level of direct supervision.
- Can exercise independence of judgement and autonomy.
- Acts as SME to senior stakeholders and /or other team members.
**Key Responsibilities**:
Design and implement ETL pipelines using PySpark and Big Data tools on platforms like Hadoop, Hive, HDFS etc.Write scalable Python code for Machine Learning preprocessing tasks and work with libraries such as pandas, Scikit-learn etc.Develop data pipelines to support model training, evaluation and inference.
**Skills**:
Proficiency in Python programming with experience in PySpark for large-scale data processing.Hands-on experience in Big Data technologies: Hadoop, Hive HDFS etc.Exposure to machine learning workflows, model lifecycle and data preparation.Experience with ML libraries: Scikit-learn, XGBoost, Tensorflow, PyTorch etc.Exposure to cloud platforms (AWS/GCP) for data and AI workloads.
Qualifications:
- 4-8 years of relevant experience in the Financial Service industry
- Intermediate level experience in Applications Development role
- Consistently demonstrates clear and concise written and verbal communication
- Demonstrated problem-solving and decision-making skills
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education**:
- Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.Job Family Group:
Technology
- **Job Family**:
Applications Development
- Time Type:
Full time
- Most Relevant Skills
Please see the requirements listed above.
- Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
- 
					
						Big Data + Pyspark
3 days ago
Chennai, Tamil Nadu, India Cognizant Full timeAIA-Pune **Job Summary** Data Engineer 4 to 9 Years **Responsibilities** Data Engineering design experience (to support with HLD review LLD build out etc.) Azure experience confident in working with Azure Cloud and Data Engineering capabilities ( e.g. ADLS Gen2 Synapse ADF etc.) Advanced SQL experience query writing & optimisation data aggregation...
 - 
					
						Big Data Developer(Hive, Pyspark)
2 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
2 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
2 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
1 week ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
2 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
1 week ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:- Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.- Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
1 week ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:- Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.- Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
5 days ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:- Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. - Should be able to...
 - 
					
						Big Data Developer(Hive, Pyspark)
1 week ago
Chennai, India Tata Consultancy Services Full timeTCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark) Years of Experience: 4 to 10 yrs Location: Chennai Notice Period: 0- 90 days Date of Interview: 25th Oct, 2025 Mode of Interview: Virtual Drive( Cisco or WebEx) Roles & Responsibilities: Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. Should be able...