Big Data, Python, Pyspark- C11

1 day ago

Chennai Tamil Nadu, India Citigroup Full time

**Responsibilities**:

- Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
- Serve as advisor or coach to new or lower level analysts
- Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
- Has the ability to operate with a limited level of direct supervision.
- Can exercise independence of judgement and autonomy.
- Acts as SME to senior stakeholders and /or other team members.

**Key Responsibilities**:
Design and implement ETL pipelines using PySpark and Big Data tools on platforms like Hadoop, Hive, HDFS etc.Write scalable Python code for Machine Learning preprocessing tasks and work with libraries such as pandas, Scikit-learn etc.Develop data pipelines to support model training, evaluation and inference.

**Skills**:
Proficiency in Python programming with experience in PySpark for large-scale data processing.Hands-on experience in Big Data technologies: Hadoop, Hive HDFS etc.Exposure to machine learning workflows, model lifecycle and data preparation.Experience with ML libraries: Scikit-learn, XGBoost, Tensorflow, PyTorch etc.Exposure to cloud platforms (AWS/GCP) for data and AI workloads.

Qualifications:

- 4-8 years of relevant experience in the Financial Service industry
- Intermediate level experience in Applications Development role
- Consistently demonstrates clear and concise written and verbal communication
- Demonstrated problem-solving and decision-making skills
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

**Education**:

- Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.Job Family Group:
Technology
- **Job Family**:
Applications Development
- Time Type:
Full time
- Most Relevant Skills

Please see the requirements listed above.
- Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

  • Big Data, Python, Pyspark- C11

    2 weeks ago

    Chennai, Tamil Nadu - Pune, Maharashtra, India Citigroup Full time

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team The overall objective of this role is to contribute to applications systems analysis and programming...

  • Officer- Data Engineer

    2 weeks ago

    Chennai, India Citi Full time

    At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most...

  • Big Data + Pyspark

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Full time

    AIA-Pune **Job Summary** Data Engineer 4 to 9 Years **Responsibilities** Data Engineering design experience (to support with HLD review LLD build out etc.) Azure experience confident in working with Azure Cloud and Data Engineering capabilities ( e.g. ADLS Gen2 Synapse ADF etc.) Advanced SQL experience query writing & optimisation data aggregation...

  • PySpark/Scala Developer

    2 weeks ago

    Chennai, India Risk Resources LLP Full time

    Description : Job Title : PySpark/Scala DeveloperFunctional Skills : Experience in Credit Risk/Regulatory risk domainTechnical Skills : Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scriptingGood to Have Skills : Exposure to Machine Learning TechniquesJob Description : - 5+ Years of experience with Developing/Fine tuning and implementing...

  • Data Engineer

    7 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!! Role: Data Engineer with Mandatory Pyspark, Python Knowledge Desired Experience Range: 5 to 10 yrs Location: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 Days Interview Mode: Virtual Mode Interview Date: 13th Nov 2025 Time Of Interview: 10AM TO 2PM Required Technical Skill Set:...

  • Data Engineer

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python KnowledgeDesired Experience Range: 5 to 10 yrsLocation: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 DaysInterview Mode: Virtual ModeInterview Date: 13th Nov 2025Time Of Interview: 10AM TO 2PMRequired Technical Skill Set: Python,...

  • Data Engineer

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python KnowledgeDesired Experience Range: 5 to 10 yrsLocation: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 DaysInterview Mode: Virtual ModeInterview Date: 13th Nov 2025Time Of Interview: 10AM TO 2PMRequired Technical Skill Set: Python,...

  • Data Engineer

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python KnowledgeDesired Experience Range: 5 to 10 yrsLocation: Pune, Hyderabad, Chennai, Bangalore, Kochi, BhubaneshwarNotice period: 0 To 30 DaysInterview Mode: Virtual ModeInterview Date: 13th Nov 2025Time Of Interview: 10AM TO 2PMRequired Technical Skill Set: Python,...

  • Data Engineer

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python KnowledgeDesired Experience Range: 5 to 10 yrsLocation: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 DaysInterview Mode: Virtual ModeInterview Date: 13th Nov 2025Time Of Interview: 10AM TO 2PMRequired Technical Skill Set: Python,...

  • Big Data Developer(Hive, Pyspark)

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    TCS is conducting Weekend Virtual Drive for Big Data Developer(Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: ChennaiNotice Period: 0- 90 daysDate of Interview: 25th Oct, 2025Mode of Interview: Virtual Drive( Cisco or WebEx)Roles & Responsibilities:- Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.- Should be able to...