Big Data, Python, Pyspark- C11

2 weeks ago

Chennai Tamil Nadu, India Citi Full time

**Responsibilities**:

- Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
- Serve as advisor or coach to new or lower level analysts
- Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
- Has the ability to operate with a limited level of direct supervision.
- Can exercise independence of judgement and autonomy.
- Acts as SME to senior stakeholders and /or other team members.

**Key Responsibilities**:
Design and implement ETL pipelines using PySpark and Big Data tools on platforms like Hadoop, Hive, HDFS etc. Write scalable Python code for Machine Learning preprocessing tasks and work with libraries such as pandas, Scikit-learn etc. Develop data pipelines to support model training, evaluation and inference.

**Skills**:
Proficiency in Python programming with experience in PySpark for large-scale data processing. Hands-on experience in Big Data technologies: Hadoop, Hive HDFS etc. Exposure to machine learning workflows, model lifecycle and data preparation. Experience with ML libraries: Scikit-learn, XGBoost, Tensorflow, PyTorch etc. Exposure to cloud platforms (AWS/GCP) for data and AI workloads.

**Qualifications**:

- 4-8 years of relevant experience in the Financial Service industry
- Intermediate level experience in Applications Development role
- Consistently demonstrates clear and concise written and verbal communication
- Demonstrated problem-solving and decision-making skills
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

**Education**:

- Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**Job Family Group**:
Technology
- **Job Family**:
Applications Development
- **Time Type**:
Full time
- **Most Relevant Skills**

Please see the requirements listed above.
- **Other Relevant Skills**

For complementary skills, please see above and/or contact the recruiter.-
- View Citi’s _EEO Policy Statement_ and the _Know Your Rights_ poster._

  • Python/pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    **Skills required**: Python & PySpark Machine Learning & AI Data Management & SQL Containerization Orchestration Problem-Solving & Algorithms **Education/Qualification**: Python/PySpark **Desirable skills**: CI/CD & DevOps, Big Data Processing **Years of experience**: 15+ Years **Position**:Python/PySpark** **Duties & Responsibilities**: - Use the...

  • Python developers with Big Data experience

    2 weeks ago

    Chennai, Tamil Nadu, India Amazech Solutions Full time

    We are looking for skilled Big Data Developers with Python with strong hands-on experience in PySpark, Python scripting, and Big Data technologies to join our dynamic team.Key Skills Required:- Proficient in Python and PySpark- Strong experience in Big Data ecosystems (Hadoop, Hive, Spark, etc.)- Expertise in scripting for automation and data processing-...

  • Officer-pyspark Data Engineer-c11-hybrid-chennai

    7 days ago

    Chennai, Tamil Nadu, India Citi Full time

    The Data Analytics Intmd Analyst is a developing professional role. Deals with most problems independently and has some latitude to solve complex problems. Integrates in-depth specialty area knowledge with a solid understanding of industry standards and practices. Good understanding of how the team and area integrate with others in accomplishing the...

  • Python developers with Big Data experience

    2 weeks ago

    Chennai, Tamil Nadu, India Amazech Solutions Full time

    We are looking for skilled Big Data Developers with Python with strong hands-on experience in PySpark , Python scripting , and Big Data technologies to join our dynamic team. Key Skills Required : Proficient in Python and PySpark Strong experience in Big Data ecosystems (Hadoop, Hive, Spark, etc.) Expertise in scripting for automation and data...

  • Python Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    7 Years overall IT experience with minimum 5 years of work experience in below tech skills Tech Skills Strong experience in Python coding and PySpark for data processing Must have extensive development experience in PySpark and AWS Glue jobs Experience in AWS cloud platform and its data services S3 Redshift Lambda EMR Airflow Postgres SNS Event...

  • Big Data Developer

    5 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are looking for a highly skilled Big Data Developer to join our team. In this role, you will be responsible for developing and fine-tuning programs/applications using Python/PySpark/Scala on Big Data/Hadoop Platform.The ideal candidate will have strong knowledge of Big Data/Hadoop Platform and experience with Spark, PySpark, Python,...

  • Python Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    PySpark Developer Strong experience in technical leadership, mentoring MDM team of size approx. 10. Work experience 6+ years with skillset in Python (Pandas/ NumPy), PySpark Developer. Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses Hands-on experience writing complex SQL queries, exporting and importing large...

  • Python Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 8+ years in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life,...

  • Python Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Junior data engineer Overall 6 in IT Experience Required technical skills with min 5 years of experience in Python PySpark SQL AWS Required Domain Healthcare Insurance Extensive data analysis skills and Good communication skills Experience working in framework development Experience working in agile **About Virtusa** Teamwork, quality of life, professional...

  • Bigdata Python

    1 week ago

    Chennai, Tamil Nadu, India RF workforce Solutions Full time

    Skill: Bigdata with Python & Pyspark Yrs of experience: 5+ yrs Notice: preferable immediate **Job Types**: Full-time, Temporary Contract length: 6 months Pay: ₹60,000.00 - ₹82,000.00 per month Schedule: - Monday to Friday **Experience**: - Big data: 5 years (required) - python: 5 years (required) - pyspark: 5 years (required) Work Location: In...