Bigdata PySpark Developer

2 weeks ago


Pune, India Citi Full time

The Digital Software Engineer Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

  • Utilize knowledge of application development procedures and concepts, along with basic knowledge of other technical areas, to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code.
  • Consult with users, clients, and other technology groups on issues, recommend programming solutions, and install and support customer exposure systems.
  • Apply fundamental knowledge of programming languages to design specifications.
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging.
  • Serve as an advisor or coach to new/junior analysts.
  • Identify problems, analyze information, and make evaluative judgments to recommend and implement solutions.
  • Resolve issues by identifying and selecting solutions through the application of acquired technical experience and guidance from precedents.
  • Operate with a limited level of direct supervision.
  • Exercise independence of judgment and autonomy.
  • Act as an SME to senior stakeholders and/or other team members.
  • Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients, and assets by driving compliance with applicable laws, rules, and regulations, adhering to policy, applying sound ethical judgment regarding personal behavior, conduct, and business practices, and escalating, managing, and reporting control issues with transparency.

Qualifications:

  • Total 4-7 years of Bigdata, Spark development experience. Preferably 2-4 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • The candidate should have around 4-7 years of overall experience in Development and 2-4 years in Bigdata Ecosystem.
  • Should know Spark along with strong programming experience in PySpark.
  • Should know SQL at intermediate.

Skills set:

  • Both Python programming language and PySpark - Must Have – Expert
  • Big Data – Hadoop, Hive - Must Have – Expert
  • Coding / Problem solving skills - Must Have - Expert
  • Jupyter notebook - Must Have – Intermediate
  • SQL , Database - Must have – Intermediate
  • Unix Shell Scripting - Nice to Have – Intermediate
  • GIT, JIRA- Must Have – Intermediate
  • Candidate must have Exposure working on large development project with global team. Candidate must able work independently with minimal support from peers.

Education:

  • Bachelor's degree/University degree or equivalent experience

  • The candidate should have around 4-7 years of overall experience in Development and 2-4 years in Bigdata Ecosystem.

  • Should know Spark along with strong programming experience in PySpark.
  • Should know SQL at intermediate.

Required Skill Set

  • Both Python and PySpark
  • Big Data – Hadoop, Hive
  • Coding / Problem solving skills
  • Jupyter notebook
  • SQL , Database
  • Unix Shell Scripting
  • GIT, JIRA- Must Have

-

Job Family Group:

Technology

-

Job Family:

Digital Software Engineering

-

Time Type:

Full time

-

Most Relevant Skills

Please see the requirements listed above.

-

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

-

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .

View Citi's EEO Policy Statement and the Know Your Rights poster.



  • Pune, Maharashtra, India Citi Full time ₹ 1,20,000 - ₹ 2,60,000 per year

    The Digital Software Engineer Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Pyspark Developer

    3 days ago


    Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Pyspark DeveloperRequirements:Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data BricksGood Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.Must have...


  • Hyderabad, Pune, India IDESLABS PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment.Roles and ResponsibilityDesign, develop, and implement big data solutions using Hive and other relevant...

  • Big Data Developer

    2 weeks ago


    Pune, India Tata Consultancy Services Full time

    Job Title : Bigdata Developer Relevant Experience (in Yrs) : 4+ Location : Hyderabad, Pune, Chennai, Bangalore, Noida Technical/Functional Skills Must Have Experience in: 1. Hands on experience in Spark, Scala and Pyspark 2. Good knowledge in database. 3. Should be proficient in writing complex queries 4. Knowledge of Azure Data and Azure DevOps is a...

  • Pyspark Developer

    3 days ago


    Bengaluru, Chennai, Pune, India Tekskills Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    JOB SUMMARY:Experience 6+years (relevant minimum 5+ years)Detailed job description - Skill Set:Candidate should have good hands on experience in Pyspark preferrable more than 7 years.Should have very good understanding of Agile development methodologies and excellent team handling experience.Mandatory Skills - Pyspark, Python, Agile

  • Pyspark Developer

    2 days ago


    Bengaluru, Chennai, Pune, India VHR Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Description:We are looking for a skilled PySpark Developer to join our data engineering team. The ideal candidate will have strong experience in building scalable data pipelines using Apache Spark (PySpark), integrating with big data platforms, and working with large datasets in distributed environments. You will work closely with data engineers,...

  • Big Data Developer

    1 week ago


    Pune, India Tata Consultancy Services Full time

    Job Title : Bigdata DeveloperRelevant Experience (in Yrs) : 4+Location : Hyderabad, Pune, Chennai, Bangalore, NoidaTechnical/Functional Skills Must Have Experience in:1. Hands on experience in Spark, Scala and Pyspark2. Good knowledge in database.3. Should be proficient in writing complex queries4. Knowledge of Azure Data and Azure DevOps is a plus5. Any...

  • Pyspark Developer

    2 weeks ago


    Chennai, Hyderabad, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    TCS is Hiring Location :Bangalore, Chennai, Kolkata, Hyderabad, PuneExp : 4-8 YrsFunctional Skills: Experience in Credit Risk/Regulatory risk domainTechnical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scriptingGood to Have Skills: Exposure to Machine Learning TechniquesJob Description:4+ Years of experience with Developing/Fine tuning...

  • Big Data Developer

    4 hours ago


    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title :Bigdata DeveloperRelevant Experience (in Yrs) :4+Location :Hyderabad, Pune, Chennai, Bangalore, NoidaTechnical/Functional Skills Must Have Experience in:Hands on experience in Spark, Scala and PysparkGood knowledge in database.Should be proficient in writing complex queriesKnowledge of Azure Data and Azure DevOps is a plusAny certification on...

  • Pyspark Developer

    4 days ago


    Bengaluru, Chennai, Pune, India Quess Corp Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    ROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...