Lead Big Data Engineer

1 week ago

Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role Overview:

We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.

Key Responsibilities:

  • Design, develop, and maintain big data pipelines using PySpark and Apache Iceberg.
  • Optimize data workflows for performance and scalability.
  • Implement data transformation, cleansing, and enrichment processes.
  • Collaborate with data scientists and analysts to deliver actionable insights.
  • Ensure data quality, consistency, and security across all pipelines.
  • Monitor and troubleshoot data pipeline issues in production.

Required Skills:

  • Strong experience with PySpark and Apache Iceberg.
  • Proficiency in distributed data processing and big data technologies.
  • Knowledge of data modeling and schema design.
  • Familiarity with cloud platforms like AWS, Azure, or GCP.
  • Experience with version control tools like Git.

Qualifications:

  • years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication

Education:

  • Bachelor's degree/University degree or equivalent experience
  • Master's degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

-

Job Family Group:

Technology

-

Job Family:

Applications Development

-

Time Type:

Full time

-

Most Relevant Skills

Please see the requirements listed above.

-

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

-

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi's EEO Policy Statement and the Know Your Rights poster.

  • Big Data Lead

    3 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Big Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Information Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.Develop distributed data processing systems...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...

  • Lead Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.Key Responsibilities:Design, develop, and maintain big data pipelines using PySpark and...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer Job Title: Big Data Engineer About Us "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100...

  • Data Engineer

    5 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Capco Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...

  • Big Data Lead

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Investor Services, a leading business line in the Citi Services and offers the full spectrum of capabilities to clients including Custody, Fund Accounting, Investment Accounting, Fund Administration, Middle Office Services, Performance and Risk Analytics, Transfer Agency and Securities lending across multiple jurisdictions.Investor Services has embarked on...