Senior Big Data Engineer

2 days ago


Pune, Maharashtra, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job Description:
The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems analysis, development and maintenance activities. This role requires hands-on development and participation in entire software/application development lifecycle. 

Responsibilities:

  • Manage one or more Applications Development teams in an effort to accomplish established goals
  • Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
  • Review/analyze/develop proposed technical solutions for projects
  • Contribute to formulation of strategies for applications development and other functional areas
  • Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
  • Provide evaluative judgment based on analysis of factual data in complicated and unique situations
  • Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
  • Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards.

 
Core Skills:

  • The Senior Data Engineer will be working very closely with a team of data engineers working on our Big Data Platform. They will need the below core skills –
  • Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
  • Hands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
  • Strong proficiency in Spark for development work related to curation/conformance. Strong Scala development (with previous Java background) preferred.
  • Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
  • Strong data analysis skills and the ability to slice and dice the data as needed for business reporting, SQL Server), NoSQL (MongoDB) database integration and data distribution principles experienceRelational SQL (Oracle

Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
 

Communication Skills: Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
 

DevOps Practices: Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
 

Software Engineering Principles: Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
 

Data Visualization: Experience with data visualization tools and techniques for presenting data insights effectively.
 

Agile Methodologies: Familiarity with agile development methodologies and experience working in agile and scaled agile teams.

 
Additional Requirements (Nice to have):

•  Experience with Graph Databases like Neo4j

•  Experience with API development and use of JSON/XML data formats.

Qualifications:

•  6-10 years of relevant experience in the Big Data Application Development

•  Experience as Applications Development Lead

•  Experience as senior level in an Applications Development role

•  Stakeholder and people management experience is good to have

•  Basic knowledge of industry practices and standards

 
Education:

•  Bachelor's degree/University degree or equivalent experience

•  Master's degree preferred

Other Relevant Skills

Apache Hadoop, Apache Hive, Apache Impala, Apache Kafka, Apache Spark, Big Data, Java, MongoDB, NoSQL, Oracle Database, Python (Programming Language), Relational Database Management System (RDBMS). 

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

Big Data, PySpark, Python (Programming Language), Scala (Programming Language).

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi's EEO Policy Statement and the Know Your Rights poster.


  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...


  • Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...


  • Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...


  • Pune, Maharashtra, India Mycitypune Full time

    Job Description- Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field- Experience: 3-5 years of hands on experience across Big Data project implementations.- Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key stakeholders...

  • Big Data Engineer

    1 week ago


    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering Leader">We are looking for a seasoned Senior Data Engineering Leader to oversee the development and implementation of scalable, distributed data platforms that drive business value.">As a key member of our engineering team, you will be responsible for:">">Designing and architecting high-performance data pipelines that integrate with...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Big Data EngineerWe are seeking a highly skilled and experienced Senior Big Data Engineer to fill this role.Design, develop, and maintain scalable and high-performance data processing systems for maximum efficiency.Build robust ETL/ELT workflows for structured and unstructured data using big data technologies like Hadoop, Spark, Hive, HBase, Kafka,...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Big Data Engineer (PySpark)Location:Pune/Nagpur (WFO)Experience:8 - 12 YearsEmployment Type:Full-timeJob OverviewWe are looking for an experiencedBig Data Engineerwith strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance...