
Big Data Engineering Developer
1 week ago
The Applications Development Senior Programmer/Lead Analyst is an senior level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
Responsibilities:
- Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
- Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
- Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
- Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
- Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
- Ensure essential procedures are followed and help define operating standards and processes
- Serve as advisor or coach to new or lower level analysts
- Has the ability to operate with a limited level of direct supervision.
- Can exercise independence of judgement and autonomy.
- Acts as SME to senior stakeholders and /or other team members.
- Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
Core Responsibilities
This role is for a Data Engineering Lead to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value.
- Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer for consumption by business.
- Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models
- Provide guidance to the data conformance team for implementing the requirements/changes/enhancements to the conformance model
- Do hands-on development as part of the conformance team to deliver the business requirements
- Manage the workload of the team and the scrum process to align it with the objectives and priorities of the product owners
- Participate in data management activities related to the Risk and Regulatory requirements as needed.
Core Skills
The Data Engineering Senior Programmer will be working very closely with a team of data engineers working on our Big Data Platform. The Senior Developer will need the below core skills –
- Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
- 9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
- Strong proficiency in Spark for development work related to curation/conformance. Strong Scala developer (with previous Java background) preferred.
- Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
- Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
- Experience working in an agile environment with a fast paced changing requirements.
- Excellent planning and organizational skills
- Strong Communication skills
Additional Requirements (good to have)
- Cloudera/Hortonworks/AWS EMR, Couchbase, S3 experience a plus
- Experience with the AWS or GCP tech stack components
- Relational and NoSQL database integration and data distribution principles experience
- Experience with API development and use of JSON/XML/Hypermedia data formats
- Analysis and development across Lines of business including Payments, Digital Channels, Liquidities, Trade, Client Experience
- Cross train and fertilize functional and technical knowledge,
- Align to Engineering Excellence Development principles and standards.
- Promote and increase our Development Productivity scores for coding
- Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Working knowledge of consulting/project management techniques/methods
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Education:
- Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
Job Family Group:
Technology
Job Family:
Applications Development
Time Type:
Full time
Most Relevant Skills
Please see the requirements listed above.
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi's EEO Policy Statement and the Know Your Rights poster.
-
Big Data Engineer
4 days ago
Chennai, Tamil Nadu, India beBeeBigDataEngineer Full timeJob Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...
-
Big Data Engineer
2 days ago
Chennai, Tamil Nadu, India Insight Global Full timePosition: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...
-
Big Data Engineer
3 days ago
Chennai, Tamil Nadu, India Insight Global Full timePosition: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...
-
Big Data Developer
1 day ago
Chennai, Tamil Nadu, India IntraEdge Full timeJob Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...
-
Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Impetus Career Consultants Private Limited Full timeWe are hiring for one the IT big4 consulting.Location : Req : - AWS (Big Data services) S3, Glue, Athena, EMR.- Programming Python, Spark, SQL, Mulesoft,Talend, Dbt.- Data warehouse ETL, Redshift / Responsibilities : - Work with business stakeholders to understand their business needs.- Create data pipelines that extract, transform, and load (ETL) from...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Amazon Full timeProfit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation data and Business...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Citi Full time ₹ 15,00,000 - ₹ 20,00,000 per yearThe Data Engineer is accountable for developing high quality data products to support theBank's regulatory requirements and data driven decision making. A Data Engineer will serveas an example to other team members, work closely with customers, and remove orescalate roadblocks. By applying their knowledge of data architecture standards, datawarehousing, data...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Quantrail Data Full timeLocation: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...
-
Big Data Developer
1 day ago
Chennai, Tamil Nadu, India beBeeBigData Full time ₹ 9,00,000 - ₹ 12,00,000We're seeking experienced Big Data Developers with strong Python skills to contribute to our team's success.Key Responsibilities:Design and develop scalable data pipelines using PySpark and Python.Collaborate with cross-functional teams to implement data processing solutions.Develop expertise in Hadoop, Hive, Spark, and other Big Data technologies.Implement...
-
Big Data Engineer Position
2 days ago
Chennai, Tamil Nadu, India beBeeDataArchitecture Full timeJob Title: Data Architecture SpecialistWe are seeking a skilled Data Architecture Specialist to join our team.Key Responsibilities:Design and develop large-scale data processing workflows using Hadoop components such as HDFS, MapReduce, Hive, Pig, and HBase.Built and maintain ETL pipelines to ingest and transform data from various sources into Hadoop...