3 Days Left: Big Data Engineering Lead- C13

3 weeks ago

Chennai Tamil Nadu, India Citigroup Full time

The Senior Big Data engineering lead will play a pivotal role in designing implementing and optimizing large-scale data processing and analytics solutions This role requires a visionary leader who can drive innovation define architecture strategy and ensure the scalability and efficiency of our big data infrastructure Key Responsibilities Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience Design complex data transformation processes using Spark and other big data technologies using Java Pyspark or Scala Design and implement data pipelines that ensure data quality integrity and availability Collaborate with cross-functional teams to understand business needs and translate them into technical requirements Evaluate and select technologies that improve data efficiency scalability and performance Oversee the deployment and management of big data tools and frameworks such as Hadoop Spark Kafka and others Provide technical guidance and mentorship to the development team and junior architects Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities Optimize big data frameworks such as Hadoop Spark for performance improvements and reduced processing time across distributed systems Innovate in designing developing and refining data pipeline architectures to enhance data flow and ensure data processing capabilities Implement data governance frameworks to ensure data accuracy consistency and privacy across the organization leveraging metadata management and data lineage tracking Conduct benchmarking and stress testing of big data solutions to validate performance standards and operational capacity Ensure compliance with data security best practices and regulations Qualifications Bachelor s or Master s degree in Computer Science Information Technology or related field Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion persistence and retrieval Deep understanding of big data technologies including Hadoop Spark Kafka Flink NoSQL databases etc Experience with Bigdata technologies Developer Hadoop Apache Spark Python PySpark Strong programming skills in languages such as Java Scala or Python Excellent problem-solving skills with a knack for innovative solutions Strong communication and leadership abilities Proven ability to manage multiple projects simultaneously and deliver results Preferred Skills Experience with data modeling and ETL ELT processes Experience in moving ETL frameworks from proprietary ETL technologies like Abinitio to Apache Spark Familiarity with machine learning and data analytics tools Knowledge of core banking financial services systems Job Family Group Technology Job Family Applications Development Time Type Full time Most Relevant Skills Please see the requirements listed above Other Relevant Skills For complementary skills please see above and or contact the recruiter Citi is an equal opportunity employer and qualified candidates will receive consideration without regard to their race color religion sex sexual orientation gender identity national origin disability status as a protected veteran or any other characteristic protected by law If you are a person with a disability and need a reasonable accommodation to use our search tools and or apply for a career opportunity review View Citi s and the poster

  • Big Data Lead Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Synechron Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Big Data Lead Engineer - Hadoop - Spark & GCP (BigQuery/DataProc) with Java & Python ExpertiseJob SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutionsThis full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • Big Data Lead Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Synechron Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Lead Engineer — Hadoop, Spark & GCP (BigQuery/DataProc) with Java & Python Expertise Job Summary Synechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions. This full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • ▷ 3 Days Left: Data Engineer Lead

    3 days ago

    Chennai, India Bounteous x Accolite Full time

    Job Description About This Role Bounteous x Accolite is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today's complex challenges and tomorrow's opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions...

  • Big Data Intern

    6 days ago

    Anna Nagar, Chennai, Tamil Nadu, India Vestel Telecom Services Full time

    **Job title**: Big Data Intern **Job type**: Full time, at Office **Schedule**: Day shift, Mon-Fri **Duration**: 4- 6 months **Stipend**: Nil **Work Location**: Chennai, Anna Nagar. 1. Working with Hadoop, Python, SQL and Spark. 2. Work on various ETL processing methods and tools used. 3. Will work on various cloud platforms for big data infra setup...

  • [3 Days Left] Data Engineer

    3 days ago

    Chennai, India Vantageiq Technologies Opc Full time

    Job Description Key Responsibilities - Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies - Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions - Process and analyze large-scale operational datasets using frameworks like Apache Spark -...

  • (3 Days Left) Data On Cloud Architect Role

    1 week ago

    Chennai, Tamil Nadu, India virtusa Full time

    Cloud Data Architect Role T0 The ideal professional for this Cloud Architect role will Have a passion for design technology analysis collaboration agility and planning along with a drive for continuous improvement and innovation Exhibit expertise in managing high-volume data projects that leverage Cloud Platforms Data Warehouse reporting and BI Tools and the...

  • 3 Days Left: Data Solution Architect

    3 days ago

    Chennai, India Olam International Full time

    Job Description - Experience:12-15 years of experience in data architecture, with extensive expertise in Google Cloud Platform (GCP). - Skills :Deep understanding of GCP services including Big Query, Dataflow, Pub/Sub, Cloud Storage, and IAM. Proficiency in data modeling, ETL processes, and dataware housing. - Qualifications: Masters degree in Computer...

  • Data/information Mgt Sr Mgr

    4 weeks ago

    Chennai, Tamil Nadu, India Citigroup Full time

    Control Automation - Delivery Lead C13 - SIS About CITI Citi s mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress We have 200 years of experience helping our clients meet the world s toughest challenges and embrace its greatest opportunities About AIM Analytics and...

  • ▷ 3 Days Left! Hc And Insurance Operations Analyst

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    ENROLLMENT BILLING - GRADE 6 HC INSURANCE OPERATIONS ANALYST Position Overview At NTT DATA we know that with the right people on board anything is possible The quality integrity and commitment of our employees have been key factors in our company s growth and market presence By hiring the best people and helping them grow both professionally and personally...

  • Big Data Engineer

    3 days ago

    Bengaluru, Chennai, India Tekskills Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JD:• At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake• Proven experience with cloud platforms preferable Azure particularly on data services• Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc• Perform Analysis on existing data storage...