Big Data Systems Engineer

4 days ago

Mumbai, Maharashtra, India CPP Investments Full time

Transforming Data into Business Value

CPP Investments is a global investment organization seeking a highly skilled Lead, Data Engineer to join our team. As a key member of our Data Engineering team, you will play a critical role in designing, building, and deploying large-scale data processing systems on AWS cloud.

Key Responsibilities:

  • Design solutions aligned with long-term architecture and technology strategy using Amazon Web Services (AWS) for Cloud development
  • Participate in the development life cycle from start to completion - requirements analysis, development, testing, and deployment
  • Work with data analysts to select and acquire non-traditional datasets and access, clean, and pre-process data as required by use cases
  • Select appropriate datasets and data representation methods
  • Collaborate with data analysts to have necessary data pipelines built
  • Build, train, validate and test models using criteria relevant to business objectives
  • Work in a fast-paced environment collaborating with data analysts, data engineers and architects
  • Ensure architecture will support the requirements of CPP Investments' business
  • Prepare, transform, combine and manage structured and unstructured data for use by CPP Investments' business users
  • Recommend ways to improve data reliability, efficiency and quality
  • Define and shape CPP Investments' future technology and research process

Requirements

  • University degree in Engineering or Computer Science
  • Proven ability to work independently as well as to perform effectively in a team-oriented and open-concept environment
  • Deep experience working with big data including cleaning/transforming/cataloguing/mapping/ etc.
  • Experienced in cloud technology best practices to enable the distribution and analysis of big data on the cloud (formatting/partitioning/etc.)
  • Experience of ETL pipelines, managing multiple datasets and providing necessary support
  • Familiarity working with data lakes using S3/Redshift
  • Exposure to big data workflows and analytics tools (Spark/EMR/Databricks/Cassandra).
  • Deep proficiency in Python with experience using Spark, Pandas or PySpark.
  • An understanding of CI/CD pipelines and experience with DevOps
  • Experience building flexible solutions that can adapt quickly to changing requirements.
  • Ability to work in an entrepreneurial environment and be a self-starter
  • Interests in the financial industry
  • Proven attention to accuracy and detail, highly organized with the ability to prioritize and multi-task
  • Exceptional (written and verbal) communication skills and interpersonal skills
  • Ability to work in a high performing culture with time-sensitive deadlines
  • Personable, easily interacts with all types of personalities and at all levels with a high degree of professionalism
  • Exemplify our Guiding Principles of Integrity, Partnership, and High Performance

About CPP Investments

CPP Investments is a professional investment management organization that globally invests the funds of the Canada Pension Plan (CPP) to help ensure long-term sustainability. With current assets under management valued in excess of $500 billion, CPP Investments is one of the most respected and fastest growing institutional investors in the world.

We are committed to attracting and selecting high-calibre individuals from top-tier institutions around the globe. If you share a passion for performance, value a collegial and collaborative culture, and approach everything with the highest integrity, we encourage you to apply for this exciting opportunity.

  • Senior Big Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.Key Responsibilities:- Design,...

  • Big Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Nibodhah Full time

    Job SummaryNibodhah is seeking an experienced Big Data Engineer to develop and implement data pipelines that extract, transform, and load data into an information product that informs the organization in reaching strategic goals.Key ResponsibilitiesDevelop and maintain data pipelines implementing ETL processesBuild, operate, monitor, and troubleshoot Hadoop...

  • Big Data Engineer

    6 days ago

    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    Key Responsibilities:As a Data Processing Expert at Smartavya Analytica Private Limited, you will be responsible for developing, testing, and implementing Big Data projects using Hadoop, Spark, and Hive. Your expertise in setting up Hadoop services, implementing ETL/ELT pipelines, and working with Terabytes of data ingestion and processing from varied...

  • Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Snaphunt Full time

    The OpportunityWe are seeking an experienced Big Data Developer to join our team at Snaphunt. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.The RoleDesign and implement robust data processing solutions using...

  • Big Data Developer

    4 days ago

    Mumbai, Maharashtra, India Pegasus InfoCorp Full time

    About the Role:Pegasus InfoCorp is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for building solutions for customers using Big Data technologies. You will work on designing, developing, and implementing Big Data solutions that meet our customers' needs. You will also be responsible for...

  • Big Data Architect

    4 days ago

    Mumbai, Maharashtra, India Vertoz Full time

    Job OverviewWe are seeking a skilled Data Engineer with Hadoop Experience to join our team at Vertoz. The ideal candidate will be responsible for designing, developing, and maintaining our data pipeline architecture, ensuring seamless data flow and collection for cross-functional teams.The selected candidate will have hands-on experience with Hadoop, Spark,...

  • Senior Data Engineer

    4 days ago

    Mumbai, Maharashtra, India Nielsen Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our DevOps team at Nielsen. As a Senior Data Engineer, you will be responsible for analyzing, developing, testing, and supporting Big Data applications. Your primary objective will be to ensure project goals are achieved and are aligned with business objectives.ResponsibilitiesDesign,...

  • Big Data Manager

    2 weeks ago

    Mumbai, Maharashtra, India Protegrity USA Full time

    Protegrity USA is seeking a seasoned technology professional to fill the role of Manager, Engineering Big Data. The ideal candidate will have 10+ years of experience in developing enterprise software and leading/managing a team. This position is a remote role and requires adaptability to learn and enhance skills in the domain of data security alongside the...

  • Big Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full time

    About SynechronSynechron is a global consulting firm that specializes in digital transformation and innovation. Our team of experts combines creativity and technology to deliver industry-leading digital solutions.Job RoleThe Hadoop Developer will work on designing and developing big data solutions using Hive, Java, and Spark. The ideal candidate should have...

  • Big Data Developer

    5 days ago

    Navi Mumbai, Maharashtra, India Reliance Industries Limited Full time

    We are seeking a highly skilled Big Data Developer to join our team at Reliance Industries Limited. The ideal candidate will have a strong background in data engineering and analytics, with experience in designing and implementing data architectures that meet the needs of large-scale enterprise environments.Key Responsibilities:Collaborate with...

  • Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    Job DescriptionSmartavya Analytica Private Limited is seeking a highly skilled Hadoop Developer to join our team.Key ResponsibilitiesDesign and implement large-scale Big Data projects using Hadoop, Spark, and Hive.Lead the development of ETL/ELT pipelines and data ingestion processes.Collaborate with cross-functional teams to deliver high-quality data...

  • Big Data Engineer Java Spark

    3 weeks ago

    Mumbai, Maharashtra, India Overture Rede Private Limited Full time

    Job Title: Big Data Engineer Java SparkThis is a remote position.Job Summary:We are seeking a highly skilled Big Data Engineer with expertise in Java and Spark to join our modernization initiative team at Overture Rede Private Limited.Key Responsibilities:Implement and maintain high-volume online and offline batch and transactional client-facing applications...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Nexthire Full time

    Job Title: Data Engineer - Informatica and Big Data Management ExpertAbout the Role:We are seeking a skilled Data Engineer with experience in Informatica and Big Data Management. The ideal candidate will have a strong background in data extraction, transformation, and loading (ETL) processes, with a focus on optimizing data integration solutions for complex...

  • Big Data Engineer Java Spark

    3 weeks ago

    Mumbai, Maharashtra, India Overture Rede Private Limited Full time

    Job Title: Big Data Engineer Java SparkThis is a remote position.Job Description:We are seeking a big data engineer with advanced Java experience to join our modernization initiative team at Overture Rede Private Limited.The candidate will be responsible for implementing and maintaining high-volume online and offline batch and transactional client-facing...

  • Big Data Support Engineer

    1 week ago

    Navi Mumbai, Maharashtra, India Jio Full time

    About the Role: We are seeking a highly skilled Senior Hadoop Operations Engineer to join our team at Jio, where you will play a key role in ensuring the smooth operation of our big data infrastructure.Key Responsibilities:Big Data Infrastructure Management: You will be responsible for managing and maintaining our Hadoop cluster, including configuring and...

  • Data Systems Developer

    4 days ago

    Mumbai, Maharashtra, India IDFC FIRST Bank Full time

    Job Summary:We are seeking a highly skilled Data Engineer to join our team at IDFC FIRST Bank. The successful candidate will be responsible for developing and maintaining our data engineering projects, ensuring efficient data collection systems and processing pipelines.Key Responsibilities:Develop and implement data pipelines using Spark, Hadoop, and other...

  • Software Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Nielsen Full time

    About the RoleWe are seeking a highly skilled Software Engineer to join our DevOps team, focusing on analyzing, developing, testing, and supporting Big Data applications. As a key member of our team, you will work closely with your Scrum team and program team to ensure project goals are achieved and aligned with business objectives.ResponsibilitiesDesign,...

  • Big Data Hadoop Developer

    2 weeks ago

    Mumbai, Maharashtra, India Nibodhah Full time

    Job SummaryNibodhah is seeking a highly skilled Big Data Hadoop Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines that extract, transform, and load data into information products.ResponsibilitiesDevelop and implement data pipelines using...

  • Big Data Solutions Architect

    2 days ago

    Mumbai, Maharashtra, India Pegasus InfoCorp Full time

    About the RolePegasus InfoCorp seeks an experienced Big Data Solutions Architect to join our team and drive innovation in the field of Hadoop development.Design and implement scalable Big Data solutions using Hadoop, Spark, and other related technologies.Collaborate with cross-functional teams to understand business needs and develop effective...

  • Data Systems Engineer

    4 days ago

    Navi Mumbai, Maharashtra, India 3Di Systems Full time

    Job Title: Senior Database AdministratorJob Overview:We are seeking a skilled Senior Database Administrator to join our team at 3Di Systems. As a key member of our database operations team, you will be responsible for designing, implementing, and maintaining our database systems to ensure optimal performance, security, and data integrity.Key...