Senior Data Pipeline Architect

24 hours ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Unlock your potential with a career in data engineering.

Job Role

Our organization is one of the largest banking and financial services providers globally, operating in 64 countries and territories. Our mission is to empower businesses and communities by facilitating growth and prosperity.

We are currently seeking an experienced professional to join our team as a Consultant Specialist. As a member of our team, you will play a crucial role in shaping our organization's data engineering capabilities.

  • Developing effective communication strategies with senior stakeholders
  • Collaborating with a team of technologists to ensure prioritization of tasks and removal of blockers
  • Driving product backlog management and overseeing product demos
  • Understanding complex business requirements and new technologies, influencing teams to adopt best practices and automation
  • Managing risks and issues
Requirements

To succeed in this role, you should meet the following criteria:

  • At least 5 years of experience in ETL tools (e.g., Prophecy, Datastage, Pentaho)
  • At least 2 years of experience in Pyspark development
  • Ability to design and configure data pipelines
  • Strong expertise in writing complex SQL queries for data analysis on databases (SQL server, Oracle, HIVE)
  • Possess technical skills: SQL, Python, Pyspark, Hive, ETL, Unix, Control-M, or similar scheduling tools, GCP Cloud knowledge, and experience in Airflow, Dataproc, Big query is an advantage
  • Capacity to work independently on specialized assignments within project deliverables
  • Take ownership of providing solutions and tools that increase engineering efficiency
  • Design should embed standard processes, systems, and operational models into BAU approach for end-to-end execution of data pipelines
  • Proven problem-solving and analytical abilities, including critically evaluating information from multiple sources, reconciling conflicts, decomposing high-level information into details, and applying sound business and technical domain knowledge
  • Effective communication and presentation skills
  • Ability to deliver high-quality materials to management against tight deadlines
  • Ability to work under pressure with competing priorities
  • Experience with finance systems and language
  • Knowledge of data processing and analytics systems

  • Chief Data Pipeline Architect

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Solutions ArchitectThe Role:This Senior Data Engineer position plays a pivotal role in the design, development, and maintenance of large-scale data pipelines using Azure services such as Databricks and Data Factory. The ideal candidate will possess proficiency in programming languages like SQL, Python, R, or Scala to create efficient data...

  • Data Pipeline Architect

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...

  • Data Pipeline Architect

    17 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Big Data Engineer">This role will oversee a team of employees and contractors in their professional development. Key responsibilities include mentoring, problem resolution, and team building to ensure success. The position will also lead software engineering projects in developing high-quality, secure, scalable applications and pipelines based on...

  • Senior Data Pipeline Expert

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistDescription:We are looking for a skilled Data Architect Specialist to craft and maintain robust data pipelines, utilizing Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. This role involves building and optimizing data pipelines to facilitate seamless data flow across systems and...

  • Data Architect

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Solutions ArchitectWe are seeking a highly skilled and experienced Senior Data Solutions Architect to design, build, and maintain robust data pipelines using Azure cloud services.The ideal candidate will have 9-12 years of experience in designing, building, and maintaining scalable data solutions for large-scale organizations.Key...

  • Senior Data Pipeline Specialist

    2 hours ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team. This role involves crafting and maintaining robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data.The ideal candidate will have expertise in building and optimizing data pipelines to facilitate seamless data flow across systems...

  • Senior Data Architect Position

    5 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Architect Position">  We are seeking a highly skilled Data Architect to lead the development of our data engineering practices. The ideal candidate will have extensive experience in designing and implementing large-scale data architectures, including data warehousing, ETL/ELT processes, and data governance."> Key Responsibilities:">">Migrate...

  • Senior Data Architect

    5 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data ArchitectAre you a data expert looking to spearhead the evolution of our digital landscape? We are seeking a highly skilled Senior Data Architect to lead our data architecture efforts and drive innovation.Key Responsibilities:Design and implement data architectures that enable efficient data transfer and processing.Collaborate with...

  • Senior Data Solutions Architect

    2 days ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a Senior Data Solutions Architect, you will play a pivotal role in designing and implementing data solutions on the cloud.Key Responsibilities:Data Pipeline DevelopmentCollaborate with data scientists and analysts to support informed decision-makingMaintain strong expertise in ETL processes and data integrationEssential Skills:Proficiency in Azure Data...

  • Lead Data Architect

    5 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the design, development, and maintenance of our data pipelines and software systems.Responsibilities:Develop scalable data architectures and oversee their implementationCollaborate with cross-functional teams to identify and understand data requirementsImplement ETL processes...