Expert Data Pipeline Architect

7 days ago

agra, India beBeeDataEngineer Full time

As a Freelance Data Engineer, you will play a pivotal role in shaping the data infrastructure of our organization.We are seeking an expert with extensive experience in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines. Data Ingestion Expertise: Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data.Ecosystem Integration: Integrate data pipelines with Google Cloud Platform (GCP) services, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer/Airflow.Data Delivery: Ensure low-latency, high-throughput data delivery to downstream systems for analytics and reporting.SQL Query Optimization: Develop and optimize SQL queries for BigQuery and relational databases to ensure data transformation and analysis.Python Scripting: Write Python scripts for data transformation, automation, and custom NiFi processors when required.Error Handling and Quality Control: Implement data quality, validation, and error-handling mechanisms within ingestion pipelines to ensure reliability and accuracy.Collaboration: Collaborate with data analysts, data scientists, and platform engineers to deliver consistent and high-quality datasets.Data Security and Governance: Ensure data security, governance, and compliance with GCP IAM, VPC Service Controls, and encryption standards.Pipeline Performance Monitoring: Monitor, troubleshoot, and optimize data pipeline performance to ensure smooth operations.Documentation: Document data flows, architecture, and best practices to maintain consistency across teams.The ideal candidate will possess strong problem-solving skills, excellent communication abilities, and a keen eye for detail.

  • Senior Data Pipeline Architect

    1 week ago

    agra, India beBeeData Full time

    Advanced Data Scientist Role SummaryWe are looking for an experienced data professional to lead the development of cutting-edge data pipelines that fuel our AI and machine learning capabilities.The ideal candidate will be responsible for architecting, building, and maintaining robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and...

  • Data Pipeline Architect

    1 week ago

    agra, India beBeePlatform Full time

    Platform Engineer PositionWe are seeking a skilled and dedicated platform engineer to join our development and support center. This position offers an exciting opportunity to contribute to the growth of our organization.Develop scalable data pipelines and platform services using Python, Apache Spark, and Databricks.Design and manage notebook-based workflows...

  • Chief Data Pipeline Architect

    2 days ago

    agra, India beBeeDataEngineer Full time

    Job Opportunity: Senior Data EngineerElevate data management by designing, building, and optimizing high-performance data pipelines and systems.Develop scalable and reliable Extract, Transform, Load/Extract, Load, Transform (ETL/ELT) pipelines to ensure seamless data flow.Construct robust data models, marts, and warehouses to support business analytics and...

  • Chief Data Solutions Architect

    13 hours ago

    agra, India beBeeDataArchitect Full time

    Solution and Data Architect - Azure ApplicationsJob Summary:We are seeking a seasoned Solution and Data Architect with expertise in designing secure, scalable, and robust data architectures on Microsoft Azure. As a key member of our team, you will be responsible for crafting end-to-end data solutions that support mission-critical public-facing transactional...

  • Data Expert

    19 hours ago

    agra, India beBeeData Full time

    Cloud Data EngineerAbout our teamWe are a dynamic company focused on delivering superior, highly automated Managed Services to Enterprise customers.We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP.The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka,...

  • Enterprise Data Architect

    7 days ago

    agra, India beBeeData Full time

    Senior Data Architect RoleWe are seeking an experienced senior data architect to design and implement robust, scalable, and high-performance data architectures that support enterprise data initiatives.Lead the planning, execution, and delivery of multiple data projects ensuring alignment with business goals, timelines, and quality standards.Architect...

  • Data Architect Leader

    1 week ago

    agra, India beBeeData Full time

    Strategic Data ArchitectEstablish a leading edge in data and analytics by partnering with top industry leaders.This is an opportunity to shape the direction of your career as a Senior Data Architect, focusing on Banking, Financial Services, and Insurance (BFSI) sector.The role requires expertise in defining complex customer data strategies, elevating our...

  • Senior Data Architect

    7 days ago

    agra, India beBeeData Full time

    We are seeking a Senior Data Architect to lead the design and delivery of enterprise data analytics solutions. The ideal candidate will own the architecture for ETL/ELT, data warehousing, analytics pipelines, data governance, and integrations with LMS/EdTech systems.The successful candidate will define end-to-end data architectures and roadmaps for...

  • Senior Data Pipeline Specialist

    1 week ago

    agra, India beBeeData Full time

    Data Engineering RoleOverview:We are seeking a seasoned Data Engineer to spearhead the design, development, and optimization of scalable data pipelines using Python. The ideal candidate will have hands-on experience with ETL/ELT pipeline development, data extraction, transformation, and loading into data lakes/warehouses, workflow orchestration, and...

  • Distinguished Data Solutions Architect

    9 hours ago

    agra, India beBeeData Full time

    Senior Data Engineer Job DescriptionWe are seeking a seasoned Data Architect to lead the design, build and optimization of large-scale data pipelines and Delta Lake environments.Responsibilities include:Developing and maintaining complex ETL processes utilizing PySpark and DatabricksManaging and optimizing the performance of Delta Lake...