Chief Data Pipeline Architect

1 week ago


salem, India beBeeDataEngineer Full time

Job Title:Cloud Data EngineerAbout the RoleThis position involves designing, developing and maintaining scalable ETL pipelines using cloud-native tools. The ideal candidate will have expertise in architecting and implementing data lakes and warehouses on cloud platforms.Key ResponsibilitiesDesign and develop efficient ETL processes using cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory and GCP Dataflow.Architect and implement data lakes and warehouses on cloud platforms including AWS, Azure and GCP.Develop and optimize data ingestion, transformation and loading processes using Databricks, Snowflake, Redshift and BigQuery.Implement ETL processes using Informatica and SAP Data Intelligence.Develop and optimize data processing jobs using Spark Scala.Data Integration and ManagementIntegrate various data sources including relational databases, APIs and unstructured data into the data lake.Ensure data quality and integrity through rigorous testing and validation.Perform data extraction from SAP or ERP systems when necessary.Performance OptimizationMonitor and optimize the performance of data pipelines and ETL processes.Implement best practices for data management including data governance, security and compliance.Collaboration and CommunicationWork closely with data scientists, analysts and other stakeholders to understand data requirements and deliver solutions.Collaborate with cross-functional teams to design and implement data solutions that meet business needs.Documentation and MaintenanceDocument technical solutions, processes and workflows.Maintain and troubleshoot existing ETL pipelines and data integrations.



  • salem, India beBeeData Full time

    Enterprise Data Architect Role OverviewWe seek a senior data architect to design and implement robust, scalable, and high-performance data architectures that drive our enterprise data initiatives.The ideal candidate should bring expertise in SQL, ETL/ELT, cloud data platforms, Azure, and a deep understanding of data warehousing concepts, medallion...


  • salem, India beBeeDataEngineer Full time

    Lead Data EngineerWe are seeking talented and motivated data professionals to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.As a lead data engineer, you will play a critical role in designing, implementing, and maintaining scalable data infrastructure to support business initiatives. You will...


  • salem, India beBeeData Full time

    Unlock Data Engineering ExcellenceWe are seeking a skilled Data Engineer to lead the development and maintenance of ETL pipelines using Python and Airflow.ETL Pipeline Development: Design and implement scalable data pipelines leveraging Python and Airflow, ensuring seamless integration with SQL, GCP BigQuery, and cloud-based data workflows.Cloud-Based Data...


  • salem, India beBeeDataEngineer Full time

    Job Title: Senior Data EngineerThis is a freelance role for an experienced Senior Data Engineer to architect, build, and own data pipelines that power large language model (LLM) development.The ideal candidate will be the team's expert on data ingestion, processing, and quality for all AI training.The primary mission is to design, develop, and maintain...

  • Chief Data Architect

    2 weeks ago


    salem, India beBeeDataEngineering Full time

    Job OpportunityWe are seeking a Data Engineer to join our team and drive business growth through data-driven insights.This role requires strong technical skills in data modeling, ETL frameworks, and cloud-based data platforms.The ideal candidate will have experience with PySpark, AWS Glue, Snowflake, and API integration.Design and develop scalable ETL/ELT...


  • salem, India beBeeDataEngineer Full time

    Job Title: Data EngineerWe are seeking highly skilled professionals to build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initiatives.Design and develop scalable, reliable data pipelines using advanced data engineering tools and frameworks.Develop ETL/ELT workflows for structured,...


  • salem, India beBeeDataScientist Full time

    Our mission is to build the future of finance, and we're looking for talented individuals who share our passion.We want someone who is driven by innovation and has a deep understanding of crypto and blockchain technology.Ambitious professionals will thrive in our fast-paced environment, where teamwork and collaboration are key.The Data Platform team plays a...


  • salem, India beBeeEngineer Full time

    Job DescriptionThreatXIntel, a forward-thinking cybersecurity firm, is driven by the mission to safeguard businesses from cyber threats. We specialize in cloud security, DevSecOps, and vulnerability assessment.We are seeking an experienced Freelance Data Engineer with expertise in Apache NiFi and Google Cloud Platform (GCP) to design and implement real-time...


  • salem, India beBeeData Full time

    Chief Data ArchitectWe are looking for a highly skilled Chief Data Architect to lead the development of robust, scalable data platforms.The ideal candidate will have experience in designing and implementing end-to-end data architectures, building high-performing solutions on leading cloud platforms, and creating sophisticated data models to integrate...


  • salem, India beBeeDataEngineering Full time

    Data Engineer PositionWe are seeking an accomplished Data Engineer to spearhead innovation within our microservices architecture, focusing on data engineering and back-end systems.This role requires a seasoned professional with expertise in designing, developing, optimizing, and maintaining data pipelines and back-end services. The successful candidate will...