Data Engineer

18 hours ago

Kozhikode, India TechFrolic Full time

Data Engineer Design and develop ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines to process and curate data sets using technologies such as SQL Server, Azure Data Factory, and Databricks ensuring data quality, accuracy, and consistency. Data Pipelines: Design, build, and maintain robust, large-scale, fault-tolerant and automated data pipelines for batch and streaming data ingestion of data and processing and storing large datasets. Orchestration: Utilize workflow orchestration tools to automate data pipeline execution and dependency management. Develop and maintain data infrastructure, including data warehouses, data lakes, and data marts. Data Architecture and Modeling: Design and implement robust data models and architectures that align with business requirements and support efficient data processing, analysis, and reporting. Monitoring and Alerting: Integrate monitoring and alerting mechanisms to track pipeline health, identify performance bottlenecks, and proactively address issues. Improve platform resilience, data quality, and observability with advanced monitoring, alerting, and automated data governance. Build and manage streaming data architectures using tools such as Apache Kafka, and Spark/Flink Streaming. Deep knowledge of modern lake-house/table formats: Apache Iceberg, Delta Lake, or Apache Hudi. Enforce standards and automation across the entire data lifecycle, including schema evolution, dataset migration, and deprecation strategies. Experience managing data lakes, catalogs, and metadata governance in large-scale environments. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide data solutions. 

  • Data Engineer

    2 weeks ago

    Kozhikode, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....

  • Data Engineer

    2 weeks ago

    Kozhikode, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....

  • Data Engineering Specialist

    2 weeks ago

    kozhikode, India beBeeDataEngineering Full time

    Job Title:Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team.About the RoleDesign and implement end-to-end data solutions using Microsoft's data platforms, including Fabric, Azure Synapse Analytics, Databricks, and Power BI.Bulk Responsibilities include designing scalable data processing models, endpoint...

  • Data Engineering Professional

    4 days ago

    kozhikode, India beBeeDataSpecialist Full time

    Data Specialist Role Evaluate technical proficiency in data engineering, analytics, and cloud platforms through comprehensive assessments and actionable feedback.Key Responsibilities:Develop quality audit frameworks for training programs.Conduct structured technical interviews to evaluate SQL skills, data engineering principles, Databricks, Snowflake, and...

  • Data Engineering Leader

    1 week ago

    kozhikode, India beBeeDataEngineering Full time

    Job Title: Data Engineering LeaderWe are seeking a seasoned data engineering professional to lead our data architecture and technology initiatives.Oversee the design, development, and deployment of large-scale data pipelines and cloud-based solutionsMentor junior engineers in designing efficient and reusable Python scripts for data processingDevelop complex...

  • Cloud Data Engineer

    1 week ago

    kozhikode, India beBeeCloudDataEngineer Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled and experienced Cloud Data Engineer to join our team.This is an excellent opportunity for a data professional to leverage their expertise in cloud-based technologies, specifically GCP, to drive business growth and innovation. As a Cloud Data Engineer, you will be responsible for designing,...

  • Sustainability Data Engineer

    2 weeks ago

    kozhikode, India beBeeData Full time

    Job Opportunity: Sustainability Data Engineer Overview:The company is seeking a skilled data engineer to support its enterprise-wide sustainability initiative. The successful candidate will design and implement data pipelines and models to analyze product-level carbon footprint, enabling the organization to make informed decisions and reduce its...

  • Data Engineering Leader

    2 weeks ago

    kozhikode, India beBeeDataEngineering Full time

    Data Engineering Manager - Web Crawling is a pivotal role that demands exceptional leadership and technical expertise.Job Description:We seek an experienced Data Engineering Manager to lead our web crawling and pipeline architecture initiatives. Your primary focus will be on designing, building, and optimizing scalable data pipelines that can handle...

  • Azure data engineer

    7 days ago

    Kozhikode, India LogFix SCM Solutions Pvt Ltd Full time

    Position: Azure Data EngineerExperience: 5+ YearsLocation: RemoteEngagement: ContractJob DescriptionWe are seeking an experienced Azure Data Engineer to design and implement a scalable, Azure-based Central Asset Registry that integrates data from 120+ SQL Server e-Quip databases and 130+ CSV-based hospital systems .The engineer will be responsible...

  • Data Architect and Engineer

    2 weeks ago

    kozhikode, India beBeeData Full time

    About the RoleWe are seeking a highly skilled data professional to join our team as a Data Architect and Engineer. The ideal candidate will have extensive experience in designing, developing, and maintaining robust data pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.You will be responsible for leading the development of scalable...