Data Engineer

22 hours ago

Kozhikode, India TechFrolic Full time

Data Engineer Design and develop ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines to process and curate data sets using technologies such as SQL Server, Azure Data Factory, and Databricks ensuring data quality, accuracy, and consistency. Data Pipelines: Design, build, and maintain robust, large-scale, fault-tolerant and automated data pipelines for batch and streaming data ingestion of data and processing and storing large datasets. Orchestration: Utilize workflow orchestration tools to automate data pipeline execution and dependency management. Develop and maintain data infrastructure, including data warehouses, data lakes, and data marts. Data Architecture and Modeling: Design and implement robust data models and architectures that align with business requirements and support efficient data processing, analysis, and reporting. Monitoring and Alerting: Integrate monitoring and alerting mechanisms to track pipeline health, identify performance bottlenecks, and proactively address issues. Improve platform resilience, data quality, and observability with advanced monitoring, alerting, and automated data governance. Build and manage streaming data architectures using tools such as Apache Kafka, and Spark/Flink Streaming. Deep knowledge of modern lake-house/table formats: Apache Iceberg, Delta Lake, or Apache Hudi. Enforce standards and automation across the entire data lifecycle, including schema evolution, dataset migration, and deprecation strategies. Experience managing data lakes, catalogs, and metadata governance in large-scale environments. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide data solutions. 

  • Data Engineer

    2 weeks ago

    Kozhikode, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....

  • Data Engineer

    2 weeks ago

    Kozhikode, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....

  • Data Engineering Specialist

    2 weeks ago

    kozhikode, India beBeeDataEngineering Full time

    Job Title:Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team.About the RoleDesign and implement end-to-end data solutions using Microsoft's data platforms, including Fabric, Azure Synapse Analytics, Databricks, and Power BI.Bulk Responsibilities include designing scalable data processing models, endpoint...

  • Data Engineering Professional

    4 days ago

    kozhikode, India beBeeDataSpecialist Full time

    Data Specialist Role Evaluate technical proficiency in data engineering, analytics, and cloud platforms through comprehensive assessments and actionable feedback.Key Responsibilities:Develop quality audit frameworks for training programs.Conduct structured technical interviews to evaluate SQL skills, data engineering principles, Databricks, Snowflake, and...

  • Data Engineering Leader

    1 week ago

    kozhikode, India beBeeDataEngineering Full time

    Job Title: Data Engineering LeaderWe are seeking a seasoned data engineering professional to lead our data architecture and technology initiatives.Oversee the design, development, and deployment of large-scale data pipelines and cloud-based solutionsMentor junior engineers in designing efficient and reusable Python scripts for data processingDevelop complex...

  • Cloud Data Engineer

    1 week ago

    kozhikode, India beBeeCloudDataEngineer Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled and experienced Cloud Data Engineer to join our team.This is an excellent opportunity for a data professional to leverage their expertise in cloud-based technologies, specifically GCP, to drive business growth and innovation. As a Cloud Data Engineer, you will be responsible for designing,...

  • Azure data engineer

    7 days ago

    Kozhikode, India LogFix SCM Solutions Pvt Ltd Full time

    Position: Azure Data EngineerExperience: 5+ YearsLocation: RemoteEngagement: ContractJob DescriptionWe are seeking an experienced Azure Data Engineer to design and implement a scalable, Azure-based Central Asset Registry that integrates data from 120+ SQL Server e-Quip databases and 130+ CSV-based hospital systems .The engineer will be responsible...

  • Ai Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    AI Data Engineer (AWS/Snowflake) Remote (India-Based) Overview Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through intelligent automation. They recently secured multiple new engagements and is expanding rapidly. We’re seeking a strong technical AI...

  • Cloud Data Engineer

    1 week ago

    kozhikode, India Lemongrass Full time

    About Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...

  • Senior Data Engineer

    3 weeks ago

    Kozhikode, India Primesoft Inc Full time

    Hiring for Data Engineer!!!Company: Primesoft Enterprise IT Services Pvt. Ltd.Experience: 7+ yearsLocation: Chennai (Work From Office)Notice Period: Immediate to 30days onlyAbout the role–-As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at...