Senior Data Engineer

1 week ago

Kozhikode, India Vista Applied Solutions Group Inc Full time

Job Summary:

Our client is seeking a Senior Data Engineer to lead the modernization of our enterprise data platform using Microsoft Fabric, with a focus on building an AI-ready foundation. This role is key to replacing legacy ERP systems, retiring SSIS, and implementing scalable, code-driven data pipelines to support advanced analytics and future AI workloads. Our legal client is transitioning from SAP to Aderant and is currently in the first round of conversion, prioritizing 20–25 urgent integrations. The next phase will involve migrating 200–300 SAP-based reports, all within a Microsoft-based cloud environment.


Responsibilities:

  • Architect and implement ETL pipelines using Microsoft Fabric (Dataflows Gen2, Pipelines, Notebooks) to support both operational reporting and AI model training.
  • Migrate legacy SSIS packages to code-first, cloud-native ETL solutions.
  • Design and optimize SQL Databases and Data Warehouses for structured analytics and feature engineering.
  • Build and manage streaming data solutions and real-time dataflows to support predictive analytics and AI inference pipelines.
  • Enable seamless data integration for ERP system replacement, ensuring clean, governed, and accessible data for downstream AI use cases.
  • Collaborate with data scientists and AI engineers to ensure the platform supports model development, feature stores, and data versioning.
  • Implement best practices for data lineage, metadata management, and data quality to support explainable AI and compliance.


Experience:

  • Hands-on experience with Microsoft Fabric, including Dataflows Gen2, Pipelines, and Notebooks.
  • Strong proficiency in SQL, ETL development, and data modeling for analytics and AI.
  • Experience with streaming architectures and real-time data processing.
  • Proven ability to migrate from SSIS to modern, code-based ETL frameworks.
  • Familiarity with data lake house architecture, feature engineering, and AI data prep workflows.
  • Understanding of AI/ML lifecycle needs, including data ingestion, transformation, and versioning.


Nice to Have:

  • Experience supporting AI/ML teams with data pipelines and infrastructure.
  • Familiarity with Azure Synapse, Power BI, and ML Ops tools.
  • Exposure to feature stores, vector databases, or embedding pipelines.
  • Knowledge of DevOps for data engineering, including CI/CD and infrastructure-as-code

  • Senior AWS Data Engineer

    4 weeks ago

    Kozhikode, Kerala, India CYAN360 Full time

    Position: Senior AWS Data EngineerLocation: RemoteSalary: OpenWork Timings: 2:30 PM to 11:30 PM IST*** Need someone who can join immediately or in 15 days***Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Implement data processing...

  • Senior Finance Data Architect

    2 weeks ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 12,00,000

    About Our SolutionsWe are a boutique AI and data engineering firm that empowers Fortune 1000 companies through AI-powered decision intelligence.Key Responsibilities:You will act as a key member of our consulting team, helping clients re-invent their corporate finance function by leveraging advanced analytics. You will work closely with senior stakeholders to...

  • Senior Machine Learning Engineer

    3 weeks ago

    Kozhikode, Kerala, India CustoBiz Full time

    Job Title: MLE (FAS MLE – TS03)- Senior Machine Learning EngineerLocation: HyderabadExperience Required: 7+ YearsRelevant Exp Required: 7+ YearsAvailability: Immediate joiners preferredJob Description:We are seeking an experienced Senior Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing...

  • Data Engineer

    3 weeks ago

    Kozhikode, Kerala, India Logic Pursuits Full time

    Job Title: Data Engineer (Snowflake + dbt)Location: Hyderabad, IndiaJob Type: Full-timeJob Description:We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt, and able to...

  • Data Engineer

    3 weeks ago

    Kozhikode, Kerala, India Talogy Full time

    Data EngineerThis opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines. This role requires an analytical thinker who pays significant attention to detail in their work.We are looking for an experienced data engineer with extensive...

  • Senior Civil Engineer

    6 days ago

    Kozhikode, Kerala, India Era Creatio Developers LLP Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Company DescriptionEstablished in 2018, Era Creatio Developers LLP is a top player in the Builders & Developers category in Kerala. Based in Kuttikattor, Era Creatio Developers is also a leading home designers and architectural company. We provide the best Kerala home designs by analyzing client requirements, budget, and landscape. Our focus is on delivering...

  • Quality Engineer

    6 days ago

    Kozhikode, India Tiger Analytics Full time

    As a Quality Engineer - Data, you will be involved in every phase of SDLC and focus on Functional testability, Automation and Performance of the software. More specifically, you will work on:Selecting and integrating Data tools and frameworks required to provide requested capabilities.Technical guidance for software engineers engaged in the design, coding,...

  • Data Engineer

    2 weeks ago

    Kozhikode, India Innodata Inc. Full time

    We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key ResponsibilitiesDesign, implement, and...

  • Senior AI Engineer

    3 weeks ago

    Kozhikode, Kerala, India BugRaid AI Full time

    Location: Hyderabad/Bangalore/SingaporeAbout BugRaid.AIIncidents are the silent killers of modern enterprises. Every minute of downtime means lost revenue, lost trust, and engineers under fire.BugRaid.AI is building the world's first enterprise-ready incident copilot — intelligent, agentic systems that can detect, diagnose, and resolve complex production...

  • IT Data Platform Engineer

    3 weeks ago

    Kozhikode, Kerala, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...