Senior Data Engineer

4 weeks ago

Erode, India Vista Applied Solutions Group Inc Full time

Job Summary:

Our client is seeking a Senior Data Engineer to lead the modernization of our enterprise data platform using Microsoft Fabric, with a focus on building an AI-ready foundation. This role is key to replacing legacy ERP systems, retiring SSIS, and implementing scalable, code-driven data pipelines to support advanced analytics and future AI workloads. Our legal client is transitioning from SAP to Aderant and is currently in the first round of conversion, prioritizing 20–25 urgent integrations. The next phase will involve migrating 200–300 SAP-based reports, all within a Microsoft-based cloud environment.


Responsibilities:

  • Architect and implement ETL pipelines using Microsoft Fabric (Dataflows Gen2, Pipelines, Notebooks) to support both operational reporting and AI model training.
  • Migrate legacy SSIS packages to code-first, cloud-native ETL solutions.
  • Design and optimize SQL Databases and Data Warehouses for structured analytics and feature engineering.
  • Build and manage streaming data solutions and real-time dataflows to support predictive analytics and AI inference pipelines.
  • Enable seamless data integration for ERP system replacement, ensuring clean, governed, and accessible data for downstream AI use cases.
  • Collaborate with data scientists and AI engineers to ensure the platform supports model development, feature stores, and data versioning.
  • Implement best practices for data lineage, metadata management, and data quality to support explainable AI and compliance.


Experience:

  • Hands-on experience with Microsoft Fabric, including Dataflows Gen2, Pipelines, and Notebooks.
  • Strong proficiency in SQL, ETL development, and data modeling for analytics and AI.
  • Experience with streaming architectures and real-time data processing.
  • Proven ability to migrate from SSIS to modern, code-based ETL frameworks.
  • Familiarity with data lake house architecture, feature engineering, and AI data prep workflows.
  • Understanding of AI/ML lifecycle needs, including data ingestion, transformation, and versioning.


Nice to Have:

  • Experience supporting AI/ML teams with data pipelines and infrastructure.
  • Familiarity with Azure Synapse, Power BI, and ML Ops tools.
  • Exposure to feature stores, vector databases, or embedding pipelines.
  • Knowledge of DevOps for data engineering, including CI/CD and infrastructure-as-code

  • Data engineer

    4 days ago

    Erode, India RevX Full time

    Data Engineer About Rev XRev X helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue. We're all about taking your app businesses to a new growth level. We rely on data science, innovative technology, and AI, and a skilled team, to create and deliver seamless ad experiences to delight your app users....

  • Data Engineer

    5 days ago

    Erode, India Forage AI Full time

    Experience Level: Data Engineer- 3- 7 years of relevant experience in data engineering.About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly...

  • Data Engineer

    4 weeks ago

    Erode, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Senior frontend engineer

    5 days ago

    Erode, India HARCEPT IT Services Pvt. Ltd. Full time

    We’re seeking a Senior Frontend Engineer to take ownership of our customer-facing portal and drive the modernization of our frontend architecture. This role offers significant influence: you’ll evaluate frameworks, set the strategy, and deliver intuitive, scalable interfaces that security teams depend on.This position calls for a strong grasp of both...

  • Data Management Engineer

    10 hours ago

    Erode, Tamil Nadu, India FoundersClick Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionFoundersClick (FC) is an "ecosystem as a service" platform hosting a global community of Entrepreneurs, Businesses, Professionals, Domain experts, Investors, and Non-Profits. FC supports mid-size to small and early-stage businesses and their stakeholders to Connect, Promote, and Effect results through a tiered (Basic & Premium) service...

  • Senior DevOps/Platform Engineer

    5 days ago

    Erode, India nineDots.io Full time

    Senior DevOps/Platform Engineer (Contract) – FinTechHelp build and scale backend infrastructure for a financial services platform in the Middle East. You’ll join a team working to strengthen AWS architecture, automate deployments, and raise the bar on platform reliability and security. This is hands-on work with real impact, the product is live,...

  • Senior ai engineer

    1 day ago

    Erode, India Nous Infosystems Full time

    Senior AI DeveloperAbout NousNous Infosystems is a CMMI® Level 5 and ISO 9001:2000 certified global information Technology Company with expertise in providing quality software solutions and IT-enabled support services to a wide range of industries. Nous was incorporated in 1996 with the mission of providing the highest quality software development services...

  • Data Engineer

    4 weeks ago

    Erode, India Kumaran Systems Full time

    Job Description:Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Experience with Orchestration tools.Strong analytical and problem-solving skills.

  • ▷ Urgent: Data Engineer

    5 days ago

    Erode, India Delta Air Lines Full time

    About Delta Tech Hub: Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Enterprise Data

    5 days ago

    Erode, India Nexora Tech Solutions Full time

    Join Nexora Tech as a Strategic Partner – Enterprise Data & Analytics ArchitectAbout Nexora Tech:Nexora Tech, founded by Aparna Kumar (Former CIO – SBI, HSBC, and leadership positions at HDFC Bank, Capgemini, Oracle and Citi), is a boutique technology advisory firm that partners with CXOs and Boards to deliver digital transformation, AI/ML strategy, IT...