Senior Data Engineer

7 days ago

Erode, India Vista Applied Solutions Group Inc Full time

Job Summary:

Our client is seeking a Senior Data Engineer to lead the modernization of our enterprise data platform using Microsoft Fabric, with a focus on building an AI-ready foundation. This role is key to replacing legacy ERP systems, retiring SSIS, and implementing scalable, code-driven data pipelines to support advanced analytics and future AI workloads. Our legal client is transitioning from SAP to Aderant and is currently in the first round of conversion, prioritizing 20–25 urgent integrations. The next phase will involve migrating 200–300 SAP-based reports, all within a Microsoft-based cloud environment.


Responsibilities:

  • Architect and implement ETL pipelines using Microsoft Fabric (Dataflows Gen2, Pipelines, Notebooks) to support both operational reporting and AI model training.
  • Migrate legacy SSIS packages to code-first, cloud-native ETL solutions.
  • Design and optimize SQL Databases and Data Warehouses for structured analytics and feature engineering.
  • Build and manage streaming data solutions and real-time dataflows to support predictive analytics and AI inference pipelines.
  • Enable seamless data integration for ERP system replacement, ensuring clean, governed, and accessible data for downstream AI use cases.
  • Collaborate with data scientists and AI engineers to ensure the platform supports model development, feature stores, and data versioning.
  • Implement best practices for data lineage, metadata management, and data quality to support explainable AI and compliance.


Experience:

  • Hands-on experience with Microsoft Fabric, including Dataflows Gen2, Pipelines, and Notebooks.
  • Strong proficiency in SQL, ETL development, and data modeling for analytics and AI.
  • Experience with streaming architectures and real-time data processing.
  • Proven ability to migrate from SSIS to modern, code-based ETL frameworks.
  • Familiarity with data lake house architecture, feature engineering, and AI data prep workflows.
  • Understanding of AI/ML lifecycle needs, including data ingestion, transformation, and versioning.


Nice to Have:

  • Experience supporting AI/ML teams with data pipelines and infrastructure.
  • Familiarity with Azure Synapse, Power BI, and ML Ops tools.
  • Exposure to feature stores, vector databases, or embedding pipelines.
  • Knowledge of DevOps for data engineering, including CI/CD and infrastructure-as-code

  • Senior Data Engineer

    4 weeks ago

    Erode, Tamil Nadu, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Senior Data Engineer

    4 weeks ago

    Erode, Tamil Nadu, India Right Move Full time

    Greetings From Right Move Please see below the Job Description. If you find this interesting and in line with your career aspirations, kindly revert to this email with your confirmation & updated CV.Experience – 4+ Years.Role –Senior Data Engineer .Job Type - Permanent.Mode – Work from Office.Company Location – Pune .Only IIT Candidates Skill Set –...

  • Senior Data Engineer with GCP, ETL

    3 weeks ago

    Erode, Tamil Nadu, India iitjobs, Inc. Full time

    GreetingsRole : Senior Data Engineer with GCP, ETLLocation- 100 % RemoteExp Range- 4+ YrsNotice Period- Immediate Joiners only.Duration- 4 months ContractTime: 11 am to 8 pm ISTMust have skills:1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best...

  • Data Engineer

    4 weeks ago

    Erode, Tamil Nadu, India Firstsource Full time

    Key Skills and Responsibilities: We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Senior Data Engineer

    2 weeks ago

    Erode, India NovintiX Full time

    NovintiX is seeking a highly skilled and experienced Data Engineers (x4) to join our growing data team focused on delivering impactful solutions in the healthcare and medical technology space. If you’re passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you!🔍 𝗞𝗲𝘆

  • Data Engineer

    3 weeks ago

    Erode, Tamil Nadu, India AgileEngine Full time

    Senior Data Engineer (AI/ML | Python | GCP ) - WFHTHIS IS FULLY REMOTE WORKING OPPORTUNITY.WE NEED IMMEDIATE JOINERS or someone who can join in less than 1 month.If you are interested and fulfill the below mentioned criteria then please share below information.1. EMAIL ID2. YEARS OF RELEVANT EXPERIENCE.3. UPDATED RESUME.4. CCTC/ECTC5. Notice period *Key...

  • Data Engineer

    5 days ago

    Erode, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    4 weeks ago

    Erode, Tamil Nadu, India Innodata Inc. Full time

    We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key ResponsibilitiesDesign, implement, and...

  • Data Management Engineer

    2 weeks ago

    Erode, India FoundersClick Inc. Full time

    Company Description FoundersClick (FC) is an "ecosystem as a service" platform hosting a global community of Entrepreneurs, Businesses, Professionals, Domain experts, Investors, and Non-Profits. FC supports mid-size to small and early-stage businesses and their stakeholders to Connect, Promote, and Effect results through a tiered (Basic & Premium) service...

  • Data Management Engineer

    20 hours ago

    Erode, Tamil Nadu, India FoundersClick Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionFoundersClick (FC) is an "ecosystem as a service" platform hosting a global community of Entrepreneurs, Businesses, Professionals, Domain experts, Investors, and Non-Profits. FC supports mid-size to small and early-stage businesses and their stakeholders to Connect, Promote, and Effect results through a tiered (Basic & Premium) service...