ai - Data Engineer

3 days ago

Chandigarh, Chandigarh, India Sprouts Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Job Summary
We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and processing systems that power our modern data platform. The ideal candidate will have hands-on expertise in distributed data processing, data lake/lakehouse systems, and workflow orchestration using modern tools such as Spark, PySpark, Apache Iceberg, Apache Hudi, and Apache Airflow.

This role will be central in enabling reliable data ingestion, transformation, and governance-ready pipelines to support analytics, AI, and operational use cases across the organization.

Key Responsibilities

  • Build and maintain scalable ETL/ELT pipelines for batch and streaming data using PySpark and Airflow.
  • Develop and optimize data ingestion workflows from multiple structured and unstructured data sources.
  • Implement data lake and lakehouse solutions using Spark with Apache Iceberg, Hudi, or Delta Lake.
  • Ensure data quality, reliability, and integrity through validation, profiling, and monitoring frameworks and automations using AI.
  • Support database migration efforts and cross-system data reconciliation.
  • Collaborate with data scientists, analysts, and platform engineers to enable analytics and ML use cases.
  • Contribute to data governance practices, including schema evolution, versioned data catalogs (e.g., Nessie), and metadata management.
  • Troubleshoot and optimize data jobs for performance and cost efficiency.

Required Skills & Qualifications

  • 6- 10 years of experience in data engineering with strong exposure to big data platforms.
  • Hands-on experience with PySpark for distributed data processing.
  • Solid understanding of modern table formats (Apache Iceberg, Hudi, Delta) and versioned data catalogs.
  • Experience with Apache Airflow (or equivalent) for workflow orchestration.
  • Strong SQL skills with experience in data modeling and performance tuning.
  • Exposure to cloud data platforms (AWS, GCP, Azure) and managed services.
  • Experience with handling large-scale datasets (TBs-100s of TBs).
  • Understanding of DevOps practices for CI/CD of data pipelines.

Nice To Have

  • Experience in streaming data frameworks (Kafka, Flink, Spark Streaming).
  • Knowledge of Sales, Marketing, or CRM domains (Accounts, Contacts data).
  • Exposure to Elasticsearch, PostgreSQL, or Vector databases.

Why Join Us

  • Work on cutting-edge open-source data technologies at scale
  • Grow your expertise in lakehouse, streaming, and AI-ready data architectures.
  • Contribute to building a governance-ready, modern data platform from the ground up using AI
  • Collaborate in a fast-paced, innovation-driven culture.

)

  • AI Creator

    1 day ago

    Chandigarh, Chandigarh, India Athink AI Studios Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionWe suggest you enter details here.Role DescriptionThis is a full-time on-site role for an AI Creator located in Chandigarh, India. The AI Creator will be responsible for developing, refining, and implementing artificial intelligence algorithms and systems. This includes conducting research, designing experiments, analyzing data, creating...

  • AI/ML Engineer

    2 weeks ago

    Chandigarh, Chandigarh, India TechFacto Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Job Summary:We are seeking a highly skilled AI/ML professional with 5+ years of experience in designing, developing, and deploying advanced machine learning and artificial intelligence solutions. The ideal candidate will have strong expertise in ML algorithms, deep learning frameworks, data engineering, and model deployment, with proven experience in...

  • AI/ML & Gen AI Engineer

    1 week ago

    Chandigarh, Chandigarh, India Passionate Hr Group Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    AI/ML & GenAI EngineerJob DescriptionLocation: On-site ( IT Park Chandigarh)Experience: 5+ yearsRole Type: Full-TimeJob SummaryWe are looking for an experienced and innovative AI/ML Engineer to join our team. The ideal candidate will have over 5 years of hands-on experience in machine learning, computer vision, natural language processing, and AI system...

  • Forensic AI Data Intern in Chandigarh

    3 days ago

    Chandigarh, Chandigarh, India PaladinAi Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    About UsWe are a leading technology firm based in the heart of Chandigarh, specializing inbig data analytics and AI-driven solutionsfor law enforcement and defense agencies. Our mission is to leverage cutting-edge technology to enhance security and intelligence operations, providing our partners with the tools they need to solve complex challenges.The...

  • Ai Ml Engineer

    1 week ago

    Chandigarh, Chandigarh, India Matrix Marketers Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a proactive and detail-oriented AI/ML Engineer to join our ITServices AI/ML team. In this role, you will engage directly with clients tounderstand their IT needs, gather requirements.

  • Pogram manager

    4 weeks ago

    Chandigarh, Chandigarh, India Scry AI Full time

    Job Title: Program ManagerLocation: India, RemoteDepartment: Product & DeliveryAbout Scry AIScry AI is a leading provider of AI-powered enterprise solutions, delivering transformational business outcomes through products like Collatio (automation of complex document processing across financial, legal, and operational domains), Auriga (Enterprise Knowledge...

  • Pogram Manager

    4 weeks ago

    Chandigarh, Chandigarh, India Scry AI Full time

    Job Title: Program Manager Location: India, Remote Department: Product & Delivery About Scry AI Scry AI is a leading provider of AI-powered enterprise solutions, delivering transformational business outcomes through products like Collatio (automation of complex document processing across financial, legal, and operational domains), Auriga...

  • Pogram Manager

    4 weeks ago

    Chandigarh, Chandigarh, India Scry AI Full time

    Job Title: Program ManagerLocation: India, RemoteDepartment: Product & DeliveryAbout Scry AIScry AI is a leading provider of AI-powered enterprise solutions, delivering transformational business outcomes through products like Collatio (automation of complex document processing across financial, legal, and operational domains), Auriga (Enterprise Knowledge...

  • Data Scientist

    2 weeks ago

    Chandigarh, Chandigarh, India INFLUX SERVICE Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Data ScientistExperience: 2+ YearsJob Overview:We are seeking a talented Data Scientist to join our team and contribute to building advanced AI/ML solutions. The candidate will be responsible for developing, deploying, and optimizing models—including Large Language Models (LLMs)—to solve real-world business challenges. You will collaborate...

  • Data Annoation

    3 days ago

    Chandigarh, Chandigarh, India Stealth Company Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    About Paladin TechAt Paladin Tech, we build AI-powered products that transform complex data into actionable insights. Our portfolio includes solutions for deepfake detection, video and image analytics, big data intelligence, AI assistants, and real-time decision support systems. We help organizations enhance security, verify authenticity, optimize...