ai - Data Engineer

3 weeks ago


Bengaluru, Karnataka, India Sprouts Full time

Job Summary :

We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and processing systems that power our modern data platform. The ideal candidate will have hands-on expertise in distributed data processing, data lake/lakehouse systems, and workflow orchestration using modern tools such as Spark, PySpark, Apache Iceberg, Apache Hudi, and Apache Airflow.

This role will be central in enabling reliable data ingestion, transformation, and governance-ready pipelines to support analytics, AI, and operational use cases across the organization.

Key Responsibilities :

- Build and maintain scalable ETL/ELT pipelines for batch and streaming data using PySpark and Airflow.

- Develop and optimize data ingestion workflows from multiple structured and unstructured data sources.

- Implement data lake and lakehouse solutions using Spark with Apache Iceberg, Hudi, or Delta Lake.

- Ensure data quality, reliability, and integrity through validation, profiling, and monitoring frameworks and automations using AI.

- Support database migration efforts and cross-system data reconciliation.

- Collaborate with data scientists, analysts, and platform engineers to enable analytics and ML use cases.

- Contribute to data governance practices, including schema evolution, versioned data catalogs (e.g., Nessie), and metadata management.

- Troubleshoot and optimize data jobs for performance and cost efficiency.

Required Skills & Qualifications :

- 6- 10 years of experience in data engineering with strong exposure to big data platforms.

- Hands-on experience with PySpark for distributed data processing.

- Solid understanding of modern table formats (Apache Iceberg, Hudi, Delta) and versioned data catalogs.

- Experience with Apache Airflow (or equivalent) for workflow orchestration.

- Strong SQL skills with experience in data modeling and performance tuning.

- Exposure to cloud data platforms (AWS, GCP, Azure) and managed services.

- Experience with handling large-scale datasets (TBs-100s of TBs).

- Understanding of DevOps practices for CI/CD of data pipelines.

Nice to Have :

- Experience in streaming data frameworks (Kafka, Flink, Spark Streaming).

- Knowledge of Sales, Marketing, or CRM domains (Accounts, Contacts data).

- Exposure to Elasticsearch, PostgreSQL, or Vector databases.

Why Join Us :

- Work on cutting-edge open-source data technologies at scale

- Grow your expertise in lakehouse, streaming, and AI-ready data architectures.

- Contribute to building a governance-ready, modern data platform from the ground up using AI

- Collaborate in a fast-paced, innovation-driven culture.

(ref:hirist.tech)
  • Ai Security Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 332430 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer to join our team in Bangalore Karn taka IN-KA India IN AI Security Engineer - Shared...

  • AI Engineering

    5 days ago


    Bengaluru, Karnataka, India Refold AI Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    As an AI Engineer on the founding team, you won't just write code, you'll architect, experiment, and build AI systems that power the future of software interoperability. You'll work directly with the founders, take ownership of major technical decisions, and help define the trajectory of our product and platform. We move fast. We build a lot. And we have fun...

  • AI Solution Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Hevo Data Full time

    Job DescriptionAbout Hevo:At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer...

  • AI /Ml Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Weekday AI Full time

    This role is for one of Weekday's clientsSalary range: Rs 1200000 - Rs 2000000 (ie INR 12-20 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-timeRequirementsAbout the role- Design, develop, and implement AI/ML models and algorithms.- Build Proof of Concept (POC) applications to demonstrate feasibility and business value.- Write clean, efficient,...

  • AI Solutions Engineer

    22 hours ago


    Bengaluru, Karnataka, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Hevo:At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...


  • Bengaluru, Karnataka, India Enable Data Incorporated Full time

    AI Engineer Primary Responsibilities: - Over all 5 + Years- Relevant 2+ Years of Develop and improve the AI agentic frameworks that allow AI agents to work together to achieve complex tasks. - Develop novel data collection, fine-tuning, and AI technologies that achieve optimal performance on specific tasks and domains. - Design and implement ML pipelines...


  • Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AI Engineer   Primary Responsibilities: Over all 5 + Years Relevant 2+ Years of Develop and improve the AI agentic frameworks that allow AI agents to work together to achieve complex tasks.  Develop novel data collection, fine-tuning, and AI technologies that achieve optimal performance on specific tasks and domains.  Design and implement ML pipelines...

  • AI Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Key Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python code for data science and machine learning projects.Preferred Qualifications: Knowledge of Deep Learning (DL) techniques. Experience working with Generative AI (GenAI) and Large Language Models...


  • Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:332430NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Security Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job DescriptionAI Security...

  • Staff+ AI Engineer

    3 days ago


    Bengaluru, Karnataka, India Yupp AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About YuppWe are a well-funded, rapidly growing, early-stage AI startup headquartered in Silicon Valley that is building a two-sided product -- one side meant for global consumers and the other side for AI builders and researchers. We work on the cutting edge of AI across the stack. Check out our product that was launched recently, and how it solves the...