Data Engineer

2 hours ago


Delhi, India Data-Hat AI Full time
Department:
Data Engineering & AI Solutions
Reports To:
Lead Data Solutions Architect
Travel:
International travel required (up to 30–40%)
Position Summary:
We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure
that underpins mission-critical AI systems. With 12+ years of experience, you’ll be responsible for implementing robust data pipelines, enforcing governance frameworks, and ensuring end-to-end data accessibility for advanced machine learning and analytics use cases.
This is a strategic and hands-on role that sits at the heart of AI delivery, demanding a combination of deep technical acumen, system architecture expertise, and the ability to collaborate across business, data science, and engineering teams. The ideal candidate combines technical mastery with a consultative mindset
and is capable of aligning technical workstreams with business outcomes.
Key Responsibilities:
Data Pipeline Engineering
Design, build, and maintain cloud-native, scalable ETL/ELT pipelines for structured and unstructured data ingestion, transformation, and delivery.
Leverage tools such as Apache Airflow, dbt, Spark, Kafka, and native cloud data services to optimize data flow and processing latency.
Implement event-driven architectures and real-time data streaming solutions where applicable.
Data Infrastructure Architecture
Architect and manage data infrastructure components across cloud environments (AWS, Azure, GCP), including storage, compute, orchestration, and security layers.
Enable containerized deployment of data services using Docker and Kubernetes, ensuring high availability and scalability of infrastructure.
Ensure data systems are optimized for AI workloads, including support for large-scale model training and real-time inference.
Data Modeling & Governance
Design and implement enterprise-grade data models, schema definitions, and metadata management practices.
Enforce data governance policies, lineage tracking, access control, and compliance standards (e.g., GDPR, ISO 27001).
Establish data quality frameworks, including anomaly detection, validation rules, and automated monitoring mechanisms.
Collaboration & Stakeholder Engagement
Act as a technical liaison between Data Scientists, ML Engineers, Business Analysts, and senior stakeholders to ensure alignment of data architecture with AI goals.
Lead technical workshops and provide mentorship to junior engineers and project teams.
Translate high-level business requirements into detailed technical execution plans.
Optimization & Monitoring
Proactively monitor pipeline performance, identify system bottlenecks, and implement enhancements for throughput, latency, and cost-efficiency.
Set up automated alerts, logging, and dashboarding using observability tools (e.g., Prometheus, Grafana, CloudWatch).
Documentation & Knowledge Sharing
Develop and maintain comprehensive documentation covering data flows, infrastructure configuration, architectural decisions, and operational procedures.
Deliver internal training sessions and contribute to reusable libraries, templates, and engineering standards.
International Implementation Support
Travel internationally to work directly with clients and partners, conducting technical assessments, supporting deployments, and providing hands-on engineering leadership in the field.
Required Qualifications:
Education:
Bachelor’s degree in Computer Science, Data Engineering, or a related technical discipline is required.
Master’s degree in Data Science, Information Systems, or Software Engineering is
highly preferred .
Technical Expertise:
Data Warehousing & Lakehouse : Advanced experience with Snowflake, Redshift, BigQuery, or Delta Lake architectures.
Cloud Platforms : Deep hands-on expertise in at least one major cloud provider (AWS, Azure, GCP).
ETL/ELT Tools : Proficient with dbt, Apache Airflow, Informatica, or similar.
Programming Languages : Strong coding skills in Python
(essential), SQL (advanced), and optionally Scala or Java.
Containerization & Orchestration : Experience with
Docker, Kubernetes , and Helm.
CI/CD Pipelines : Familiarity with tools like GitLab CI, Jenkins, or cloud-native DevOps pipelines.
Security & Compliance : Knowledge of role-based access control, encryption, data masking, and regulatory compliance frameworks.
Soft Skills & Leadership:
Strong interpersonal and communication skills - capable of working across cultures, geographies, and organizational levels.
Proven ability to lead technical conversations with business context and explain abstract data architecture in understandable terms.
Demonstrated success in client-facing roles or cross-functional teams.
High degree of ownership, autonomy, and problem-solving capability.
Preferred/Bonus Qualifications:
Certifications in AWS/Azure/GCP data or ML specialties.
Experience in MLOps and AI/ML model deployment lifecycles.
Background in sectors such as government, energy, or finance.
Company Description
Generative AI solutions are reshaping how we work, and AI Agents are the future. Data-Hat AI assists Enterprises in navigating the AI landscape and building profitable and scalable Enterprise AI solutions. As transformation leaders implore the AI landscape, they seek experts to assist in developing solutions and building strategies. And that’s where Data-Hat AI comes in Guided by an industry veteran, Kshitij Kumar (KK), who has over 2 decades of experience in introducing and implementing Data and AI solutions in Large Enterprises in the US, UK and Europe; a global team of AI and ML experts design Enterprise level AI, GenAI and AI Agent solutions. We go beyond product development, we collaborate with stakeholders and technology leaders to build a Data and AI strategy, develop a Minimal Viable Product (MVP) and establish ROI. We help Enterprises with impactful AI solutions development.
  • Senior Data Engineer

    4 weeks ago


    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...


  • Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...


  • Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...


  • Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...


  • Delhi, NCR, India MchooversPacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title: Senior Data Engineer (IDMC-CDI)Primary Skills: IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 8-15 yearsShift Timing: Open to work in EST shift (5PM to 2AM IST)About UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various...


  • New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Data Engineer

    2 weeks ago


    Delhi, India Tata Consultancy Services Full time

    Position- Data Engineer Location- Pune , Chennai, Bangalore, Gurgaon Experience-5 to 9 Years Notice Period: 0 to 45 Days or Serving Notice period Skills: Spark and Scala(Must have) Hadoop, Hive, Impala, Advanced SQL,OS (Unix), CI/CD Tools (Git, Jenkins, Nexus), Agile (Jira, Confluence), Relational Databases Job Description: Big Data/Hadoop Experience...

  • Data Engineer

    4 weeks ago


    Delhi, Delhi, India Comtek Full time

    About the Role : We are seeking a skilled Data Engineer to join our team and contribute to our cutting-edge data platform built on a medallion data lake architecture. You will design, develop, and maintain robust data pipelines while collaborating on innovative AI engineering projects. This role combines traditional data engineering responsibilities with...

  • Data Engineer

    2 weeks ago


    Delhi, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP)Job SummaryWe are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    5 days ago


    Delhi, Delhi, India FlexionHire Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHidden Road is the global credit network for institutions, enabling seamless access to both traditional and digital markets. Our conflict-free model built on a modern technology stack helps eliminate complexity and reduce costs in prime brokerage, clearing, and financing. For more information, please email Role DescriptionThis is a...