Senior Data Engineer

5 days ago

Delhi, India Sovereign IT Solutions Pvt Ltd Full time

We are seeking a Senior Data Engineer with 8+ years of real-world experience to act as a Subject Matter Expert (SME) and train students specifically for Data Engineering, Big Data, and AI/ML Data Platform interviews.The ideal candidate will not only be hands-on with the latest data + AI/ML technologies but also excel at coaching, mentoring, and conducting mock interviews to prepare students for success in top-tier companies.This role is perfect for someone who can bridge deep technical expertise with interview preparation and training.Key ResponsibilitiesAct as SME & trainer, guiding students to crack Data Engineering, AI/ML, and Cloud Data Platform interviews.Conduct mock interviews, Q&A sessions, and technical deep-dives.Train students on real-world interview scenarios:End-to-end ETL/ELT pipelinesData modelling & warehousingData for AI/ML use cases (feature pipelines, vector databases, embeddings)Streaming & batch processing at scaleData governance, lineage, and security-first architecturesCore Data Engineering + AI/ML Pillars to Cover1. Data Warehousing & Modelling: Star, Snowflake, and Data Vault modelling, SCD Types 1–6, OLTP vs OLAP vs Lakehouse, Schema evolution & data versioning2. ETL/ELT & OrchestrationOrchestration: Apache Airflow, Prefect, Dagster, Azure Data FactoryTransformation: dbt, Spark SQL, Pandas, PySparkBatch & streaming workflows (Kafka, Flink, Spark Structured Streaming, Kinesis)3. Big Data & Distributed Processing: Spark (PySpark, Scala, Delta Lake), Hive, Presto/Trino, Iceberg, Hudi, Partitioning, bucketing, caching & shuffle optimisation, Lakehouse & Data Mesh architectures4. Cloud Data PlatformsSnowflake, Databricks, BigQuery, Redshift, Synapse, Multi-cloud (AWS, Azure, GCP) + hybrid/on-prem migration5. Data Storage & Ingestion: Data Lakes (S3, ADLS, GCS), Semi/unstructured data (Parquet, ORC, Avro, JSON, XML, multimedia), Real-time ingestion (Kafka, Pulsar, Debezium, CDC pipelines)6. Observability & MonitoringPipeline observability (Prometheus, Grafana, ELK, CloudWatch, Datadog)Data quality & reliability (Great Expectations, Soda, Deequ)End-to-end lineage & metadata (Apache Atlas, DataHub, Purview, Collibra)7. Security & GovernanceIAM, RBAC, ABAC, fine-grained access controlsData masking, tokenization, PII handlingGDPR, HIPAA, CCPA complianceSecrets management (Vault, Key Vault, KMS)8. AI/ML EnablementFeature Engineering Pipelines: scalable pipelines for ML modelsFeature Stores: Feast, Tecton, Databricks Feature StoreMLOps Practices: MLflow, SageMaker Pipelines, Vertex AI, Azure MLVector Databases & RAG: Pinecone, Weaviate, Milvus, Chroma for LLM appsModel Serving: TensorFlow Serving, TorchServe, Kubernetes-based servingAI Workflows: data prep for NLP, embeddings, recommendation systemsLLM Integration: prompt engineering, embeddings pipeline, data optimisation for GenAI workloadsRequired Skills & Experience8+ years in Data Engineering/Big Data/Cloud roles, with hands-on AI/ML data enablement.Proven expertise with ETL/ELT, Spark, Data Lakes, Data Warehouses, and distributed systems.Strong programming skills in Python, SQL, PySpark (Scala/R/ optional).Expertise in cloud-native data + AI/ML platforms (AWS SageMaker, Azure ML, GCP Vertex AI, Databricks).Hands-on with MLOps, Feature Stores, Vector Databases, and ML model integration.Deep understanding of pipeline optimisation, governance, and cost efficiency.Excellent communication & teaching skills — ability to simplify complex data & AI concepts.Prior mentoring, training, or interview-prep experience strongly preferred.

  • Senior/Lead Data Engineer

    5 days ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Senior/Lead Data Engineer

    4 days ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Data Engineer

    2 days ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 days ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    2 days ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 days ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Data Engineer

    4 days ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Senior Data Engineer

    1 week ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...

  • Senior Data Engineer

    7 days ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title: Senior Data Engineer (IDMC-CDI)Primary Skills: IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 8-15 yearsShift Timing: Open to work in EST shift (5PM to 2AM IST)About UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various...

  • Senior Data Engineer

    11 hours ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...