Senior Data Engineer
3 weeks ago
We are seeking a Senior Data Engineer with 8+ years of real-world experience to act as a Subject Matter Expert (SME) and train students specifically for Data Engineering, Big Data, and AI/ML Data Platform interviews.
The ideal candidate will not only be hands-on with the latest data + AI/ML technologies but also excel at coaching, mentoring, and conducting mock interviews to prepare students for success in top-tier companies.
This role is perfect for someone who can bridge deep technical expertise with interview preparation and training.
Key Responsibilities
Act as SME & trainer, guiding students to crack Data Engineering, AI/ML, and Cloud Data Platform interviews.
Conduct mock interviews, Q&A sessions, and technical deep-dives.
Train students on real-world interview scenarios:
End-to-end ETL/ELT pipelines
Data modelling & warehousing
Data for AI/ML use cases (feature pipelines, vector databases, embeddings)
Streaming & batch processing at scale
Data governance, lineage, and security-first architectures
Core Data Engineering + AI/ML Pillars to Cover
1. Data Warehousing & Modelling: Star, Snowflake, and Data Vault modelling, SCD Types 1–6, OLTP vs OLAP vs Lakehouse, Schema evolution & data versioning
2. ETL/ELT & Orchestration
Orchestration: Apache Airflow, Prefect, Dagster, Azure Data Factory
Transformation: dbt, Spark SQL, Pandas, PySpark
Batch & streaming workflows (Kafka, Flink, Spark Structured Streaming, Kinesis)
3. Big Data & Distributed Processing: Spark (PySpark, Scala, Delta Lake), Hive, Presto/Trino, Iceberg, Hudi, Partitioning, bucketing, caching & shuffle optimisation, Lakehouse & Data Mesh architectures
4. Cloud Data Platforms
Snowflake, Databricks, BigQuery, Redshift, Synapse, Multi-cloud (AWS, Azure, GCP) + hybrid/on-prem migration
5. Data Storage & Ingestion: Data Lakes (S3, ADLS, GCS), Semi/unstructured data (Parquet, ORC, Avro, JSON, XML, multimedia), Real-time ingestion (Kafka, Pulsar, Debezium, CDC pipelines)
6. Observability & Monitoring
Pipeline observability (Prometheus, Grafana, ELK, CloudWatch, Datadog)
Data quality & reliability (Great Expectations, Soda, Deequ)
End-to-end lineage & metadata (Apache Atlas, DataHub, Purview, Collibra)
7. Security & Governance
IAM, RBAC, ABAC, fine-grained access controls
Data masking, tokenization, PII handling
GDPR, HIPAA, CCPA compliance
Secrets management (Vault, Key Vault, KMS)
8. AI/ML Enablement
Feature Engineering Pipelines: scalable pipelines for ML models
Feature Stores: Feast, Tecton, Databricks Feature Store
MLOps Practices: MLflow, SageMaker Pipelines, Vertex AI, Azure ML
Vector Databases & RAG: Pinecone, Weaviate, Milvus, Chroma for LLM apps
Model Serving: TensorFlow Serving, TorchServe, Kubernetes-based serving
AI Workflows: data prep for NLP, embeddings, recommendation systems
LLM Integration: prompt engineering, embeddings pipeline, data optimisation for GenAI workloads
Required Skills & Experience
8+ years in Data Engineering/Big Data/Cloud roles, with hands-on AI/ML data enablement.
Proven expertise with ETL/ELT, Spark, Data Lakes, Data Warehouses, and distributed systems.
Strong programming skills in Python, SQL, PySpark (Scala/R/ optional).
Expertise in cloud-native data + AI/ML platforms (AWS SageMaker, Azure ML, GCP Vertex AI, Databricks).
Hands-on with MLOps, Feature Stores, Vector Databases, and ML model integration.
Deep understanding of pipeline optimisation, governance, and cost efficiency.
Excellent communication & teaching skills — ability to simplify complex data & AI concepts.
Prior mentoring, training, or interview-prep experience strongly preferred.
-
Senior Data Engineer
2 days ago
Rajkot, India SID Information Technologies Full timeRole: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience: 6–12 yearsLocation: HyderabadWork Mode: Hybrid (3 days/week in-office)Join Time: ImmediateMust-Have Technical Skills:Strong programming skills in Python or Scala, Spark/DatabricksHands-on experience with Apache Spark for big data processing on AWS cloudProficiency with AWS services...
-
Senior Data Engineer
2 days ago
Rajkot, India SID Information Technologies Full timeRole: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience: 6–12 yearsLocation: HyderabadWork Mode: Hybrid (3 days/week in-office)Join Time: ImmediateMust-Have Technical Skills:Strong programming skills in Python or Scala, Spark/DatabricksHands-on experience with Apache Spark for big data processing on AWS cloudProficiency with AWS services...
-
Senior Generative AI Engineer
4 weeks ago
Rajkot, India Ampstek Full timeTitle: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...
-
Senior data modeler
6 days ago
Rajkot, India Neutrino Advisory, An Inc 5000 Company Full timeRole Overview: We are seeking a Senior Data Modeler with over 12 years of IT experience, including 8–10 years in data modeling and database design. The role involves designing and optimizing data models across transactional, analytical, and cloud environments using platforms such as SQL Server, Oracle, Snowflake, and Azure Synapse. The ideal candidate will...
-
Data Engineer
2 weeks ago
Rajkot, India NuVision Auto Glass Full timeNuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield replacement and expert auto glass services, ensuring convenience and safety at every step.With seamless insurance claims, easy financing options for cash payments,...
-
Senior Engineer Purchase
4 days ago
Rajkot, India K9HR Solutions Full timek9hr solutions is looking for senior engineer purchase jobs in rajkot, experience required : 2 years educational qualification : , , skill purchase engineer, senior engineer purchase etc.Experience2 - 3 YearsNo. of Openings2EducationB.E [Mechanical], B.Tech [Mechanical], M.Tech [Mechanical]RoleSenior Engineer PurchaseIndustry TypeManufacturing / Production /...
-
Rajkot, India K9HR Solutions Full timek9hr solutions is looking for senior mechanical design engineer job in rajkot, experience required : 4 years educational qualification : , skill senior mechanical design engineer, senior design engineer etc.Experience4 - 8 YearsNo. of Openings1EducationB.E [Mechanical], B.Tech [Mechanical]RoleSenior Mechanical Design EngineerIndustry TypeEngineering / Cement...
-
Senior Backend Engineer
2 weeks ago
Rajkot, India Protonlogics IT Solutions Full timeSenior Backend Engineer (Node.JS + AI)Remote JobFulltime Permanent RoleNeed Candidates who can join in max 20-30 Days.Exp. 5+ YearsOverview of the Department/SectionThe Engineering department at our client organization is dedicated to analyzing, designing, developing, and delivering high-quality product requirements to meet the needs of our clients and...
-
Rajkot, India KPG99 INC Full timeHi Hope you are doing well Please look at below mentioned Job Description and share your updated resume and mention your work authorization & Current Location . If the JD match with your skills. Role: SAP Data Engineer Location: - India Remote Duration: Offshore 12+ Months Contract Job Description: Core Skillset Must Be: DataSphere S4 Hana SAC BW Data...
-
Senior Java Software Engineer
3 weeks ago
Rajkot, India Recro Full timeClient is a VC-backed, cloud-native B2B platform transforming how hotels connect with global demand. Founded by serial travel-tech entrepreneurs and backed by Highgate Technology Ventures (HTV), we’re building the next generation of hotel distribution—automated, scalable, and integrated directly with CRS/PMS systems.Scale that speaks for itself: • 1B+...