Senior Data Engineer

11 hours ago

Rajkot, India Sovereign IT Solutions Pvt Ltd Full time

We are seeking a Senior Data Engineer with 8+ years of real-world experience to act as a Subject Matter Expert (SME) and train students specifically for Data Engineering, Big Data, and AI/ML Data Platform interviews.


The ideal candidate will not only be hands-on with the latest data + AI/ML technologies but also excel at coaching, mentoring, and conducting mock interviews to prepare students for success in top-tier companies.


This role is perfect for someone who can bridge deep technical expertise with interview preparation and training.


Key Responsibilities


Act as SME & trainer, guiding students to crack Data Engineering, AI/ML, and Cloud Data Platform interviews.


Conduct mock interviews, Q&A sessions, and technical deep-dives.


Train students on real-world interview scenarios:


End-to-end ETL/ELT pipelines


Data modelling & warehousing


Data for AI/ML use cases (feature pipelines, vector databases, embeddings)


Streaming & batch processing at scale


Data governance, lineage, and security-first architectures


Core Data Engineering + AI/ML Pillars to Cover


1. Data Warehousing & Modelling: Star, Snowflake, and Data Vault modelling, SCD Types 1–6, OLTP vs OLAP vs Lakehouse, Schema evolution & data versioning


2. ETL/ELT & Orchestration


Orchestration: Apache Airflow, Prefect, Dagster, Azure Data Factory

Transformation: dbt, Spark SQL, Pandas, PySpark

Batch & streaming workflows (Kafka, Flink, Spark Structured Streaming, Kinesis)


3. Big Data & Distributed Processing: Spark (PySpark, Scala, Delta Lake), Hive, Presto/Trino, Iceberg, Hudi, Partitioning, bucketing, caching & shuffle optimisation, Lakehouse & Data Mesh architectures


4. Cloud Data Platforms


Snowflake, Databricks, BigQuery, Redshift, Synapse, Multi-cloud (AWS, Azure, GCP) + hybrid/on-prem migration


5. Data Storage & Ingestion: Data Lakes (S3, ADLS, GCS), Semi/unstructured data (Parquet, ORC, Avro, JSON, XML, multimedia), Real-time ingestion (Kafka, Pulsar, Debezium, CDC pipelines)


6. Observability & Monitoring


Pipeline observability (Prometheus, Grafana, ELK, CloudWatch, Datadog)

Data quality & reliability (Great Expectations, Soda, Deequ)

End-to-end lineage & metadata (Apache Atlas, DataHub, Purview, Collibra)


7. Security & Governance


IAM, RBAC, ABAC, fine-grained access controls

Data masking, tokenization, PII handling

GDPR, HIPAA, CCPA compliance

Secrets management (Vault, Key Vault, KMS)


8. AI/ML Enablement


Feature Engineering Pipelines: scalable pipelines for ML models

Feature Stores: Feast, Tecton, Databricks Feature Store

MLOps Practices: MLflow, SageMaker Pipelines, Vertex AI, Azure ML

Vector Databases & RAG: Pinecone, Weaviate, Milvus, Chroma for LLM apps

Model Serving: TensorFlow Serving, TorchServe, Kubernetes-based serving

AI Workflows: data prep for NLP, embeddings, recommendation systems

LLM Integration: prompt engineering, embeddings pipeline, data optimisation for GenAI workloads


Required Skills & Experience


8+ years in Data Engineering/Big Data/Cloud roles, with hands-on AI/ML data enablement.


Proven expertise with ETL/ELT, Spark, Data Lakes, Data Warehouses, and distributed systems.


Strong programming skills in Python, SQL, PySpark (Scala/R/ optional).


Expertise in cloud-native data + AI/ML platforms (AWS SageMaker, Azure ML, GCP Vertex AI, Databricks).


Hands-on with MLOps, Feature Stores, Vector Databases, and ML model integration.


Deep understanding of pipeline optimisation, governance, and cost efficiency.


Excellent communication & teaching skills — ability to simplify complex data & AI concepts.


Prior mentoring, training, or interview-prep experience strongly preferred.

  • Senior Big Data Engineer

    3 weeks ago

    Rajkot, Gujarat, India Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...

  • Senior Data Engineer with GCP, ETL

    3 weeks ago

    Rajkot, Gujarat, India iitjobs, Inc. Full time

    GreetingsRole : Senior Data Engineer with GCP, ETLLocation- 100 % RemoteExp Range- 4+ YrsNotice Period- Immediate Joiners only.Duration- 4 months ContractTime: 11 am to 8 pm ISTMust have skills:1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best...

  • Data Engineer

    2 weeks ago

    Rajkot, India Apexon Full time

    About Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core...

  • Senior Generative AI Engineer

    6 days ago

    Rajkot, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Senior Engineer

    2 weeks ago

    Rajkot, India LOGISTIC INFOTECH PVT LTD Full time

    We Are Hiring - Senior Engineer (SDK, Cloud & Security - Quantum-Safe Cryptography) Location:Rajkot / Ahmedabad Experience:5–10 Years AtLogistic Infotech Pvt. Ltd., we are working on cutting-edgeQuantum-Safe Cryptography SDK- a developer toolkit designed to secure the future of data and communication. We are looking for aSenior Engineerwho can help us take...

  • Manager - Data Engineering

    2 weeks ago

    Rajkot, India Core Minds Tech SOlutions Full time

    Job Description :In this role, you will :- Manage and develop team of data analysts with low to moderate complexity and risk in data management and technology, and engage stakeholders and internal partners- Identify and recommend opportunities for process improvement and risk control development- Operate data environments, integrate with new technologies and...

  • Data Engineer

    3 weeks ago

    Rajkot, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing...

  • Data Engineer

    2 weeks ago

    Rajkot, India Insight Global Full time

    Job Title: Data EngineerAbout the Company: Insight GlobalLocation: RemotePay Range: 18- 22 lakhs per annumDuration: 1-year contract with likely extensionNotice Period: This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!Interview Process: Priority scheduling for candidates who message on with resumeKey ResponsibilitiesDesign,...

  • Data Engineer

    3 weeks ago

    Rajkot, Gujarat, India Statfinity Full time

    Pay: ₹30,000.00 - ₹50,000.00 per monthStatfinity is seeking a skilled Data Engineer to design and build scalable data solutions using cutting-edge technologies.ResponsibilitiesDevelop robust data pipelines with Python and advanced SQL.Integrate data using APIs and OAuth.Leverage cloud services:GCP: Cloud Functions, Cloud Run, Cloud Schedulers,...

  • Senior Engineer Purchase

    7 days ago

    Rajkot, India K9HR Solutions Full time

    k9hr solutions is looking for senior engineer purchase jobs in rajkot, experience required : 2 years educational qualification : , , skill purchase engineer, senior engineer purchase etc.Experience2 - 3 YearsNo. of Openings2EducationB.E [Mechanical], B.Tech [Mechanical], M.Tech [Mechanical]RoleSenior Engineer PurchaseIndustry TypeManufacturing / Production /...