Senior Data Engineer

3 weeks ago

Rajkot, India Sovereign IT Solutions Pvt Ltd Full time

We are seeking a Senior Data Engineer with 8+ years of real-world experience to act as a Subject Matter Expert (SME) and train students specifically for Data Engineering, Big Data, and AI/ML Data Platform interviews.


The ideal candidate will not only be hands-on with the latest data + AI/ML technologies but also excel at coaching, mentoring, and conducting mock interviews to prepare students for success in top-tier companies.


This role is perfect for someone who can bridge deep technical expertise with interview preparation and training.


Key Responsibilities


Act as SME & trainer, guiding students to crack Data Engineering, AI/ML, and Cloud Data Platform interviews.


Conduct mock interviews, Q&A sessions, and technical deep-dives.


Train students on real-world interview scenarios:


End-to-end ETL/ELT pipelines


Data modelling & warehousing


Data for AI/ML use cases (feature pipelines, vector databases, embeddings)


Streaming & batch processing at scale


Data governance, lineage, and security-first architectures


Core Data Engineering + AI/ML Pillars to Cover


1. Data Warehousing & Modelling: Star, Snowflake, and Data Vault modelling, SCD Types 1–6, OLTP vs OLAP vs Lakehouse, Schema evolution & data versioning


2. ETL/ELT & Orchestration


Orchestration: Apache Airflow, Prefect, Dagster, Azure Data Factory

Transformation: dbt, Spark SQL, Pandas, PySpark

Batch & streaming workflows (Kafka, Flink, Spark Structured Streaming, Kinesis)


3. Big Data & Distributed Processing: Spark (PySpark, Scala, Delta Lake), Hive, Presto/Trino, Iceberg, Hudi, Partitioning, bucketing, caching & shuffle optimisation, Lakehouse & Data Mesh architectures


4. Cloud Data Platforms


Snowflake, Databricks, BigQuery, Redshift, Synapse, Multi-cloud (AWS, Azure, GCP) + hybrid/on-prem migration


5. Data Storage & Ingestion: Data Lakes (S3, ADLS, GCS), Semi/unstructured data (Parquet, ORC, Avro, JSON, XML, multimedia), Real-time ingestion (Kafka, Pulsar, Debezium, CDC pipelines)


6. Observability & Monitoring


Pipeline observability (Prometheus, Grafana, ELK, CloudWatch, Datadog)

Data quality & reliability (Great Expectations, Soda, Deequ)

End-to-end lineage & metadata (Apache Atlas, DataHub, Purview, Collibra)


7. Security & Governance


IAM, RBAC, ABAC, fine-grained access controls

Data masking, tokenization, PII handling

GDPR, HIPAA, CCPA compliance

Secrets management (Vault, Key Vault, KMS)


8. AI/ML Enablement


Feature Engineering Pipelines: scalable pipelines for ML models

Feature Stores: Feast, Tecton, Databricks Feature Store

MLOps Practices: MLflow, SageMaker Pipelines, Vertex AI, Azure ML

Vector Databases & RAG: Pinecone, Weaviate, Milvus, Chroma for LLM apps

Model Serving: TensorFlow Serving, TorchServe, Kubernetes-based serving

AI Workflows: data prep for NLP, embeddings, recommendation systems

LLM Integration: prompt engineering, embeddings pipeline, data optimisation for GenAI workloads


Required Skills & Experience


8+ years in Data Engineering/Big Data/Cloud roles, with hands-on AI/ML data enablement.


Proven expertise with ETL/ELT, Spark, Data Lakes, Data Warehouses, and distributed systems.


Strong programming skills in Python, SQL, PySpark (Scala/R/ optional).


Expertise in cloud-native data + AI/ML platforms (AWS SageMaker, Azure ML, GCP Vertex AI, Databricks).


Hands-on with MLOps, Feature Stores, Vector Databases, and ML model integration.


Deep understanding of pipeline optimisation, governance, and cost efficiency.


Excellent communication & teaching skills — ability to simplify complex data & AI concepts.


Prior mentoring, training, or interview-prep experience strongly preferred.

  • Senior Data Engineer

    2 days ago

    Rajkot, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience: 6–12 yearsLocation: HyderabadWork Mode: Hybrid (3 days/week in-office)Join Time: ImmediateMust-Have Technical Skills:Strong programming skills in Python or Scala, Spark/DatabricksHands-on experience with Apache Spark for big data processing on AWS cloudProficiency with AWS services...

  • Senior Data Engineer

    2 days ago

    Rajkot, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience: 6–12 yearsLocation: HyderabadWork Mode: Hybrid (3 days/week in-office)Join Time: ImmediateMust-Have Technical Skills:Strong programming skills in Python or Scala, Spark/DatabricksHands-on experience with Apache Spark for big data processing on AWS cloudProficiency with AWS services...

  • Senior Generative AI Engineer

    4 weeks ago

    Rajkot, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Senior data modeler

    6 days ago

    Rajkot, India Neutrino Advisory, An Inc 5000 Company Full time

    Role Overview: We are seeking a Senior Data Modeler with over 12 years of IT experience, including 8–10 years in data modeling and database design. The role involves designing and optimizing data models across transactional, analytical, and cloud environments using platforms such as SQL Server, Oracle, Snowflake, and Azure Synapse. The ideal candidate will...

  • Data Engineer

    2 weeks ago

    Rajkot, India NuVision Auto Glass Full time

    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield replacement and expert auto glass services, ensuring convenience and safety at every step.With seamless insurance claims, easy financing options for cash payments,...

  • Senior Engineer Purchase

    4 days ago

    Rajkot, India K9HR Solutions Full time

    k9hr solutions is looking for senior engineer purchase jobs in rajkot, experience required : 2 years educational qualification : , , skill purchase engineer, senior engineer purchase etc.Experience2 - 3 YearsNo. of Openings2EducationB.E [Mechanical], B.Tech [Mechanical], M.Tech [Mechanical]RoleSenior Engineer PurchaseIndustry TypeManufacturing / Production /...

  • Looking For Senior Mechanical Design Engineer

    4 days ago

    Rajkot, India K9HR Solutions Full time

    k9hr solutions is looking for senior mechanical design engineer job in rajkot, experience required : 4 years educational qualification : , skill senior mechanical design engineer, senior design engineer etc.Experience4 - 8 YearsNo. of Openings1EducationB.E [Mechanical], B.Tech [Mechanical]RoleSenior Mechanical Design EngineerIndustry TypeEngineering / Cement...

  • Senior Backend Engineer

    2 weeks ago

    Rajkot, India Protonlogics IT Solutions Full time

    Senior Backend Engineer (Node.JS + AI)Remote JobFulltime Permanent RoleNeed Candidates who can join in max 20-30 Days.Exp. 5+ YearsOverview of the Department/SectionThe Engineering department at our client organization is dedicated to analyzing, designing, developing, and delivering high-quality product requirements to meet the needs of our clients and...

  • Offshore 12+ Months Contract || SAP Data Engineer || Remote

    1 week ago

    Rajkot, India KPG99 INC Full time

    Hi Hope you are doing well Please look at below mentioned Job Description and share your updated resume and mention your work authorization & Current Location . If the JD match with your skills. Role: SAP Data Engineer Location: - India Remote Duration: Offshore 12+ Months Contract Job Description: Core Skillset Must Be: DataSphere S4 Hana SAC BW Data...

  • Senior Java Software Engineer

    3 weeks ago

    Rajkot, India Recro Full time

    Client is a VC-backed, cloud-native B2B platform transforming how hotels connect with global demand. Founded by serial travel-tech entrepreneurs and backed by Highgate Technology Ventures (HTV), we’re building the next generation of hotel distribution—automated, scalable, and integrated directly with CRS/PMS systems.Scale that speaks for itself: • 1B+...