Senior Data Engineer

5 days ago

Jaipur, Rajasthan, India ThoughtsWin Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role Overview :

Design, build, and optimize large-scale, production-grade data pipelines and analytics platforms on Azure, leveraging Databricks, Synapse, and the broader Microsoft data ecosystem.

Deliver business-critical data assets for analytics, BI, and AI/ML initiatives.

Key Technical Responsibilities :

- Architect modern data lakes using Azure Data Lake Storage Gen2 for batch and streaming workloads

- Build and maintain scalable ETL/ELT pipelines using Azure Data Factory and Databricks (PySpark, Scala, SQL)

- Orchestrate data workflows across ADF, Databricks, and Synapse Pipelines; implement modular and reusable data pipeline components

- Develop advanced notebooks and production jobs in Azure Databricks (PySpark, SparkSQL, Delta Lake)

- Optimize Spark jobs by tuning partitioning, caching, cluster configuration, and autoscaling for performance and cost

- Implement Delta Lake for ACID-compliant data lakes and enable time travel/audit features

- Engineer real-time data ingestion from Event Hubs, IoT Hub, and Kafka into Databricks and Synapse

- Transform and enrich raw data, building robust data models and marts for analytics and AI use cases

- Integrate structured, semi-structured, and unstructured sources, including APIs, logs, and files

- Implement data validation, schema enforcement, and quality checks using Databricks, PySpark, and tools like Great Expectations

- Manage access controls : Azure AD, Databricks workspace permissions, RBAC, Key Vault integration

- Enable end-to-end lineage and cataloging via Microsoft Purview (or Unity Catalog if multi-cloud)

- Automate deployment of Databricks assets (notebooks, jobs, clusters) using Databricks CLI/REST API, ARM/Bicep, or Terraform

- Build and manage CI/CD pipelines in Azure DevOps for data pipelines and infrastructure as code

- Containerize and deploy custom code with Azure Kubernetes Service (AKS) or Databricks Jobs as needed

- Instrument monitoring and alerting with Azure Monitor, Log Analytics, and Databricks native tools

- Diagnose and resolve performance bottlenecks in distributed Spark jobs and pipeline orchestrations

- Collaborate with data scientists, BI engineers, and business stakeholders to deliver data solutions

- Document design decisions, create technical specifications, and enforce engineering standards across the team

Required Skills & Experience :

- Hands-on with :

1. Azure Data Lake Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks

2. PySpark, SparkSQL, advanced SQL, Delta Lake

3. Data modeling (star/snowflake), partitioning, and data warehouse concepts

- Strong Python programming and experience with workflow/orchestration (ADF, Airflow, or Synapse Pipelines)

- Infrastructure automation : ARM/Bicep, Terraform, Databricks CLI/API, Azure DevOps

- Deep understanding of Spark internals, cluster optimization, cost management, and distributed computing

- Data security, RBAC, encryption, and compliance (SOC2, ISO, GDPR/DPDPA)

- Excellent troubleshooting, performance tuning, and documentation skills

  • Senior Data Engineering Consultant

    7 days ago

    Jaipur, Rajasthan, India Atrium Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What will you be doing at Atrium? As a Senior Data Engineering Consultant, you will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. You will support the software developers, database architects, data analysts, and data scientists on data...

  • Senior Data Engineer – Looker

    1 day ago

    Jaipur, Rajasthan, India BOT Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking a highly skilled Senior Data Engineer with extensive hands-on experience in both Looker (LookML/dashboard development) and Amazon QuickSight. This role will help shape our analytic infrastructure, assist in dashboard migration, and deliver high-performance BI solutions in collaboration with cross-functional teams. You'll work with the latest...

  • Sr Data Engineer

    1 week ago

    Jaipur, Rajasthan, India Infomagine softwares pvt ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data EngineerJob Summary:We are looking for an experienced Senior Data Engineer with 6+ years of hands-on experience in designing, building, and optimizing data pipelines and architectures. The ideal candidate will take ownership of complex data systems, lead data engineering initiatives, and play a key role in shaping our organization's...

  • Senior Data Engineer

    7 days ago

    Jaipur, Rajasthan, India ThoughtsWin Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Role OverviewDesign, build, and optimize large-scale, production-grade data pipelines and analytics platforms on Azure, leveraging Databricks, Synapse, and the broader Microsoft data ecosystem.Deliver business-critical data assets for analytics, BI, and AI/ML initiatives.Key Technical ResponsibilitiesArchitect modern data lakes using Azure Data Lake Storage...

  • Senior Data Engineering Consultant

    1 week ago

    Jaipur, Rajasthan, India Atrium AI Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Take your career to the next level with the only consulting firm born in AI and delivering with AI.At Atrium, we're not simply adapting to an AI-driven world — we've helped define it since we were founded. Our clients partner with us because we turn potential into measurable impact, reshaping industries, realizing exponential value, and empowering...

  • Senior Data Analyst

    7 days ago

    Jaipur, Rajasthan, India Sanmax Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description Sanmax  is a Multidivisional Company of India's largest and oldest Business House Poddar Group. leader in consulting, App Building, Business Development, and outsourcing solutions. As a proven Enterprises focused on enhancing new trend of technology,Sanmax enables clients in all over india along with European countries to outperform the...

  • Senior Data Scientist

    2 weeks ago

    Jaipur, Rajasthan, India CIMET Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Purpose Of The PositionWe are looking for a highly experienced Senior Data Scientist with a deep understanding of AI/ML technologies, including Recommendation Systems, Chatbots, Generative AI, and Large Language Models (LLMs). The ideal candidate will have hands-on experience in applying these technologies to solve real-world problems, working with large...

  • Senior DevOps Engineer

    7 days ago

    Jaipur, Rajasthan, India ListenFirst Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About the OpportunityWe're looking for a senior-level DevOps engineer to lead the design, scaling, and security of our AWS infrastructure. This role is critical for deploying, monitoring, and managing both our applications and critical data workflows. The ideal candidate will have strong computer science fundamentals, deep Linux expertise, and hands-on...

  • Senior Data Scientist

    3 days ago

    Jaipur, Rajasthan, India CIMET Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Purpose Of The Position:We are looking for a highly experienced Senior Data Scientist with a deep understanding of AI/ML technologies, including Recommendation Systems, Chatbots, Generative AI, and Large Language Models (LLMs). The ideal candidate will have hands-on experience in applying these technologies to solve real-world problems, working with large...

  • Data Engineer

    1 day ago

    Jaipur, Rajasthan, India Celebal Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required years)Job Summary: We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data solutions that drive business value.Responsibilities:•...