Senior Data Engineer

5 hours ago

Jaipur, Rajasthan, India ThoughtsWin Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Role Overview
Design, build, and optimize large-scale, production-grade data pipelines and analytics platforms on Azure, leveraging Databricks, Synapse, and the broader Microsoft data ecosystem.

Deliver business-critical data assets for analytics, BI, and AI/ML initiatives.

Key Technical Responsibilities

  • Architect modern data lakes using Azure Data Lake Storage Gen2 for batch and streaming workloads
  • Build and maintain scalable ETL/ELT pipelines using Azure Data Factory and Databricks (PySpark, Scala, SQL)
  • Orchestrate data workflows across ADF, Databricks, and Synapse Pipelines; implement modular and reusable data pipeline components
  • Develop advanced notebooks and production jobs in Azure Databricks (PySpark, SparkSQL, Delta Lake)
  • Optimize Spark jobs by tuning partitioning, caching, cluster configuration, and autoscaling for performance and cost
  • Implement Delta Lake for ACID-compliant data lakes and enable time travel/audit features
  • Engineer real-time data ingestion from Event Hubs, IoT Hub, and Kafka into Databricks and Synapse
  • Transform and enrich raw data, building robust data models and marts for analytics and AI use cases
  • Integrate structured, semi-structured, and unstructured sources, including APIs, logs, and files
  • Implement data validation, schema enforcement, and quality checks using Databricks, PySpark, and tools like Great Expectations
  • Manage access controls : Azure AD, Databricks workspace permissions, RBAC, Key Vault integration
  • Enable end-to-end lineage and cataloging via Microsoft Purview (or Unity Catalog if multi-cloud)
  • Automate deployment of Databricks assets (notebooks, jobs, clusters) using Databricks CLI/REST API, ARM/Bicep, or Terraform
  • Build and manage CI/CD pipelines in Azure DevOps for data pipelines and infrastructure as code
  • Containerize and deploy custom code with Azure Kubernetes Service (AKS) or Databricks Jobs as needed
  • Instrument monitoring and alerting with Azure Monitor, Log Analytics, and Databricks native tools
  • Diagnose and resolve performance bottlenecks in distributed Spark jobs and pipeline orchestrations
  • Collaborate with data scientists, BI engineers, and business stakeholders to deliver data solutions
  • Document design decisions, create technical specifications, and enforce engineering standards across the team

Required Skills & Experience

  • Hands-on with :
  • Azure Data Lake Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks
  • PySpark, SparkSQL, advanced SQL, Delta Lake
  • Data modeling (star/snowflake), partitioning, and data warehouse concepts
  • Strong Python programming and experience with workflow/orchestration (ADF, Airflow, or Synapse Pipelines)
  • Infrastructure automation : ARM/Bicep, Terraform, Databricks CLI/API, Azure DevOps
  • Deep understanding of Spark internals, cluster optimization, cost management, and distributed computing
  • Data security, RBAC, encryption, and compliance (SOC2, ISO, GDPR/DPDPA)
  • Excellent troubleshooting, performance tuning, and documentation skills

)

  • Senior Data Engineer

    4 days ago

    Jaipur, Rajasthan, India ListenFirst Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Summary:We are looking for a skilled and motivated Senior Data Engineer with strong experience in data engineering and ETL processes. The ideal candidate should be comfortable working with any object-oriented programming language, possess strong SQL skills, and have hands-on experience with AWS services like S3 and Redshift. Experience in Ruby and...

  • Lead/Senior Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India 80161b78-3cc4-4a86-a077-b6a3c33bfbb5 Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Job DescriptionLead Data Engineer - 8+ yearsSenior Data Engineer - 3+ yearsSkills: Scala, Python, DataBricks, Apache PySparkEMPLOYMENT TYPE: Full-Time, PermanentLOCATION: Remote (Pan India)SHIFT TIMINGS: 2.00 pm-11:00 pm ISTBudget- As per company standardsREPORTING: This position will report to our CEO or any other Lead as assigned by Management.The...

  • Data engineer

    1 week ago

    Jaipur, Rajasthan, India vlitechnologies Full time ₹ 60,00,000 - ₹ 84,00,000 per year

    Role: Senior Data Engineer Experience: 6+ Years Rate: 70k -80k per month Location: Remote (candidate must visit once in 2 months to Jaipur, company will bear all allowances excluding food)Job Type: Full-timePay: Up to ₹70,000.00 per monthBenefits:Food provided

  • Sr Data Engineer

    2 days ago

    Jaipur, Rajasthan, India Infomagine softwares pvt ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data EngineerJob Summary:We are looking for an experienced Senior Data Engineer with 6+ years of hands-on experience in designing, building, and optimizing data pipelines and architectures. The ideal candidate will take ownership of complex data systems, lead data engineering initiatives, and play a key role in shaping our organization's...

  • Senior Data Engineering Consultant

    2 weeks ago

    Jaipur, Rajasthan, India Atrium AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Take your career to the next level with the only consulting firm born in AI and delivering with AI.At Atrium, we�re not simply adapting to an AI-driven world � we�ve helped define it since we were founded. Our clients partner with us because we turn potential into measurable impact, reshaping industries, realizing exponential value, and empowering...

  • Senior Data Engineering Consultant

    3 days ago

    Jaipur, Rajasthan, India Atrium AI Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Take your career to the next level with the only consulting firm born in AI and delivering with AI.At Atrium, we're not simply adapting to an AI-driven world — we've helped define it since we were founded. Our clients partner with us because we turn potential into measurable impact, reshaping industries, realizing exponential value, and empowering...

  • Senior Data Analyst

    7 hours ago

    Jaipur, Rajasthan, India Sanmax Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company Description Sanmax  is a Multidivisional Company of India's largest and oldest Business House Poddar Group. leader in consulting, App Building, Business Development, and outsourcing solutions. As a proven Enterprises focused on enhancing new trend of technology,Sanmax enables clients in all over india along with European countries to outperform the...

  • Senior Data Scientist

    7 days ago

    Jaipur, Rajasthan, India CIMET Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Purpose Of The PositionWe are looking for a highly experienced Senior Data Scientist with a deep understanding of AI/ML technologies, including Recommendation Systems, Chatbots, Generative AI, and Large Language Models (LLMs). The ideal candidate will have hands-on experience in applying these technologies to solve real-world problems, working with large...

  • Data Engineer

    3 days ago

    Jaipur, Rajasthan, India Arting Digital Private Limited Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position: Data Engineer - 1Experience: 3 - 5 YearsLocation: Udaipur, RajasthanWork Mode: On-site (5 Days a Week)About the RoleWe are looking for an experienced Data Engineer Lead to design, build, and optimize scalable data platforms and pipelines. In this leadership role, you will take full ownership of data engineering initiatives, ensure high-quality data...

  • Data Engineer

    7 hours ago

    Jaipur, Rajasthan, India UiPath Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Life at UiPathThe people at UiPath believe in the transformative power of automation to change how the world works. We're committed to creating category-leading enterprise software that unleashes that power.To make that happen, we need people who are curious, self-propelled, generous, and genuine. People who love being part of a fast-moving, fast-thinking...