Senior Data Engineer

4 hours ago

Jaipur, Rajasthan, India ThoughtsWin Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Role Overview
Design, build, and optimize large-scale, production-grade data pipelines and analytics platforms on Azure, leveraging Databricks, Synapse, and the broader Microsoft data ecosystem.

Deliver business-critical data assets for analytics, BI, and AI/ML initiatives.

Key Technical Responsibilities

  • Architect modern data lakes using Azure Data Lake Storage Gen2 for batch and streaming workloads
  • Build and maintain scalable ETL/ELT pipelines using Azure Data Factory and Databricks (PySpark, Scala, SQL)
  • Orchestrate data workflows across ADF, Databricks, and Synapse Pipelines; implement modular and reusable data pipeline components
  • Develop advanced notebooks and production jobs in Azure Databricks (PySpark, SparkSQL, Delta Lake)
  • Optimize Spark jobs by tuning partitioning, caching, cluster configuration, and autoscaling for performance and cost
  • Implement Delta Lake for ACID-compliant data lakes and enable time travel/audit features
  • Engineer real-time data ingestion from Event Hubs, IoT Hub, and Kafka into Databricks and Synapse
  • Transform and enrich raw data, building robust data models and marts for analytics and AI use cases
  • Integrate structured, semi-structured, and unstructured sources, including APIs, logs, and files
  • Implement data validation, schema enforcement, and quality checks using Databricks, PySpark, and tools like Great Expectations
  • Manage access controls : Azure AD, Databricks workspace permissions, RBAC, Key Vault integration
  • Enable end-to-end lineage and cataloging via Microsoft Purview (or Unity Catalog if multi-cloud)
  • Automate deployment of Databricks assets (notebooks, jobs, clusters) using Databricks CLI/REST API, ARM/Bicep, or Terraform
  • Build and manage CI/CD pipelines in Azure DevOps for data pipelines and infrastructure as code
  • Containerize and deploy custom code with Azure Kubernetes Service (AKS) or Databricks Jobs as needed
  • Instrument monitoring and alerting with Azure Monitor, Log Analytics, and Databricks native tools
  • Diagnose and resolve performance bottlenecks in distributed Spark jobs and pipeline orchestrations
  • Collaborate with data scientists, BI engineers, and business stakeholders to deliver data solutions
  • Document design decisions, create technical specifications, and enforce engineering standards across the team

Required Skills & Experience

  • Hands-on with :
  • Azure Data Lake Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks
  • PySpark, SparkSQL, advanced SQL, Delta Lake
  • Data modeling (star/snowflake), partitioning, and data warehouse concepts
  • Strong Python programming and experience with workflow/orchestration (ADF, Airflow, or Synapse Pipelines)
  • Infrastructure automation : ARM/Bicep, Terraform, Databricks CLI/API, Azure DevOps
  • Deep understanding of Spark internals, cluster optimization, cost management, and distributed computing
  • Data security, RBAC, encryption, and compliance (SOC2, ISO, GDPR/DPDPA)
  • Excellent troubleshooting, performance tuning, and documentation skills

)

  • Senior Data Engineer

    1 week ago

    Jaipur, Rajasthan, India ListenFirst Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking an experienced and motivatedSenior Data Engineerwith expertise in building and optimizing data pipelines, ETL processes, and scalable data solutions. The ideal candidate will have strong SQL and database knowledge, solid coding experience, and a solution-oriented approach to problem solving. Hands-on exposure to cloud platforms,...

  • Senior Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India BOT Consulting Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the job : We are seeking a highly skilled Senior Data Engineer with extensive hands-on experience in both Looker (LookML/dashboard development) and Amazon QuickSight. This role will help shape our analytic infrastructure, assist in dashboard migration, and deliver high-performance BI solutions in collaboration with cross-functional teams. ...

  • Senior Data Architect

    1 week ago

    Jaipur, Rajasthan, India Programmers Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role:Senior Data ArchitectEmployment:Full TimeExperience:14 To 20 YearsSalary:Not DisclosedLocation:Jaipur,Hyderabad,PuneProgrammers.IO is currently looking to hire Senior Data Architect on Microsoft Fabric (ETL/ELT, Data Analysis, Visualisation), Pre Sales/Solution Design, AI/ML Technology. If you think you are a good fit and willing to work from...

  • Data engineer

    1 week ago

    Jaipur, Rajasthan, India vlitechnologies Full time ₹ 60,00,000 - ₹ 84,00,000 per year

    Role: Senior Data Engineer Experience: 6+ Years Rate: 70k -80k per month Location: Remote (candidate must visit once in 2 months to Jaipur, company will bear all allowances excluding food)Job Type: Full-timePay: Up to ₹70,000.00 per monthBenefits:Food provided

  • Senior Data Engineering Consultant

    5 hours ago

    Jaipur, Rajasthan, India Atrium Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What will you be doing at Atrium? As a Senior Data Engineering Consultant, you will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. You will support the software developers, database architects, data analysts, and data scientists on data...

  • Sr Data Engineer

    3 days ago

    Jaipur, Rajasthan, India Infomagine softwares pvt ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data EngineerJob Summary:We are looking for an experienced Senior Data Engineer with 6+ years of hands-on experience in designing, building, and optimizing data pipelines and architectures. The ideal candidate will take ownership of complex data systems, lead data engineering initiatives, and play a key role in shaping our organization's...

  • Senior Data Engineering Consultant

    2 days ago

    Jaipur, Rajasthan, India Atrium AI Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Take your career to the next level with the only consulting firm born in AI and delivering with AI.At Atrium, we're not simply adapting to an AI-driven world — we've helped define it since we were founded. Our clients partner with us because we turn potential into measurable impact, reshaping industries, realizing exponential value, and empowering...

  • Senior Data Analyst

    7 hours ago

    Jaipur, Rajasthan, India Sanmax Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description Sanmax  is a Multidivisional Company of India's largest and oldest Business House Poddar Group. leader in consulting, App Building, Business Development, and outsourcing solutions. As a proven Enterprises focused on enhancing new trend of technology,Sanmax enables clients in all over india along with European countries to outperform the...

  • Senior Data Scientist

    6 days ago

    Jaipur, Rajasthan, India CIMET Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Purpose Of The PositionWe are looking for a highly experienced Senior Data Scientist with a deep understanding of AI/ML technologies, including Recommendation Systems, Chatbots, Generative AI, and Large Language Models (LLMs). The ideal candidate will have hands-on experience in applying these technologies to solve real-world problems, working with large...

  • Senior DevOps Engineer

    9 hours ago

    Jaipur, Rajasthan, India ListenFirst Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About the OpportunityWe're looking for a senior-level DevOps engineer to lead the design, scaling, and security of our AWS infrastructure. This role is critical for deploying, monitoring, and managing both our applications and critical data workflows. The ideal candidate will have strong computer science fundamentals, deep Linux expertise, and hands-on...