Azure Data Engineer

4 days ago

New Delhi, India Rainier Softech Solutions Pvt Ltd Full time

Sr. Data Engineer (Databricks)About the RoleWe're looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You'll turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you'll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you'll thrive here.Core Qualifications:- Bachelor's degree in computer science, Engineering, or a related field - 7+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark - Strong proficiency in Python, SQL, and PySpark - Deep understanding of AWS and Azure Cloud service - Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt - Solid grasp of data Lakehouse and warehousing architecture - Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support - Familiarity with infrastructure-as-code tools like Terraform or CloudFormation - Strong analytical and troubleshooting skills in a fast-paced, agile environment - Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders - Clear communicator with strong documentation habits - Comfortable leading discussions, offering strategic input, and mentoring othersKey Responsibilities:- The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services - This role will play a pivotal part in enabling the customer's data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability - Partner directly with the customer's data engineering team to design and deliver scalable, cloud-based data solutions - Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights - Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL - Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks - Build ETL/ELT workflows with AWS and Azure Services - Optimize Spark jobs for both performance and cost within the customer's cloud infrastructure - Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization - Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain - Implement CI/CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins - Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation - Troubleshoot and maintain production data pipelines - Provide mentorship and share best practices with both internal and customer teams

  • Azure Data Engineer

    2 weeks ago

    New Delhi, India Mars Data Insights Full time

    Hiring Azure Data Engineer (Azure / MS Fabric / SAP BW/BFC) position in remote locationsSkills: Microsoft Fabric (MS Fabric), SAP BW/BFC Data Integration, Apache Kafka, Azure cloud services, Azure Functions, Docker Containers, and Kafka for real-time data processing, python, DW, Data Gov & Security, data modelling, ETL/ELT processes, and performance tuning,...

  • Azure Data Engineer

    7 days ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS! Job Title: Azure Data Engineer Required Skillset: Azure Databricks, Pyspark, SQL, ADF, Data Lake Location: Kolkata Experience Range: 4-6 yearsJob Description Must-Have**Azure Databricks, Pyspark, SQL, ADFGood To Have: Python, SnowflakeResponsibility of / Expectations from the Role:Analyzing and translating business needs into long-term...

  • Azure Data Engineer

    1 hour ago

    New Delhi, India E-Solutions Full time

    Job Role: Azure Data EngineerLocation: Bangalore, Chennai , Hyderabad Type of Hire: PermanentMust Have Skills :Azure Data Factory, Azure Databricks, Pyspark/Scala, Logic App, Azure SQL, ADLS Gen 2.0, Azure key Vault, T-SQL, Stored Procedure.Data Engineer JD Developing, managing and optimizing robust and reliable data pipelines using azure native...

  • Azure Data Engineer

    2 days ago

    New Delhi, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together.TCS Hiring for skill "ADF, ADB".Role: Azure Data EngineerExperience: 6-8yearsWork Location: New DelhiAbout the Role:We are seeking a highly skilled Data Engineer to join our team...

  • Azure Data Engineer

    1 week ago

    New Delhi, India Wall Street Consulting Services LLC Full time

    Title: Azure Data Engineer Location: Hyderabad Mode of work: Work from Office Type of Work: Full TimeCandidates with 7+ years experience only apply.Job Description: We are seeking an experienced Data Engineer with strong expertise in P&C Insurance data systems or any Insurance background. The ideal candidate will have hands-on experience in Azure Data...

  • Azure Data Engineer

    2 weeks ago

    New Delhi, India Wall Street Consulting Services LLC Full time

    Title: Azure Data EngineerLocation: HyderabadJob Description:Job Description: We are seeking an experienced Data Engineer with strong expertise in Insurance data systems. The ideal candidate will have hands-on experience in Azure Data Platform, ADF (Azure Data Factory), Data Fabric, and data integration/migration projects.Key Responsibilities: Design,...

  • Azure Data Engineer

    5 days ago

    New Delhi, India Wall Street Consulting Services LLC Full time

    Title: Azure Data EngineerLocation: HyderabadJob Description:Job Description:We are seeking an experienced Data Engineer with strong expertise in Insurance data systems. The ideal candidate will have hands-on experience in Azure Data Platform, ADF (Azure Data Factory), Data Fabric, and data integration/migration projects.Key Responsibilities:- Design,...

  • Azure data engineer

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    We await your innovation at TCS: Hiring |Azure Data Engineer|Greetings from TCS!! We are Hiring for Azure Data Engineer Required Experience: 8-12 years Work location: Chennai, BangaloreRequired technical Skills: Azure Data Engineer (ADF / Databrick) & ETL Developer JD: Senior associate with hands-on working experience with Azure tool (primarily ADF/...

  • Azure data engineer

    1 week ago

    New Delhi, India Stratus Full time

    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks Experience with Agile development methodologies and tools, such as Jira, to plan out Program Increments and Sprints Experienced in end-to-end development of data solutions on Azure using Databricks/Snowflake Perform code reviews and...

  • Azure data engineer

    2 weeks ago

    New Delhi, India Stratus Full time

    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure DatabricksExperience with Agile development methodologies and tools, such as Jira, to plan out Program Increments and Sprints Experienced in end-to-end development of data solutions on Azure using Databricks/Snowflake Perform code reviews and...