Azure Data Engineer

24 hours ago

bangalore district, India Ekfrazo Technologies Private Limited Full time

Role: Data Engineer Exp: 5 Years+ Location: Remote/Hybrid Work Timing: 2 PM - 10 PM UK Time Zone Immediate Joiners Key Skills: Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing . The ideal candidate must have deep experience with Python , PySpark , Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks) , and SQL-based data modeling . 🔷 Key Responsibilities 1. Data Pipeline Development Design, develop, and maintain end-to-end ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems . Implement incremental load, CDC (Change Data Capture) , and high-volume data ingestion frameworks. 2. API Data Extraction & Azure Functions Develop Azure Functions (Python) to extract data from REST/SOAP APIs , handle pagination, throttling, and authentication (OAuth2, JWT, API keys). Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines. Parse and transform complex JSON/XML structures. 3. Big Data Processing (PySpark / Databricks) Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations. Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries. Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE. 4. Azure Cloud Data Platform Utilize Azure services such as: Azure Data Lake Storage (ADLS Gen2) Azure Data Factory (ADF) Azure Synapse Analytics (SQL Pool / Serverless SQL) Azure Databricks Azure Key Vault Azure Functions Deploy and manage solutions using CI/CD pipelines with Azure DevOps. 5. Data Modeling & SQL Design and develop data warehouse models (Star Schema, Snowflake). Write advanced SQL queries for transformations, validation, performance tuning. Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server . 6. Data Quality & Governance Implement data validation, profiling, and quality checks. Maintain metadata, lineage, and documentation using appropriate tools. Ensure compliance with security policies, encryption, and access management. 🔷 Required Technical Skills Core Skills Python (5+ years) PySpark / Spark SQL Azure Cloud (ADF, ADLS, Functions, Synapse, Databricks) REST API integration JSON, XML Parsing SQL (T-SQL / Spark SQL / Synapse SQL) ETL/ELT development Delta Lake

  • Azure Data Engineer

    1 week ago

    bangalore district, India Inumellas Full time

    Position - Azure Data Engineer Role - Data Engineer & Senior Data Engineer Exp range - 4 Yrs to 10 Yrs Position Type - Permanent FTE Locations - Bengaluru, Chennai, Hyderabad Company - Global Leader in Data Analytics, Cloud and AI Notice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec) Skills & Experience: 5+ years of...

  • Azure Data Engineer

    6 days ago

    bangalore district, India Rainier Softech Solutions Pvt Ltd Full time

    Sr. Data Engineer (Databricks) About the Role We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark...

  • Azure data engineer

    2 weeks ago

    bangalore district, India Live Connections Full time

    Role: Azure Data Engineer Years of Experience: 5+ years Location: Bangalore Skills: ADF, Synapse, SQL, PySpark

  • Azure Data Engineer

    3 days ago

    hyderabad district, India Wall Street Consulting Services LLC Full time

    Job description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...

  • Azure Data Engineer

    2 weeks ago

    bangalore, India Talent Worx Full time

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    4 days ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data EngineerRequired Skillset: Azure Databricks, Pyspark, SQL, ADF, Data LakeLocation: KolkataExperience Range: 4-6 yearsJob DescriptionMust-Have**Azure Databricks, Pyspark, SQL, ADFGood To Have:Python, SnowflakeResponsibility of / Expectations from the Role:Analyzing and translating business needs into long-term solution...

  • Azure Data Engineer

    24 hours ago

    bangalore, India Teamware Solutions Full time

    Greetings From Teamware Solutions We're Hiring – Azure Data Engineer | 6–8 Years Experience We are looking for a highly skilled Azure Data Engineer with strong expertise in Azure Data Factory, PySpark, and Databricks to join our fast-growing data engineering team Location: Chennai / Bangalore / Pune / Hyderabad Experience: 6–8 Years Notice Period:...

  • Azure Data Engineer

    4 days ago

    bangalore, India Wall Street Consulting Services LLC Full time

    Job description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...

  • Azure Data engineer

    2 weeks ago

    bangalore, India Princeton Software Services Pvt. Ltd. Full time

    We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will work closely with data analysts, scientists, and business stakeholders to ensure efficient data processing, storage, and access. Looking For Banking Domain SectorKey Responsibilities:· Design...

  • Azure data engineer

    2 weeks ago

    bangalore, India Stratus Full time

    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure DatabricksExperience with Agile development methodologies and tools, such as Jira, to plan out Program Increments and SprintsExperienced in end-to-end development of data solutions on Azure using Databricks/SnowflakePerform code reviews and provide...