Azure Data Engineer

3 days ago

Bangalore, India Ekfrazo Technologies Private Limited Full time

Role: Data Engineer Exp: 5 Years+ Location: Remote/Hybrid Work Timing: 2 PM - 10 PM UK Time Zone Immediate Joiners Key Skills: Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing . The ideal candidate must have deep experience with Python , PySpark , Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks) , and SQL-based data modeling . Key Responsibilities 1. Data Pipeline Development Design, develop, and maintain end-to-end ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems . Implement incremental load, CDC (Change Data Capture) , and high-volume data ingestion frameworks. 2. API Data Extraction & Azure Functions Develop Azure Functions (Python) to extract data from REST/SOAP APIs , handle pagination, throttling, and authentication (OAuth2, JWT, API keys). Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines. Parse and transform complex JSON/XML structures. 3. Big Data Processing (PySpark / Databricks) Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations. Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries. Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE. 4. Azure Cloud Data Platform Utilize Azure services such as: Azure Data Lake Storage (ADLS Gen2) Azure Data Factory (ADF) Azure Synapse Analytics (SQL Pool / Serverless SQL) Azure Databricks Azure Key Vault Azure Functions Deploy and manage solutions using CI/CD pipelines with Azure DevOps. 5. Data Modeling & SQL Design and develop data warehouse models (Star Schema, Snowflake). Write advanced SQL queries for transformations, validation, performance tuning. Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server . 6. Data Quality & Governance Implement data validation, profiling, and quality checks. Maintain metadata, lineage, and documentation using appropriate tools. Ensure compliance with security policies, encryption, and access management. Required Technical Skills Core Skills Python (5+ years) PySpark / Spark SQL Azure Cloud (ADF, ADLS, Functions, Synapse, Databricks) REST API integration JSON, XML Parsing SQL (T-SQL / Spark SQL / Synapse SQL) ETL/ELT development Delta Lake

  • Azure Data Engineer

    1 day ago

    Bangalore, India E-Solutions Full time

    Job Role: Azure Data Engineer Location: Bangalore, Chennai , Hyderabad Type of Hire: Permanent Must Have Skills : Azure Data Factory, Azure Databricks, Pyspark/Scala, Logic App, Azure SQL, ADLS Gen 2.0, Azure key Vault, T-SQL, Stored Procedure. Data Engineer JD Developing, managing and optimizing robust and reliable data pipelines using azure native...

  • Azure Data Engineer

    7 days ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data EngineerRequired Skillset: Azure Databricks, Pyspark, SQL, ADF, Data LakeLocation: KolkataExperience Range: 4-6 yearsJob DescriptionMust-Have**Azure Databricks, Pyspark, SQL, ADFGood To Have:Python, SnowflakeResponsibility of / Expectations from the Role:Analyzing and translating business needs into long-term solution...

  • Azure Data Engineer

    20 hours ago

    bangalore, India E-Solutions Full time

    Job Role: Azure Data EngineerLocation: Bangalore, Chennai , HyderabadType of Hire: PermanentMust Have Skills : Azure Data Factory, Azure Databricks, Pyspark/Scala, Logic App, Azure SQL, ADLS Gen 2.0, Azure key Vault, T-SQL, Stored Procedure. Data Engineer JDDeveloping, managing and optimizing robust and reliable data pipelines using azure native...

  • Azure Data Engineer

    4 days ago

    bangalore, India Teamware Solutions Full time

    Greetings From Teamware Solutions We're Hiring – Azure Data Engineer | 6–8 Years Experience We are looking for a highly skilled Azure Data Engineer with strong expertise in Azure Data Factory, PySpark, and Databricks to join our fast-growing data engineering team Location: Chennai / Bangalore / Pune / Hyderabad Experience: 6–8 Years Notice Period:...

  • Azure Data Engineer

    7 days ago

    bangalore, India Wall Street Consulting Services LLC Full time

    Job description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...

  • Azure Data Engineer

    1 week ago

    bangalore, India GSPANN Technologies, Inc Full time

    About the Company: Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 2000+...

  • Azure Data Engineer

    7 days ago

    bangalore, India GSPANN Technologies, Inc Full time

    About the Company: Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 2000+...

  • Azure Data Engineer

    2 weeks ago

    bangalore, India Inumellas Full time

    Position - Azure Data EngineerRole - Data Engineer & Senior Data EngineerExp range - 4 Yrs to 10 YrsPosition Type - Permanent FTELocations - Bengaluru, Chennai, HyderabadCompany - Global Leader in Data Analytics, Cloud and AINotice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec)Skills & Experience:5+ years of overall...

  • Azure Data Engineer

    1 week ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCSJob Title: Azure Data Engineer With DatabricksRequired Skillset: Azure Databricks, SQL, Python, Spark.Location: HYD, Chennai, BLR, Noida, Pune, KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**1. Design, develop, and deploy data processing solutions using Azure Databricks.2. Collaborate with data engineers, architects, and...

  • Azure Data Engineer

    1 week ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data Engineer With DatabricksRequired Skillset: Azure Databricks, SQL, Python, PySpark, ADF, ADB.Location: HYD, Chennai, BLR, Noida, Pune, KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**1. Design, develop, and deploy data processing solutions using Azure Databricks.2. Collaborate with data engineers,...