Azure Data Engineer
4 days ago
Role: Data EngineerExp: 5 Years+Location: Remote/HybridWork Timing: 2 PM - 10 PM UK Time ZoneImmediate JoinersKey Skills: Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQLWe are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing. The ideal candidate must have deep experience with Python, PySpark, Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks), and SQL-based data modeling.🔷 Key Responsibilities1. Data Pipeline DevelopmentDesign, develop, and maintain end-to-end ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark.Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems.Implement incremental load, CDC (Change Data Capture), and high-volume data ingestion frameworks.2. API Data Extraction & Azure FunctionsDevelop Azure Functions (Python) to extract data from REST/SOAP APIs, handle pagination, throttling, and authentication (OAuth2, JWT, API keys).Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines.Parse and transform complex JSON/XML structures.3. Big Data Processing (PySpark / Databricks)Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations.Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries.Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE.4. Azure Cloud Data PlatformUtilize Azure services such as:Azure Data Lake Storage (ADLS Gen2)Azure Data Factory (ADF)Azure Synapse Analytics (SQL Pool / Serverless SQL)Azure DatabricksAzure Key VaultAzure FunctionsDeploy and manage solutions using CI/CD pipelines with Azure DevOps.5. Data Modeling & SQLDesign and develop data warehouse models (Star Schema, Snowflake).Write advanced SQL queries for transformations, validation, performance tuning.Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server.6. Data Quality & GovernanceImplement data validation, profiling, and quality checks.Maintain metadata, lineage, and documentation using appropriate tools.Ensure compliance with security policies, encryption, and access management.🔷 Required Technical SkillsCore SkillsPython (5+ years)PySpark / Spark SQLAzure Cloud (ADF, ADLS, Functions, Synapse, Databricks)REST API integrationJSON, XML ParsingSQL (T-SQL / Spark SQL / Synapse SQL)ETL/ELT developmentDelta Lake
-
Azure Data Engineer
1 day ago
Bangalore, India E-Solutions Full timeJob Role: Azure Data Engineer Location: Bangalore, Chennai , Hyderabad Type of Hire: Permanent Must Have Skills : Azure Data Factory, Azure Databricks, Pyspark/Scala, Logic App, Azure SQL, ADLS Gen 2.0, Azure key Vault, T-SQL, Stored Procedure. Data Engineer JD Developing, managing and optimizing robust and reliable data pipelines using azure native...
-
Azure Data Engineer
7 days ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCS!Job Title: Azure Data EngineerRequired Skillset: Azure Databricks, Pyspark, SQL, ADF, Data LakeLocation: KolkataExperience Range: 4-6 yearsJob DescriptionMust-Have**Azure Databricks, Pyspark, SQL, ADFGood To Have:Python, SnowflakeResponsibility of / Expectations from the Role:Analyzing and translating business needs into long-term solution...
-
Azure Data Engineer
20 hours ago
bangalore, India E-Solutions Full timeJob Role: Azure Data EngineerLocation: Bangalore, Chennai , HyderabadType of Hire: PermanentMust Have Skills : Azure Data Factory, Azure Databricks, Pyspark/Scala, Logic App, Azure SQL, ADLS Gen 2.0, Azure key Vault, T-SQL, Stored Procedure. Data Engineer JDDeveloping, managing and optimizing robust and reliable data pipelines using azure native...
-
Azure Data Engineer
4 days ago
bangalore, India Teamware Solutions Full timeGreetings From Teamware Solutions We're Hiring – Azure Data Engineer | 6–8 Years Experience We are looking for a highly skilled Azure Data Engineer with strong expertise in Azure Data Factory, PySpark, and Databricks to join our fast-growing data engineering team Location: Chennai / Bangalore / Pune / Hyderabad Experience: 6–8 Years Notice Period:...
-
Azure Data Engineer
7 days ago
bangalore, India Wall Street Consulting Services LLC Full timeJob description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...
-
Azure Data Engineer
1 week ago
bangalore, India GSPANN Technologies, Inc Full timeAbout the Company: Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 2000+...
-
Azure Data Engineer
7 days ago
bangalore, India GSPANN Technologies, Inc Full timeAbout the Company: Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 2000+...
-
Azure Data Engineer
3 days ago
Bangalore, India Ekfrazo Technologies Private Limited Full timeRole: Data Engineer Exp: 5 Years+ Location: Remote/Hybrid Work Timing: 2 PM - 10 PM UK Time Zone Immediate Joiners Key Skills: Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building...
-
Azure Data Engineer
2 weeks ago
bangalore, India Inumellas Full timePosition - Azure Data EngineerRole - Data Engineer & Senior Data EngineerExp range - 4 Yrs to 10 YrsPosition Type - Permanent FTELocations - Bengaluru, Chennai, HyderabadCompany - Global Leader in Data Analytics, Cloud and AINotice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec)Skills & Experience:5+ years of overall...
-
Azure Data Engineer
1 week ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCSJob Title: Azure Data Engineer With DatabricksRequired Skillset: Azure Databricks, SQL, Python, Spark.Location: HYD, Chennai, BLR, Noida, Pune, KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**1. Design, develop, and deploy data processing solutions using Azure Databricks.2. Collaborate with data engineers, architects, and...
