Azure Data Engineer

4 weeks ago

Gurgaon, Haryana, India AceNet Full time

About Us :

AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors.

We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you're passionate about technology and thrive in a fast-paced environment, we want to hear from you.

Job Summary :

We are seeking a skilled and innovative Data Engineer to join our team. In this role, you will design and implement scalable data pipelines and architectures that empower our organization to make data-driven decisions. You'll work closely with cross-functional teams to ensure the reliability, security, and efficiency of our data systems.

Key Responsibilities :

1.Staging Layer Development :

- Create and Manage Staging Layers : Design efficient staging tables for preliminary data storage.

- Historical and Incremental Data Loads : Implement strategies for managing both historical and incremental data loads using Azure Synapse SQL pools and other relevant tools.

- Performance Optimization : Optimize data load processes to ensure minimal impact on system performance.

2. Data Quality Management :

- Data Quality Checks : Develop and implement robust data quality checks using custom scripts or data quality tools.

- Source & Master Mapping : Develop source-to-target mapping documents and master data mapping in the silver layer.

- Data Profiling : Conduct detailed data profiling and data anomaly detection.

3. Operational Data Store (ODS) Layer Development :

- Design and Implementation : Architect and impleme nt the ODS layer using Azure Synapse Analytics.

- Integration : Integrate ODS with diverse data sources ensuring real-time and batch processing capabilities.

- Refresh Strategies : Develop strategies for refreshing data within the ODS layer.

4. Gold Layer Development :

- Business-Critical Data Handling : Design the gold layer for high-value, business-critical data using Azure Synapse dedicated SQL pools.

- Aggregation & Calculation : Implement complex aggregations and calculations in the gold layer.

- Performance Tuning : Continuously monitor and tune performance for optimal query execution.

5. Architecture Implementation :

- Medallion Architecture : Design and implement data solutions adhering to the Medallion Architecture principles for reliable and scalable data lakes.

- Microsoft Fabric & Azure Synapse Integration : Integrate Microsoft Fabric services with Azure Synapse environments.

- Delta Lakehouse Implementation : Utilize Delta Lake for building scalable and fault-tolerant data lakehouses.

6. Data Engineering Solutions :

- Business Data Model Implementation : Translate business data models into robust data engineering solutions using Azure Synapse, Azure Data Factory, and other Azure data services.

- Workflow Orchestration : Orchestrate complex data workflows ensuring data consistency and reliability.

7. Data Warehouse & Data Lake Creation :

- Data Warehouse Design : Design and build data warehouses leveraging Azure Synapse Analytics.

- Data Lake Construction : Construct and manage data lakes and delta lakehouses for seamless data integration and storage.

- Compliance & Security : Ensure data solutions adhere to compliance and security best practices.

Role Requirements and Qualifications :

- Bachelor's degree in Computer Science, Data Engineering, or a related field.

- Proficiency in programming languages like Python, Java, or Scala.

- Experience with data processing frameworks (e.g., Apache Spark, Kafka).

- Strong knowledge of database systems (e.g., PostgreSQL, MySQL, MongoDB).

- Familiarity with cloud platforms (AWS, Azure, or GCP) and their data services.

- Excellent problem-solving and communication skills.

Why Join Us :

- Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.

- Continuous investment in employee growth and professional development with a strong focus on up & re-skilling.

- Competitive compensation & benefits, ESOPs and international assignments.

- Supportive environment with healthy work-life balance and a focus on employee well-being.

- Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.

(ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Impetus Career Consultants Private Limited Full time

    We are hiring for one of the IT product-based company. Location : Pune/Gurgaon/Noida. Work Mode : Hybrid. Exp - 1-6 Years. Required Skills and Qualifications : Technical Expertise : - Strong experience with Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse, Azure Databricks, and Azure Functions. - Proficiency...

  • Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Absolutdata Full time

    Location : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development etc. ...

  • Azure Data Engineers

    3 weeks ago

    Gurgaon, Haryana, India NETSACH GLOBAL Full time

    Greetings from Netsach.We are looking for resource who have strong experience in Azure Data Engineers with 5-7 years' experience. This is a 1yr contract + extension. Candidate must have relevant working exp in Azure Data Factory, Spark concept, Python, Shell Scripting, Pyspark, Synapse Cosmos DB. Real Time Streaming is mandatory. Job Title: Azure Data...

  • azure data engineer

    3 weeks ago

    Gurgaon, Haryana, India Michael Page Full time

    Fast track growth & PnL ownership Handling multiple clients About Our Client Our client is a renowned GCC in the consumer goods section. Job Description Bachelor's degree in Computer Engineering, Computer Science or related discipline, Master's Degree preferred. 7+ years of ETL design, development, and performance tuning using ETL tools such as...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Cognitio Analytics Inc Full time

    Job Title: Azure Data Engineer Education Qualification: • Bachelor's degree in a Quantitative field or relevant Graduate degree. • 3+ years of experience in a related role. Key Responsibilities: 1. Cloud Platform Expertise: o Proficient with Microsoft Azure and its services including: Azure Storage Azure Open AI Azure Key Vault 2. Azure...

  • Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Cognitio Analytics Inc Full time

    Job Title: Azure Data Engineer Requirements: Obtain a Bachelor's degree in a Quantitative field or equivalent Graduate degree. Gain 3+ years of experience in a related role. Main Responsibilities: 1. Cloud Platform Expertise: a. Microsoft Azure Proficiency: Azure Storage, Azure Open AI, and Azure Key Vault expertise required. b. Azure Databricks...

  • Lead Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India T D Newton Full time

    Urgent requirement for Lead Azure Data Engineer for Gurgaon and Thane Location.Experience- 8-13 YrsJob Location- Gurgaon/ ThaneJob Description:- A Bachelor's/College Degree would be beneficial and extensive experience in a technology related discipline, such as IT or Engineering is required.- 8+ years' experience as a Data Engineer.- Basic understanding of...

  • Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Cognitio Analytics Inc Full time

    Job Title: Azure Data EngineerEducation Qualification:• Bachelor's degree in a Quantitative field or relevant Graduate degree.• 3+ years of experience in a related role.Key Responsibilities:1. Cloud Platform Expertise:o Proficient with Microsoft Azure and its services including: Azure Storage Azure Open AI Azure Key Vault2. Azure Databricks Proficiency:o...

  • Azure Data Engineer-2

    3 weeks ago

    Gurgaon, Haryana, India Axalta Full time

    Description : Axalta has remained at the forefront of the coatings industry by continually investing in innovative solutions. We engineer technologies that protect customers' products – whether they are battling heat, light, corrosion, abrasion, moisture, or chemicals – and add dimension and beauty with colourful finishes. We have a vast and...

  • Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Capgemini Full time

    Job Description Strong experience on SSAS Tabular Model, DAX queries & query optimization, resolving performance issues, database tuning and data replication techniques with Microsoft SQL Server. Strong background with Stored Procedures, Functions, Triggers, Views & Data warehousing(Clear on the concepts of creating Facts, dims etc.) Must have...

  • Azure Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Absolutdata Full time

    Experience : 3-6 years Job location : Gurgaon As a Data Engineer, you will: Identify data sets required per Use Case in collaboration with Source Teams and BusinessAnalysts Onboard data in the Enterprise Data Lake Move and transform data from Data Lake to SQL DB or SQL DW as required per Use Case. Implement logic as per business requirements...

  • Azure - Data Architect/Senior Engineer

    3 weeks ago

    Gurgaon, Haryana, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doingJOB DESCRIPTION: If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Engineer -Azure, you will work in the Technology team that helps deliver our Data...

  • Azure Cloud Data Solutions Expert

    1 day ago

    Gurgaon, Haryana, India EXL IT service management Full time

    Job SummaryEXL IT Service Management is seeking an Azure Cloud Data Solutions Expert to lead the design, development, and implementation of scalable data engineering solutions using PySpark, Databricks, and Azure. The ideal candidate will have 5+ years of experience in data engineering, with a strong understanding of cloud architecture and DevOps...

  • Electrical Design Engineer

    4 weeks ago

    Gurgaon, Haryana, India Azure Power Full time

    Perform PVsyst simulations to assess plant performance and energy output for the operational portfolio, bidding processes, resource assessments, and technology selection.Maintaining the Solar Resource Database of the companyConduct due diligence and evaluate various technologies for PV modules and inverters.Prepare DC calculations to optimize system...

  • Azure Integration Services Engineer

    3 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    Azure Integration Services Engineer (Senior) with skills Data Engineering, Python, postgreSQL Development, ETL, Microsoft SSIS, Apache Spark, Azure Data Factory for location Gurugram, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Core Skills Extensive experience with Azure Integration...

  • Data Engineers

    1 week ago

    Gurgaon, Haryana, India ScaleneWorks Full time

    Roles and Responsibilities ? Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization. ? The Lead Data Engineer will be responsible for designing and overseeing the implementation of data architectures using Microsoft Azure...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Summary We are seeking a seasoned data engineer with expertise in modern cloud-based technologies to join our team. The ideal candidate will have at least 5 years of experience in designing and implementing data warehouses, lakes, and engineering solutions on Azure, AWS, GCP, and Data Bricks. About the Role Minimum 5 years of experience in modern data...

  • Azure Engineer II

    3 weeks ago

    Gurgaon, Haryana, India Rackspace Full time

    Job Title: Azure Engineer III Skills : Azure Location : India Remote Experience : 6+ Yrs. of relevant exp.Position Summary:We are seeking a skilled and experienced Senior Azure Level III Engineer to join our dynamic team. The ideal candidate will have strong expertise in Azure cloud technologies, with a focus on Azure VMs, Logic Apps, and monitoring...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Cognitio Analytics Inc Full time

    Cognitio Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized as a "Great...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...