Azure Data Factory

6 months ago


Bengaluru Karnataka, India Bangalore Strategic Solution Full time

**Job Title: Azure Data Engineer**
- **SQL**: Proficient in writing and optimizing SQL queries for data retrieval, manipulation, and analysis in Azure environments.
- **Azure Data Factory (ADF)**: Design, develop, and implement data pipelines using Azure Data Factory to orchestrate data workflows and automate data integration processes.
- **Azure Databricks**: Utilize Azure Databricks to build scalable and high-performance data processing solutions, leveraging PySpark for data transformation and analysis.
- **PySpark**: Experience with PySpark for data manipulation, data cleansing, and advanced analytics tasks within Azure Databricks environment.

**Responsibilities**:

- Design, develop, and implement data solutions on the Azure platform, leveraging Azure SQL Database, Azure Data Factory, Azure Databricks, and other Azure services.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Develop and optimize SQL queries and scripts to extract, transform, and load data from various sources into Azure Data Lake Storage, Azure SQL Database, and other data repositories.
- Design and implement scalable and efficient data pipelines using Azure Data Factory to orchestrate data movement and transformation workflows.
- Build and maintain data processing jobs using PySpark within Azure Databricks environment for data transformation, cleansing, and analysis tasks.
- Perform data modeling and schema design to support analytical reporting and business intelligence needs.
- Ensure data quality and integrity by implementing data validation and cleansing techniques throughout the data pipeline.
- Monitor and optimize data pipelines for performance, reliability, and cost efficiency in Azure environment.
- Collaborate with data scientists and analysts to support advanced analytics and machine learning initiatives.

**Required Skills and Qualifications**:

- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience as a data engineer with expertise in SQL, Azure Data Factory, Azure Databricks, and PySpark.
- Strong proficiency in writing and optimizing SQL queries.
- Hands-on experience designing and implementing data pipelines using Azure Data Factory.
- In-depth knowledge of Azure Databricks and PySpark for big data processing and analytics.
- Experience with data modeling, schema design, and data warehouse concepts.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect are a plus.

**Job Types**: Full-time, Permanent

**Salary**: ₹500,000.00 - ₹900,000.00 per year

**Benefits**:

- Health insurance

Schedule:

- Day shift

**Experience**:

- total work: 7 years (preferred)

Work Location: In person


  • Azure Data Factory

    6 months ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Data Factory**: ****Primary Skill: Microsoft Active Directory, Exchange, O365 & Azure Good hands in the below skills: Migration Planning Infrastructure Assessment User and Group Migration Application and Service Migration Security and Compliance Communication and Training Testing and Validation Documentation

  • Azure Data Factory

    6 months ago


    Bengaluru, India Spout Analytics, Inc Full time

    **Title - Azure Data Factory** **Location - Hyderabad, Chennai and Bangalore** **Duration - Full Time** **Job description**: Specialized in cloud architect for developing solutions for Microsoft Azure cloud - Should have good Azure technical skills - Should have good experience in Azure Data Lake, SQL DB, SQL queries, Databricks, ADF - Good knowledge in...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    We are seeking an experienced Azure Data Factory Architect to join our team at NR Consulting - India.About the RoleThe successful candidate will be responsible for designing and developing technologies for data loads, extracts, and utilities using 9-12 years of experience in SQL and Azure Data Factory.Key responsibilities include creating complex SQL...

  • Azure Data Factory

    3 weeks ago


    Bengaluru / Bangalore, Pune, India Anlage Infotech India Private Limited Full time

    Responsibilities - AZUREYou are an expert in Azure Data Analytics having thorough understanding of Azure Data Platform tools.Expertise and hands on experience in at least 4 tools on Azure Platform among: Data Factory, Data Bricks, Synapse, Data Lake Gen2, Stream Analytics, Azure Spark, Azure ML.Expertise in SQL Server DB, Cosmos DB.Collaborate with project...

  • Azure Data Factory

    6 months ago


    Bengaluru, Karnataka, India Thoucentric Full time

    **About us**: **Thoucentric is the Consulting arm of Xoriant**, a prominent digital engineering services company with 5000+ employees. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally. As the Consulting business of **Xoriant**, We help clients with Business Consulting, Program &...

  • Data Engineer

    3 months ago


    Bengaluru, India PyjamaHR Full time

    Key Responsibilities : - Design and deliver scalable data solutions using Azure Data services. - Develop and implement data ingestion and transformation pipelines for large-scale environments. - Build data solutions using a wide range of tools and Azure services. - Collaborate on proof-of-concept development and production implementation. - Meet tight...

  • Azure Data Factory

    2 months ago


    Bengaluru, India Maneva Consulting Pvt. Ltd Full time

    GreetingsfromManeva! JobDescription JobTitle Azure DataFactory LocationBangalore Experience5 10 Years NoticeImmediateJoiner Requirements: Min 5years in ADFProficiency in AzureData Factory Databricks and AzureSynapse.Strong SQL ss andexperience with DeltaLake.Expertise in datamodelling particularly Data Vault2.Experience withscripting languages such as...

  • Azure Data Factory

    4 months ago


    Bengaluru, Karnataka, India Yash Technologies Full time

    Date: Aug 21, 2024- Job Requisition Id: 58316- Location: Hyderabad, TG, IN Bangalore, KA, IN Indore, IN Indore, MP, IN Bangalore, KA, IN Hyderabad, TG, IN Indore, MP, IN Indore, IN Hyderabad, IN Indore, MP, IN, 452001 Hyderabad, INYASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance...

  • Azure Data Factory

    3 months ago


    Kalyananagar, Bengaluru, Karnataka, India Kalpita Technologies Pvt Ltd Full time

    **J*ob **Description :* As an architect we expect minimum of 2 to 3 end to end architecture implementations. Responsibilities: - Design and develop appropriate technologies for fulfilling user requirement for data loads, extracts, data dumps, and other utilities - Write complex SQL statement for large scale database reports - Proficiency in **Azure Data...

  • Senior Data Engineer

    3 months ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with extensive experience in Azure Data Factory (ADF) and Snowflake. The ideal candidate will have a strong background in data warehousing, ETL processes, and cloud platforms, particularly Azure. The role involves working with US-based clients and requires excellent technical and...

  • Data Engineer

    2 months ago


    Bengaluru, India Element Infomatics (India) Pvt. Ltd. Full time

    Position : Data Engineer Job Description :- Develop and maintain data pipelines using ADF for data extraction, transformation, and loading (ETL).- Manage data warehousing solutions on Azure, optimizing storage and performance.- Utilize Azure services like Azure Data Factory and Azure Databricks or snowflake for data processing.- Create and maintain data...


  • Bengaluru, India HR Full time

    Key Responsibilities :Azure Data Lake Development :- Design and develop scalable and efficient data storage solutions using Azure Data Lake Gen1/Gen2.- Implement data ingestion, transformation, and processing pipelines.Data Integration and Management :- Develop and maintain ETL processes using Azure Data Factory (ADF).- Integrate structured, semi-structured,...


  • Bengaluru, India Capgemini Full time

    Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - ADF (Azure Data Factory) OR - ADB ( Azure...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure DevOps + Data Lake**: **Primary Skills: Azure DevOps, CI/CD, Azure Data Factory, Data Lake, Azure Kubernetes Services.** **Secondary Skills: Terraform, Scripting, Agile.** Experience: 7+ Years Excellent communication skills Good experience in setting up end-to-end CI/CD using Azure DevOps ( components such as web app, function app,...

  • Azure Data Engineer

    6 months ago


    Bengaluru, Karnataka, India DigitalCube Consultancy Full time

    **Azure Data Engineer** **Job Type - Full time** **Location - Bangalore/ Mumbai, India** **Responsibilities**: - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and...

  • Associate Architect

    3 months ago


    Bengaluru, India Kalpita Technologies Private Limited Full time

    Job Description : We are looking for associate architect or architect position in azure data factory (ADF).About us :Kalpita is an outcome-focused, core IT company aimed at delivering unique, reliable, and innovative software solutions to small and large businesses using an agile approach to rapid software delivery. We harbor a team of sharp problem Solvers...

  • Azure

    6 months ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: Azure Databricks & Data Factory Exp : 3-10years Good to have: Azure Data Factory, Data Lake, Synapse DB, Azure Databricks, Python, pyspark, SQL / RDBMS Data base development Domain : Manufacturing domain experience Azure Ecosystem - Azure Functions, Cosmos DB, RDBMS Development, App Insights and Log Analytics etc., DevOps - Qualifications :BACHELOR OF...

  • Project Lead

    3 months ago


    Bengaluru, India Axtria - Ingenious Insights Full time

    Axtria:-Axtria is a global provider of award-winning cloud software and data analytics to the life sciences industry. Axtria enables life sciences organizations to transform the product commercialization journey and deliver much-improved healthcare outcomes for patients worldwide. We are acutely aware that our work impacts millions of people and are...


  • Bengaluru, Karnataka, India Virtusa Full time

    Experience in ADF (Azure Data Factory) Experience in SQL Server Exp in writing complex stored procedures Exp in database designing and solutioning Performance Improvements Experience in ETL tool - SSIS. In depth knowledge of SSIS Experience in creating complex SSIS packages **About Virtusa** Teamwork, quality of life, professional and personal...

  • Azure Data Architect

    6 months ago


    Bengaluru, Karnataka, India Skillety Technologies Full time

    **Job Description**: Role: Azure Data Architect with streaming experience Job description Total experience in data management area for 10 + years with Azure cloud data platform experience Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & mandatory expertise on Azure...