Azure Data Factory

3 days ago

Bengaluru Karnataka, India Bangalore Strategic Solution Full time

**Job Title: Azure Data Engineer**
- **SQL**: Proficient in writing and optimizing SQL queries for data retrieval, manipulation, and analysis in Azure environments.
- **Azure Data Factory (ADF)**: Design, develop, and implement data pipelines using Azure Data Factory to orchestrate data workflows and automate data integration processes.
- **Azure Databricks**: Utilize Azure Databricks to build scalable and high-performance data processing solutions, leveraging PySpark for data transformation and analysis.
- **PySpark**: Experience with PySpark for data manipulation, data cleansing, and advanced analytics tasks within Azure Databricks environment.

**Responsibilities**:

- Design, develop, and implement data solutions on the Azure platform, leveraging Azure SQL Database, Azure Data Factory, Azure Databricks, and other Azure services.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Develop and optimize SQL queries and scripts to extract, transform, and load data from various sources into Azure Data Lake Storage, Azure SQL Database, and other data repositories.
- Design and implement scalable and efficient data pipelines using Azure Data Factory to orchestrate data movement and transformation workflows.
- Build and maintain data processing jobs using PySpark within Azure Databricks environment for data transformation, cleansing, and analysis tasks.
- Perform data modeling and schema design to support analytical reporting and business intelligence needs.
- Ensure data quality and integrity by implementing data validation and cleansing techniques throughout the data pipeline.
- Monitor and optimize data pipelines for performance, reliability, and cost efficiency in Azure environment.
- Collaborate with data scientists and analysts to support advanced analytics and machine learning initiatives.

**Required Skills and Qualifications**:

- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience as a data engineer with expertise in SQL, Azure Data Factory, Azure Databricks, and PySpark.
- Strong proficiency in writing and optimizing SQL queries.
- Hands-on experience designing and implementing data pipelines using Azure Data Factory.
- In-depth knowledge of Azure Databricks and PySpark for big data processing and analytics.
- Experience with data modeling, schema design, and data warehouse concepts.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect are a plus.

**Job Types**: Full-time, Permanent

**Salary**: ₹500,000.00 - ₹900,000.00 per year

**Benefits**:

- Health insurance

Schedule:

- Day shift

**Experience**:

- total work: 7 years (preferred)

Work Location: In person

  • Azure Data Factory

    1 week ago

    Bengaluru, Karnataka, India Aspire Systems Full time

    India ID asp-001-0724 - Full Time 21/05/2025 **Skill**: ADF **Notice Period**: 30 Days **Skills Required**: - 6-8 years of professional experience in data engineering or a related field. - Profound expertise in SQL,T-SQL, database design, and data warehousing principles. - Strong experience with Microsoft Azure tools including SQL Azure, Azure Data...

  • Azure Data Factory

    1 week ago

    Bengaluru, Karnataka, India Aspire Systems Full time

    India ID asp-007-0125 - Full Time 21/05/2025 **Job Purpose**: We are seeking an experienced Azure Data Factory Engineer for the Design, develop, and maintain robust data pipelines and ETL processes, Implement and optimize data storage solutions in data warehouses and data lakes ,Strong experience with Microsoft Azure tools, including SQL Azure, Azure Data...

  • Azure Data Factory

    1 week ago

    Bengaluru, Karnataka, India Aspire Systems Full time

    India ID - Full Time 30/01/2025 **Job Purpose**: We are seeking an experienced Azure Data Factory Engineer for the Design, develop, and maintain robust data pipelines and ETL processes, Implement and optimize data storage solutions in data warehouses and data lakes ,Strong experience with Microsoft Azure tools, including SQL Azure, Azure Data Factory,...

  • Azure Data Factory Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Azure Data FactoryDescription :We are seeking an experienced Azure Data Factory professional to join our team in India. The ideal candidate will have extensive experience in designing and implementing data pipelines, ensuring high-quality data management, and optimizing data processing workflows. Responsibilities :Design and implement data pipelines using...

  • Azure Data Factory-hyderabad

    5 days ago

    Bengaluru, Karnataka, India Diverse Lynx Full time

    Azure Data Factory-Hyderabad Data Orchestration Create and schedule complex data processing tasks ensuring efficient and automated data movement and transformation Data Integration Transformation Connect to various data sources on-premises cloud files and perform transformations to prepare data for analytical purposes Develop ETL ELT...

  • Azure Data Factory Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    In this role, you will be responsible for designing and implementing efficient data integration workflows using Azure Data Factory. The ideal candidate will have experience in developing ETL ELT pipelines to connect various data sources and perform transformations to prepare data for analytical purposes.Data OrchestrationYou will design, build, and implement...

  • Azure Data Factory

    1 week ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and...

  • Azure Data Factory Developer

    2 weeks ago

    Bengaluru, Karnataka, India Acesoft Labs Full time US$ 90,000 - US$ 1,20,000 per year

    Role & responsibilitiesDesign, develop, and maintain data pipelines using Azure Data FactoryCreate and manage data models in PostgreSQL, ensuring efficient data storage and retrieval.Optimize query performance and database performance in PostgreSQL, including indexing, query tuning, and performance monitoring.Strong knowledge on data modeling and mapping...

  • Senior Azure Data Factory

    7 days ago

    Bengaluru, Karnataka, India SIAGE Solutions Private Limited Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Job Summary:We are seeking a skilledADF Developerwith 5 to 8 years of experience in designing, developing, and maintaining data integration solutions usingAzure Data Factoryand other Azure data services. The ideal candidate should have a strong background in data engineering, ETL/ELT processes, cloud data platforms, and SQL.Experience:5–8...

  • Azure Data Factory, Synapse and SQL

    6 days ago

    Bengaluru, India Mindtree Full time

    Job Requirements: Azure Data Factory, Data Processing, Data Analysis **Job Type**: Full Time **Location**: BANGALORE **Mandatory Skills**: - Azure Data Factory - Synapse and SQL **Years of Experience**: 4 to 8 Years