Thoucentric - Data Engineer - Azure Data Factory

2 weeks ago


Mumbai, Maharashtra, India Thoucentric Full time

Job Description :

We are seeking a skilled Account Technical Resource specializing in Azure Data Factory (ADF) Optimization. This role is pivotal in supporting the optimization challenges between Salesforce and SQL Server as part of our ongoing Distributor migration to Salesforce.

Responsibilities :

1. ADF Optimization : Collaborate with cross-functional teams to optimize data flows within Azure Data Factory, ensuring efficient data processing and transfer between Salesforce and SQL Server.

2. Performance Analysis : Conduct thorough analysis of data flow performance, identifying bottlenecks, and proposing solutions to enhance performance and scalability.

3. Troubleshooting : Investigate and resolve issues related to data flow optimization, ensuring minimal disruption to data warehouse operations.

4. Documentation : Document optimization strategies, best practices, and troubleshooting steps for future reference and knowledge sharing.

5. Technical Support : Provide technical support and guidance to internal teams involved in the Distributor migration project, addressing any ADF optimization-related queries or concerns.

Requirements :

1.Experience : Proven experience in optimizing data flows within Azure Data Factory, particularly in scenarios involving Salesforce and SQL Server integration.

2. Technical Proficiency : Strong understanding of ADF components, activities, and data transformation techniques & Proficiency in SQL Server and Salesforce is highly desirable.

3. Analytical Skills : Ability to analyze complex data flow scenarios, identify performance issues, and propose optimization strategies.

4. Problem-Solving : Excellent problem-solving skills with the ability to troubleshoot and resolve ADF optimization issues efficiently.

5. Communication : Strong verbal and written communication skills with the ability to collaborate effectively with cross-functional teams.

6. Adaptability : Ability to adapt to changing requirements and priorities in a fast-paced environment.

7. Certifications : Any relevant certifications in Azure Data Factory or related technologies would be advantageous.

8. Education : Bachelor's degree in computer science, Engineering, or a related field.

(ref:hirist.tech)
  • Azure Data Factory

    2 weeks ago


    Mumbai, Maharashtra, India Thoucentric Full time

    Job DescriptionAt Thoucentric, we work on various problem statements.The most popular ones are -Building capabilitiesthat address a market need,basis our ongoing research effortsSolving a specific use casefor a current or potential clientbased on challenges on-groundDeveloping new systemsthat help be a better employer and a better partner to clientsAll of...

  • Azure Data Engineer

    2 weeks ago


    Mumbai/Pune, Maharashtra, India Risk Resources India Full time

    Job Description :- Develop and maintain end-to-end data pipelines using Azure data factory for the business requirements on large datasets- Transformation and processing of data using Dataflows/mapping dataflows- Experience working with multiple data sources and building extraction logic with incremental data load- Optimization techniques in reading and...


  • Mumbai, Maharashtra, India HNM Solutions Full time

    Job Description :Role : Azure Data ArchitectLocation : MumbaiExperience : 4 to 5 yearsNotice Period : Only Immediate joinerRequirements :We are seeking a highly skilled and experienced Azure Data Architect to join our dynamic team. The ideal candidate will be a problem-solver, a collaborator, and an innovator with a passion for crafting scalable data...

  • Azure Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Scalene works Full time

    Key Responsibilities Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services. Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse. Developing data models and maintaining data architecture to support data analytics and business...

  • Oneture Technologies

    4 weeks ago


    Mumbai/Navi Mumbai, Maharashtra, India Oneture Technologies Private Limited Full time

    Location : MumbaiExperience : 1 - 3 yrsTechnologies : SQL, Azure Data Factory (ADF), ETL, Scala, DatabricksAbout The Role :We are looking for a Data Engineer who will be responsible for meeting the reporting and analytics needs of key business functions through development of data pipeline, ETL and data models. We are looking for someone that is a functional...

  • Oneture Technologies

    4 weeks ago


    Mumbai/Navi Mumbai, Maharashtra, India Oneture Technologies Private Limited Full time

    Location : MumbaiExperience : 1 - 3 yrsTechnologies : SQL, Azure Data Factory (ADF), ETL, Scala, DatabricksAbout The Role :We are looking for a Data Engineer who will be responsible for meeting the reporting and analytics needs of key business functions through development of data pipeline, ETL and data models. We are looking for someone that is a functional...


  • Mumbai, Maharashtra, India Techno Wise Full time

    Responsibilities :Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.Optimize and tune existing data pipelines for performance and reliability.Work...

  • Senior Data Analyst

    3 weeks ago


    Mumbai, Maharashtra, India se Full time

    Job Title: Senior Data Analyst. Location: Mumbai, Kurla. Department: Data Science. Job Purpose: The Senior Data Analyst is responsible for conducting strategic analyses and reporting to support key business decisions. This role involves providing impactful insights to CXO and Business Head level stakeholders.Key Responsibilities:- Lead the Data Analytics...


  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience :5 Years If candidate is good can take 4+ yrs as wellLocation : Mumbai Must have 4 Years of Experience on Python Must have 4 yrs relevant experience on Apache Spark OR PySpark Must have 5 yrs of experience in SQL (Must be proficient in writing Advanced complex queries ) Good to have Airflow...

  • Azure Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India John Cockerill Full time

    Location - Mumbai, India Job Purpose As an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment. Key Responsibilities Develop, construct, test, and maintain...


  • Mumbai, Maharashtra, India White Force Full time

    Job Description: Key Responsibilities:1. Design, develop, and deploy scalable data pipelines on the Azure cloud platform using AzureData Factory (ADF).2. Architect end-to-end data solutions to support business requirements and analyticalinsights, with a focus on Databricks (PySpark) for data processing.3. Implement and optimize data processing workflows...


  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...


  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...

  • Azure Data Engineer

    2 days ago


    Navi Mumbai/Mumbai/Pune, Maharashtra, India Techno Wise Full time

    Job Description :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Azure Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing RESPONSIBILITIES: • Be an integral part of large scale client business development and delivery engagements • Develop the software and systems needed for end-to-end execution on large projects • Work across all phases of SDLC, and use Software Engineering principles to...

  • RBHU Analytics

    4 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Description : We are looking for bright, young engineers with prior knowledge of Power BI development, data-warehousing and ETL.Knowledge Area : - T-SQL, Power-BIResponsibilities : Selected candidates will be responsible for the following :1. Understand requirements given by business users in the retail functional domain.2. Access data stored in Azure Data...

  • RBHU Analytics

    2 months ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Description : We are looking for bright, young engineers with prior knowledge of Power BI development, data-warehousing and ETL.Knowledge Area : - T-SQL, Power-BIResponsibilities : Selected candidates will be responsible for the following :1. Understand requirements given by business users in the retail functional domain.2. Access data stored in Azure Data...


  • Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

    Azure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...


  • Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

    Azure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...

  • Azure Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India John Cockerill Full time

    Location -Mumbai, IndiaJob PurposeAs an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment.Key ResponsibilitiesDevelop, construct, test, and maintain architectures...