Thoucentric - Data Engineer - Azure Data Factory
2 weeks ago
Job Description :
We are seeking a skilled Account Technical Resource specializing in Azure Data Factory (ADF) Optimization. This role is pivotal in supporting the optimization challenges between Salesforce and SQL Server as part of our ongoing Distributor migration to Salesforce.
Responsibilities :
1. ADF Optimization : Collaborate with cross-functional teams to optimize data flows within Azure Data Factory, ensuring efficient data processing and transfer between Salesforce and SQL Server.
2. Performance Analysis : Conduct thorough analysis of data flow performance, identifying bottlenecks, and proposing solutions to enhance performance and scalability.
3. Troubleshooting : Investigate and resolve issues related to data flow optimization, ensuring minimal disruption to data warehouse operations.
4. Documentation : Document optimization strategies, best practices, and troubleshooting steps for future reference and knowledge sharing.
5. Technical Support : Provide technical support and guidance to internal teams involved in the Distributor migration project, addressing any ADF optimization-related queries or concerns.
Requirements :
1.Experience : Proven experience in optimizing data flows within Azure Data Factory, particularly in scenarios involving Salesforce and SQL Server integration.
2. Technical Proficiency : Strong understanding of ADF components, activities, and data transformation techniques & Proficiency in SQL Server and Salesforce is highly desirable.
3. Analytical Skills : Ability to analyze complex data flow scenarios, identify performance issues, and propose optimization strategies.
4. Problem-Solving : Excellent problem-solving skills with the ability to troubleshoot and resolve ADF optimization issues efficiently.
5. Communication : Strong verbal and written communication skills with the ability to collaborate effectively with cross-functional teams.
6. Adaptability : Ability to adapt to changing requirements and priorities in a fast-paced environment.
7. Certifications : Any relevant certifications in Azure Data Factory or related technologies would be advantageous.
8. Education : Bachelor's degree in computer science, Engineering, or a related field.
-
Azure Data Factory
2 weeks ago
Mumbai, Maharashtra, India Thoucentric Full timeJob DescriptionAt Thoucentric, we work on various problem statements.The most popular ones are -Building capabilitiesthat address a market need,basis our ongoing research effortsSolving a specific use casefor a current or potential clientbased on challenges on-groundDeveloping new systemsthat help be a better employer and a better partner to clientsAll of...
-
Azure Data Engineer
2 weeks ago
Mumbai/Pune, Maharashtra, India Risk Resources India Full timeJob Description :- Develop and maintain end-to-end data pipelines using Azure data factory for the business requirements on large datasets- Transformation and processing of data using Dataflows/mapping dataflows- Experience working with multiple data sources and building extraction logic with incremental data load- Optimization techniques in reading and...
-
Azure Data Architect
2 days ago
Mumbai, Maharashtra, India HNM Solutions Full timeJob Description :Role : Azure Data ArchitectLocation : MumbaiExperience : 4 to 5 yearsNotice Period : Only Immediate joinerRequirements :We are seeking a highly skilled and experienced Azure Data Architect to join our dynamic team. The ideal candidate will be a problem-solver, a collaborator, and an innovator with a passion for crafting scalable data...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Scalene works Full timeKey Responsibilities Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services. Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse. Developing data models and maintaining data architecture to support data analytics and business...
-
Oneture Technologies
4 weeks ago
Mumbai/Navi Mumbai, Maharashtra, India Oneture Technologies Private Limited Full timeLocation : MumbaiExperience : 1 - 3 yrsTechnologies : SQL, Azure Data Factory (ADF), ETL, Scala, DatabricksAbout The Role :We are looking for a Data Engineer who will be responsible for meeting the reporting and analytics needs of key business functions through development of data pipeline, ETL and data models. We are looking for someone that is a functional...
-
Oneture Technologies
4 weeks ago
Mumbai/Navi Mumbai, Maharashtra, India Oneture Technologies Private Limited Full timeLocation : MumbaiExperience : 1 - 3 yrsTechnologies : SQL, Azure Data Factory (ADF), ETL, Scala, DatabricksAbout The Role :We are looking for a Data Engineer who will be responsible for meeting the reporting and analytics needs of key business functions through development of data pipeline, ETL and data models. We are looking for someone that is a functional...
-
Senior Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Techno Wise Full timeResponsibilities :Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.Optimize and tune existing data pipelines for performance and reliability.Work...
-
Senior Data Analyst
3 weeks ago
Mumbai, Maharashtra, India se Full timeJob Title: Senior Data Analyst. Location: Mumbai, Kurla. Department: Data Science. Job Purpose: The Senior Data Analyst is responsible for conducting strategic analyses and reporting to support key business decisions. This role involves providing impactful insights to CXO and Business Head level stakeholders.Key Responsibilities:- Lead the Data Analytics...
-
Senior Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Firstcareercentre Full timeJob Brief SummarySenior Azure Data EngineeringTotal Experience :5 Years If candidate is good can take 4+ yrs as wellLocation : Mumbai Must have 4 Years of Experience on Python Must have 4 yrs relevant experience on Apache Spark OR PySpark Must have 5 yrs of experience in SQL (Must be proficient in writing Advanced complex queries ) Good to have Airflow...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India John Cockerill Full timeLocation - Mumbai, India Job Purpose As an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment. Key Responsibilities Develop, construct, test, and maintain...
-
Sr Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India White Force Full timeJob Description: Key Responsibilities:1. Design, develop, and deploy scalable data pipelines on the Azure cloud platform using AzureData Factory (ADF).2. Architect end-to-end data solutions to support business requirements and analyticalinsights, with a focus on Databricks (PySpark) for data processing.3. Implement and optimize data processing workflows...
-
Senior Azure Data Engineer
2 months ago
Mumbai, Maharashtra, India Firstcareercentre Full timeJob Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...
-
Senior Azure Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Firstcareercentre Full timeJob Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...
-
Azure Data Engineer
2 days ago
Navi Mumbai/Mumbai/Pune, Maharashtra, India Techno Wise Full timeJob Description :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Fractal Full timeIt's fun to work in a company where people truly BELIEVE in what they are doing RESPONSIBILITIES: • Be an integral part of large scale client business development and delivery engagements • Develop the software and systems needed for end-to-end execution on large projects • Work across all phases of SDLC, and use Software Engineering principles to...
-
RBHU Analytics
4 weeks ago
Mumbai, Maharashtra, India RBHU ETG Private Limited Full timeDescription : We are looking for bright, young engineers with prior knowledge of Power BI development, data-warehousing and ETL.Knowledge Area : - T-SQL, Power-BIResponsibilities : Selected candidates will be responsible for the following :1. Understand requirements given by business users in the retail functional domain.2. Access data stored in Azure Data...
-
RBHU Analytics
2 months ago
Mumbai, Maharashtra, India RBHU ETG Private Limited Full timeDescription : We are looking for bright, young engineers with prior knowledge of Power BI development, data-warehousing and ETL.Knowledge Area : - T-SQL, Power-BIResponsibilities : Selected candidates will be responsible for the following :1. Understand requirements given by business users in the retail functional domain.2. Access data stored in Azure Data...
-
EY - Azure ETL Engineer - Data Warehousing
4 weeks ago
Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full timeAzure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...
-
EY - Azure ETL Engineer - Data Warehousing
2 months ago
Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full timeAzure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India John Cockerill Full timeLocation -Mumbai, IndiaJob PurposeAs an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment.Key ResponsibilitiesDevelop, construct, test, and maintain architectures...