Azure Data Engineer

2 months ago

Bangalore, India Kiash Solutions LLp Full time

Job Description :


Skills Required :


- Azure : Strong experience working with Microsoft Azure cloud platform, including services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Azure HDInsight.


- ETL Tools : Proficiency in designing, developing, and maintaining ETL (Extract, Transform, Load) processes using Azure Data Factory or similar ETL tools to ingest and process data from various sources into Azure data services.


- Azure Databricks : Experience in using Azure Databricks for big data processing and analytics tasks, including data exploration, data engineering, and machine learning workflows. Familiarity with Databricks notebooks and Spark jobs optimization.


- PySpark : Strong expertise in PySpark, the Python API for Apache Spark, for distributed data processing and analytics. Ability to write efficient PySpark code for data transformations, aggregations, and analytics tasks.


- Power BI (Good to have): Familiarity with Microsoft Power BI for data visualization and reporting. Ability to create interactive dashboards, reports, and data visualizations to provide insights into the data processed and stored in Azure.


Responsibilities :


- Data Engineering : Design and implement end-to-end data engineering solutions on Azure, including data ingestion, transformation, and loading processes using Azure Data Factory, Azure Databricks, and other Azure data services.


- ETL Development : Develop and optimize ETL pipelines to extract data from various sources, transform it according to business requirements, and load it into Azure data stores such as Azure Data Lake Storage and Azure SQL Database.


- Data Processing : Utilize Azure Databricks and PySpark for distributed data processing tasks such as data cleansing, enrichment, aggregation, and analysis on large-scale datasets stored in Azure.


- Data Modeling : Design and implement data models and schemas to support data analytics and reporting requirements. Optimize data structures for efficient querying and analytics performance.


- Performance Optimization : Optimize PySpark jobs and Databricks notebooks for performance and scalability. Identify and resolve performance bottlenecks in data processing workflows.


- Data Governance and Security : Ensure data governance and compliance requirements are met by implementing appropriate data security, encryption, and access control mechanisms in Azure data solutions.


- Monitoring and Maintenance : Monitor the performance and health of Azure data solutions, troubleshoot issues, and perform routine maintenance tasks such as data backup and recovery.


- Collaboration : Collaborate with cross-functional teams including data scientists, business analysts, and software developers to understand data requirements and deliver data-driven solutions.


- Documentation : Document technical designs, data pipelines, and implementation details for Azure data solutions. Maintain up-to-date documentation for reference and knowledge sharing.


- Continuous Learning : Stay updated with the latest Azure services, best practices, and industry trends in data engineering and analytics. Continuously enhance technical skills through training and self-learning.

(ref:hirist.tech)

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    7 days ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Azure Data Engineer

    3 days ago

    bangalore, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    2 months ago

    bangalore, India Nityo Infotech Full time

    Business Intelligence , C , Engineering , Integration , Java , SQL , A , AWS , Achieve , Activities , Adaptability , Agile , Analysis , Analysis Services , Analytic , Analytics , Approach , Automation , Azure , Backgrounds , Bangalore , Based , Belgium , Building , Building Trust , Business , Business Intelligence , Business Requirements , C , CO , CTS ,...

  • Azure Data Engineer

    2 months ago

    Bangalore, India Visara Full time

    Job Description : We are seeking a highly skilled and dynamic Data Engineering Analyst to join our forward-thinking data engineering team. In this pivotal role, you will be at the heart of our data-driven initiatives, leveraging the power of Azure Databricks to drive business transformation and insights. As a key member of our team, you will bridge the gap...

  • Azure Data Engineer

    2 weeks ago

    bangalore, India Torry Harris Integration Solutions Full time

    Job TitleAzure Data EngineerJob LocationBangalore, Karnataka, IndiaJob DescriptionImplement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements.Collaborate with cross-functional teams to implement solutions that meet business requirements.Developing and maintaining data lake using Data bricks and data...

  • Azure Data engineer

    4 weeks ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...

  • Azure Data engineer

    1 month ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks Lead Location: Bangalore/Mumbai/Pune/Noida Company Description: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run...

  • Azure Data Engineer

    2 weeks ago

    bangalore, India Torry Harris Integration Solutions Full time

    Job Title Azure Data Engineer Job Location Bangalore, Karnataka, India Job Description Implement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements. Collaborate with cross-functional teams to implement solutions that meet business requirements. Developing and maintaining data lake using Data bricks and...

  • Azure Data Engineer

    1 week ago

    bangalore, India Arus Info Full time

    Position: Azure Data EngineerEmployment Type: Full-timeLocation: Bangalore or MalaysiaAbout Arus:Software services organization specialized in Application Integration, ERP Implementations, Data Engineering, Analytics and Data Science. We, at Arus, aspires to inspire customers through well-crafted software engineering solutions that lays the foundation to...

  • Azure Data Engineer/Senior Azure Data Engineer

    2 months ago

    bangalore, India Saaki Argus & Averil Consulting Full time

    About the Client: Our client is focused on AI and Analytics. Skills and Qualifications: Bachelors or Masters degree in computer science or equivalent 4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft Azure Hands on experience in SQL, python and Spark (pyspark), Big Data. Experience in Azure Databricks, Azure...

  • Aptus Data Labs

    1 week ago

    Mumbai/Bangalore/Hyderabad, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services Role : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Azure Data Engineer

    4 days ago

    bangalore, India Alp Consulting Limited Full time

    Must-Have 5+ years in a data engineer role using service and hosting solutions such as private/public cloud PaaS platforms. Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features. Design and configuration of data...

  • Azure Data Engineer

    4 weeks ago

    bangalore, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Azure Data Engineer

    2 weeks ago

    Bangalore Urban, India Torry Harris Integration Solutions Full time

    Job TitleAzure Data EngineerJob LocationBangalore, Karnataka, IndiaJob DescriptionImplement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements.Collaborate with cross-functional teams to implement solutions that meet business requirements.Developing and maintaining data lake using Data bricks and data...

  • Azure Data Engineer

    2 months ago

    bangalore, India Connectio IT Pvt Ltd Full time

    Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...

  • Azure Data Engineer

    1 month ago

    Bangalore, India Connectio IT Pvt Ltd Full time

    Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...

  • Azure Data Engineer

    4 weeks ago

    bangalore, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Data Engineer

    2 months ago

    bangalore, India Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...

  • Azure Data Architect/ Data Engineer with Databricks

    4 weeks ago

    bangalore, India MNC Full time

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India :Experience: 5 - 12 YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data BricksTechnical/Functional Skills -MUST HAVE SKILLS · The Engineer with...

  • Azure Data Engineer

    2 months ago

    Bangalore, India Orange Shark Full time

    Position : Azure Data EngineerExperience : 6-10 Years Notice Period : Immediate to 15 Days Location : Bangalore. Primary Skills : Azure, DevOps, Azure Data Factory (Min. 4 Years ), Azure SQL/MS SQL. Job Description : We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience designing,...