Azure Data Engineer

4 weeks ago

BangaloreChennaiPuneKolkataGurgaonGurugram, India Pylon Management Consulting Full time

Primary Roles and Responsibilities :

- Developing Modern Data Warehouse solutions using Databricks and Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...

  • Azure Data Engineer

    2 weeks ago

    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, India VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...

  • Azure Databricks Engineer/Data Engineer

    2 weeks ago

    Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...

  • Azure Data Engineer

    4 weeks ago

    Gurugram, India Absolutdata Full time

    Location : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development etc. ...

  • Azure Data Engineer

    4 weeks ago

    gurugram, India Absolutdata Full time

    Location : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development...

  • Azure Data Engineer

    4 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Azure Data Engineer

    5 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Data Engineer

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, India Intuitive Apps Full time

    Key Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, Databricks Job Description : - Create and maintain optimal data pipeline architecture - Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required. - Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet...

  • Data Engineer

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Intuitive Apps Full time

    Key Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, DatabricksJob Description :- Create and maintain optimal data pipeline architecture- Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.- Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet functional /...

  • Azure Data engineer

    4 weeks ago

    chennai, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, India Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...

  • Azure Data Engineer

    4 weeks ago

    Chennai, India Spruce InfoTech Inc Full time

    Hope youre doing well!! We are hiring for the Azure Data Engineer role.Please find the JD below Company Name: Leading TOP MNCs JOBDesignation: Azure Data Engineer JOB Location:Noida / Pune / Chennai India. Mode of Hiring:Full time FTE Notice Period: Immediate to 15Days. Experience:68 years. Technical skills Required: Rich Experience in Azure data...

  • Azure Data Engineer

    4 weeks ago

    bangalore, India Nityo Infotech Full time

    Business Intelligence , C , Engineering , Integration , Java , SQL , A , AWS , Achieve , Activities , Adaptability , Agile , Analysis , Analysis Services , Analytic , Analytics , Approach , Automation , Azure , Backgrounds , Bangalore , Based , Belgium , Building , Building Trust , Business , Business Intelligence , Business Requirements , C , CO , CTS ,...

  • Azure Data Engineer

    3 days ago

    Chennai, India Spruce InfoTech Inc Full time

    Hope youre doing well!!We are hiring for the Azure Data Engineer role.Please find the JD belowCompany Name: Leading TOP MNCsJOBDesignation: Azure Data EngineerJOB Location:Noida / Pune / Chennai India.Mode of Hiring:Full time FTENotice Period: Immediate to 15Days.Experience:68 years.Technical skills Required:Rich Experience in Azure data factory...

  • Azure Data Engineer

    4 weeks ago

    Bangalore, India Visara Full time

    Job Description : We are seeking a highly skilled and dynamic Data Engineering Analyst to join our forward-thinking data engineering team. In this pivotal role, you will be at the heart of our data-driven initiatives, leveraging the power of Azure Databricks to drive business transformation and insights. As a key member of our team, you will bridge the gap...

  • Azure Data Engineer

    2 weeks ago

    Chennai, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva!JobDescriptionJobTitle Azure Data EngineerLocationChennai CoimbatorePuneExperience6 10YearsShift 12:30 to 9:30 pmJobRequirement:Experience in Azure Data Factory Azure Data bricks Spark (PySparkor scala)SQLExperience in Azure ingestion from onprem source e.g. mainframe SQLserverOracle.Experience in Sqoop /Hadoop.Microsoft Excel (for...

  • Data Engineer

    3 weeks ago

    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Chennai, IN VIDPRO CONSULTANCY SERVICES Full time

    Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / DatabricksPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development...

  • Data Engineer

    2 weeks ago

    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Chennai, India VIDPRO CONSULTANCY SERVICES Full time

    Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / DatabricksPrimary Roles and Responsibilities : - Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development...

  • Azure Data engineer

    2 weeks ago

    bangalore, India Birlasoft Full time

    Job Title: Azure Databricks LeadLocation: Bangalore/Mumbai/Pune/NoidaCompany Description:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses...