Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL

2 days ago

bangalore, India Tata Consultancy Services Full time

Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL


JOB LOCATION : Pune/Kolkata


EXPERIENCE REQUIREMENT : 6+


Technical Skill Set :

Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL


Must have:

Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between different system like ADLS, ADF, Synapse, Databricks etc. · A minimum of 5 years' experience with large SQL data marts. Expert relational database experience, Candidate should demonstrate ability to navigate through massive volumes of data to deliver effective and efficient data extraction, design, load, and reporting solutions to business partners, · Minimum 5 years of troubleshooting and Supporting large databases and testing activities; Identifying reporting, and managing database security issues, user access/management; Designing database backup, archiving and storage, performance tuning, ETL importing large volume of data extracted from multiple systems, capacity planning · Experience in TSQL programming along with Azure Data Factory framework and Python scripting · Work well independently as well as within a team · Proactive, organized, excellent analytical and problem-solving skills · Flexible and willing to learn, can-do attitude is key · Strong verbal and written communication skills


Good-to-Have :

Financial institution data mart experience is an asset. · Experience in .net application is an asset · Experience and expertise in Tableau driven dashboard design is an asset


Responsibility of / Expectations from the Role:

1 Azure Data Engineer (ADF,ADB)

2 ETL processes using frameworks like Azure Data Factory or Synapse or Databricks;

3 Establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc

4 TSQL programming along with Azure Data Factory framework and Python scripting

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQLJOB LOCATION : Pune/KolkataEXPERIENCE REQUIREMENT : 6+Technical Skill Set :Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLMust have:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between...

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL

    2 days ago

    bangalore, India Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL JOB LOCATION : Pune/Kolkata EXPERIENCE REQUIREMENT : 6+ Technical Skill Set : Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL Must have: Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity...

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL JOB LOCATION : Pune/Kolkata EXPERIENCE REQUIREMENT : 6+ Technical Skill Set : Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL Must have: Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity...

  • Azure Data Engineer

    5 days ago

    Bangalore City, India Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQLJOB LOCATION : Pune/KolkataEXPERIENCE REQUIREMENT : 6+Technical Skill Set :Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLMust have:Strong experience in Azure Data Factory, ADB( Azure Databricks) Synapse, pyspark;establishing the cloud connectivity between...

  • Azure Data Engineer

    1 day ago

    bangalore, India Luxoft Full time

    Project Description: The Technical scope of the project is to build Data Ingestion in ADF and ETL business login in ADB using PySpark scripting. Create complex SQL queries, Fine-tuning the queries for optimal performance, and build an Advanced Analytics layer for Reporting consumption. Responsibilities: Use and create data pipelines, analyze data, tune...

  • Azure Data Engineer

    5 days ago

    bangalore, India Luxoft Full time

    Project Description:The Technical scope of the project is to build Data Ingestion in ADF and ETL business login in ADB using PySpark scripting. Create complex SQL queries, Fine-tuning the queries for optimal performance, and build an Advanced Analytics layer for Reporting consumption.Responsibilities:Use and create data pipelines, analyze data, tune query...

  • Azure Data Engineer

    2 days ago

    bangalore, India Luxoft Full time

    Project Description:The Technical scope of the project is to build Data Ingestion in ADF and ETL business login in ADB using PySpark scripting. Create complex SQL queries, Fine-tuning the queries for optimal performance, and build an Advanced Analytics layer for Reporting consumption.Responsibilities:Use and create data pipelines, analyze data, tune query...

  • Azure Data Engineer

    5 days ago

    bangalore, India Luxoft Full time

    Project Description: The Technical scope of the project is to build Data Ingestion in ADF and ETL business login in ADB using PySpark scripting. Create complex SQL queries, Fine-tuning the queries for optimal performance, and build an Advanced Analytics layer for Reporting consumption. Responsibilities: Use and create data pipelines, analyze data, tune...

  • Azure Data Engineer

    5 days ago

    Bangalore City, India Luxoft Full time

    Project Description:As a Data Engineer you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...

  • Azure Data Engineer

    5 days ago

    Bangalore City, India Luxoft Full time

    Project descriptionAs a Data Engineer, you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...

  • Data Engineer

    2 weeks ago

    bangalore, India FinJo Full time

    Job Description :We are seeking an experienced Azure Data Engineer with 6-8 years of overall experience, including at least 3 years specifically in relevant roles.The ideal candidate will have expertise in Azure technologies, including PySpark, SQL, Azure Data Bricks (ADB), Azure Data Factory (ADF), data modeling, and Azure Data Lake Storage (ADLS).The role...

  • Azure Data Engineer

    2 days ago

    bangalore, India Luxoft Full time

    Project descriptionAs a Data Engineer, you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...

  • Azure Data Engineer

    5 days ago

    bangalore, India Luxoft Full time

    Project description As a Data Engineer, you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...

  • Azure Data Engineer

    4 days ago

    Bangalore Metropolitan Area, India Luxoft Full time

    Project descriptionAs a Data Engineer, you'll be working alongside data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and...

  • Snowflake Azure Data Engineer-

    4 months ago

    bangalore, India Tredence Inc. Full time

    Job Location- Bengaluru/Gurgaon/Pune/Chennai/HyderabadExperience- 4 to 8 yrsEarly joiners preferredPrimary Roles and Responsibilities:● Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaborate with DW/BI leads to...

  • Snowflake Azure Data Engineer-

    2 days ago

    bangalore, India Tredence Inc. Full time

    Job Location- Bengaluru/Gurgaon/Pune/Chennai/HyderabadExperience- 3 to 12 yrsEarly joiners preferredPrimary Roles and Responsibilities:● Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaborate with DW/BI leads to...

  • Snowflake Azure Data Engineer-

    4 months ago

    bangalore, India Tredence Inc. Full time

    Job Location- Bengaluru/Gurgaon/Pune/Chennai/Hyderabad Experience- 4 to 8 yrs Early joiners preferred Primary Roles and Responsibilities: ● Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF. ● Ability to provide solutions that are forward-thinking in data engineering and analytics space ● Collaborate with DW/BI leads to...

  • Data Engineer

    3 months ago

    bangalore, India Overture Rede Private Limited. Full time

    Key Skills:Azure Data Factory, Pyspark, T/SQL, PL/SQL, Exposure on other ETL Tools like SSIS, Databricks Data Engineering Job Description : - Create and maintain optimal data pipeline architecture - Design and develop Data Warehouse solutions - Assemble large, complex data sets that meet functional / non-functional business requirements.- Identify,...

  • Cloud Engineer

    2 days ago

    bangalore, India Recro Full time

    Role : Azure Data EngineerExp - 4+ years of experienceJob Type : ContractEmployer: RecroClient: InfosysRole: Azure Data EngineerExperience: 4+ yearsMode of Work: RemoteInterview Process Overview:R1: Tech Round on Intervue platformR2: Prep Call by Infosys teamR3: End Client RoundQualification :Very Good Communication (Client engagement)-Able to answer...

  • Cloud Engineer

    1 day ago

    bangalore, India Recro Full time

    Role : Azure Data Engineer Exp - 4+ years of experience Job Type : Contract Employer: Recro Client: Infosys Role: Azure Data Engineer Experience: 4+ years Mode of Work: Remote Interview Process Overview: R1: Tech Round on Intervue platform R2: Prep Call by Infosys team R3: End Client Round Qualification : Very Good Communication (Client engagement) -Able...