Azure Data Engineer

3 months ago

Kolkata, India Talpro Full time

Job Description :


We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL. Additionally, you will work on Azure and Databricks "Lakehouse" implementation, translating business requirements into technical solutions for data curation and consumption.

Responsibilities :

- Data Curation and Transformation: Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective.

- Azure Data Engineering: Develop data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components.

- SQL and Pyspark: Utilize SQL programming and Pyspark for data manipulation and processing tasks.

- Azure Services: Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks.

- Data Migration: Experience in SQL Server migration to the cloud and handling structured and unstructured datasets.

- DevOps and CI/CD: Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology.

- Databricks Expertise: In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables.

- Data Modeling: Understand and implement data modeling for the data lake.

- Data Transfer and Oracle PL/SQL: Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus.

- Effort Estimation: Provide effort estimation for new projects related to data engineering.

- Complex Design and Agile Environment: Drive complex design and development efforts in an agile environment.

Qualifications :

- Minimum of 5-7 years of experience working on Azure and Databricks "Lakehouse" implementation.

- Strong experience in ADF (Azure Data Factory) and SQL as primary skills.

- Familiarity with Informatica PWC and Oracle PL/SQL.

- Experience in SQL programming and Pyspark.

- 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse platform.

- Good understanding of data modeling and data lake concepts.

- Expertise in Databricks, ADLS, ADX, and other Azure services.

- Prior experience in SQL Server migration to the cloud.

- Knowledge of DevOps tools and processes.

(ref:hirist.tech)

  • Senior Data Integration Engineer

    4 weeks ago

    Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Azure data engineer

    1 month ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB .Develop, optimize, and...

  • Azure data engineer

    2 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...

  • Azure Data Engineer

    2 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role -Azure Data EngineerLocation - Kolkata and Hyderabad.Experience - 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-Have- Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer- Proficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure data engineer

    2 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role -Azure Data EngineerLocation - Kolkata and Hyderabad.Experience - 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-HaveSound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure Data Engineer

    2 months ago

    kolkata, India Tata Consultancy Services Full time

    Role -Azure Data Engineer Location - Kolkata and Hyderabad. Experience - 6 to 9 Years Job description Desired Competencies (Technical/Behavioral Competency) Must-Have Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory pipelines for...

  • Azure Data Engineer

    3 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role -Azure Data EngineerLocation - Kolkata and Hyderabad.Experience - 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-HaveSound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure Data Engineer

    3 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role -Azure Data EngineerLocation - Kolkata and Hyderabad.Experience - 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-HaveSound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure Data Engineer

    3 months ago

    kolkata, India Tata Consultancy Services Full time

    Role -Azure Data EngineerLocation - Kolkata and Hyderabad.Experience - 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-HaveSound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure Data Engineer

    3 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role -Azure Data Engineer Location - Kolkata and Hyderabad. Experience - 6 to 9 Years Job description Desired Competencies (Technical/Behavioral Competency) Must-Have Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory pipelines for...

  • Azure data engineer

    3 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; Snowflake Key Responsibilities: Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB . Develop, optimize,...

  • Azure data engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 YearsLocation: Kolkata Job Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.Develop, optimize, and automate...

  • Azure data engineer

    3 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 YearsLocation: Kolkata Job Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.Develop, optimize, and automate...

  • Azure data engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 YearsLocation: Kolkata Job Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.Develop, optimize, and automate...

  • Azure data engineer

    3 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; Snowflake Key Responsibilities: Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB . Develop, optimize,...

  • Azure data engineer

    2 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title:Azure Cloud Database EngineerExperience Required:3-15 YearsLocation:KolkataJob Type:Full-timeMust Have:Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases usingAzure SQLandAzure Cosmos DB .Develop, optimize, and automate data...

  • Azure Data Engineer

    2 months ago

    Kolkata, India Tata Consultancy Services Full time

    Role-Azure Data EngineerLocation- Kolkata and Hyderabad.Experience- 6 to 9 YearsJob descriptionDesired Competencies (Technical/Behavioral Competency)Must-HaveSound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL...

  • Azure data engineer

    1 month ago

    Kolkata, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Azure Data EngineerJob Locations: KolkataExperience Range: 5 to 8 yearsJob Description:-4+ years of relevant experience in Pyspark and Azure Synapse Analytics/Azure Databricks.Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data...

  • Azure data engineer

    1 month ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title- Databricks DeveloperRelevant Experience(in Yrs) 6 to 12 YRsTechnical/Functional Skills · Minimum 5 years + working exp as Databricks Developer · Minimum 3 years + working exp on Py Spark and AWSExperienceRequired 5 years+Roles &Responsibilities· 5+ years relevant and progressive data engineering experience · Deep Technical knowledge and...

  • Azure Data Engineer

    1 month ago

    Kolkata, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Azure Data EngineerJob Locations: KolkataExperience Range: 5 to 8 yearsJob Description:-4+ years of relevant experience in Pyspark and Azure Synapse Analytics/Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data...