Data Engineer Azure

3 days ago

Sany, India TCP Corps Full time
Required Skills Python Pyspark Azure DataFactory SQL DataModelling
Overview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data architecture and infrastructure enablingdatadriven decisionmaking across theorganization.KeyResponsibilities:
  • Design and developAzure data solutions including data lakes data warehouses and dataintegration services.
  • Implement and maintainETL processes to ingest cleanse transform and aggregate data fromvarious sources.
  • Optimize data infrastructurefor performance scalability and costeffectiveness onAzure.
  • Collaborate with data scientists andanalysts to understand data requirements and implement efficientdata retrieval and storage mechanisms.
  • Developand maintain data pipelines using Azure Data Factory Databricks orsimilar tools.
  • Ensure data security andcompliance with industry regulations in all Azure datasolutions.
  • Troubleshoot and resolve datarelatedissues ensuring the stability of data pipelines andservices.
  • Document data architecture processesand procedures for knowledge sharing and futurereference.
  • Participate in the evaluation andimplementation of new tools and technologies for data engineeringon Azure.
  • Conduct performance tuning andoptimization of Azure data solutions for improvedefficiency.
RequiredQualifications:
  • Bachelors or Mastersdegree in Computer Science Engineering or a relatedfield.
  • Proven experience in designingdeveloping and maintaining data solutions on Azure cloudplatform.
  • Expertise in SQL programming for datamanipulation querying and performanceoptimization.
  • Proficiency in programminglanguages such as Python Java or Scala for data processing andmanipulation.
  • Handson experience with Azureservices including Azure Data Lake Storage Azure Synapse Analyticsand Azure Data Factory.
  • Strong understanding ofdata modeling data warehousing concepts and ETL bestpractices.
  • Experience in building scalable andreliable data pipelines using Azure services andtools.
  • Good understanding of data securityprinciples and best practices in Azureenvironments.
  • Excellent problemsolving andanalytical skills with the ability to troubleshoot complex dataissues.
  • Effective communication skills and theability to work collaboratively in a teamenvironment.
  • Relevant Azure certifications suchas Azure Data Engineer Associate or Azure Solutions Architect are aplus.
  • Familiarity with DevOps practices andtools for continuous integration and deployment of data solutionson Azure is desirable.
  • Knowledge of agilemethodologies and project management practices for successfuldelivery of data engineeringprojects.

data ingestion,agilemethodologies,python,azure,pyspark,data security principles,etlprocesses,data warehousing,data transformation,azure datafactory,communication skills,data engineering,azure synapseanalytics,data storage,data modelling,azure data lakestorage,devops practices,problem-solving,etl,project management,etlbest practices,sql,analytical skills

  • Azure Data Engineer

    2 weeks ago

    Sany, India Manvision Technologies Full time

    PySpark Development experienceespecially in Spark SQL and Complex TransformationsPython development experienceExperience in Azure Data Lake Azure Data Factory AzureDatabricks Azure Databases Azure SkillsMust have working experience in Azure DataLake Azure Data Factory Azure Databricks Azure SQLDatabases Azure DevOpsAzure AD Integration Service Principal...

  • Azure Cloud Data Engineer

    2 months ago

    Sany, India IndiSquad Full time

    Azure Cloud DataEngineerOverview:TheAzure Cloud Data Engineer plays a crucial role in designingdeveloping and maintaining scalable data solutions within the Azureecosystem. They are responsible for implementing data pipelinesoptimizing data storage and processing and ensuring the reliabilityand security of data...

  • Azure Cloud Data Engineer

    4 weeks ago

    Sany, India IndiSquad Full time

    Azure Cloud DataEngineerOverview:TheAzure Cloud Data Engineer plays a crucial role in designingdeveloping and maintaining scalable data solutions within the Azureecosystem. They are responsible for implementing data pipelinesoptimizing data storage and processing and ensuring the reliabilityand security of data...

  • Azure Cloud Data Engineer

    2 months ago

    sany, India IndiSquad Full time

    Azure Cloud DataEngineer Overview: TheAzure Cloud Data Engineer plays a crucial role in designingdeveloping and maintaining scalable data solutions within the Azureecosystem. They are responsible for implementing data pipelinesoptimizing data storage and processing and ensuring the reliabilityand security of data infrastructure.KeyResponsibilities:...

  • Azure Cloud Data Engineer

    4 weeks ago

    sany, India IndiSquad Full time

    Azure Cloud DataEngineer Overview: TheAzure Cloud Data Engineer plays a crucial role in designingdeveloping and maintaining scalable data solutions within the Azureecosystem. They are responsible for implementing data pipelinesoptimizing data storage and processing and ensuring the reliabilityand security of data infrastructure.KeyResponsibilities:...

  • Azure Data Engineer

    2 weeks ago

    sany, India Manvision Technologies Full time

    MustHave (Ideally should not be morethan 35): Azure Datatechnologies PaaS components (ADF ADB Data Lake) PL/SQL. Handson Azure Data technologies experience foratleast 2 years GoodtoHave : Goodcommunication skills AzureDevOps SQL Server Responsibility of / Expectations from the Role Develop & maintainAzure Data Factory(ADF) Pipelines and Azure Data...

  • Azure Data Engineer

    4 weeks ago

    sany, India Manvision Technologies Full time

    MustHave (Ideally should not be morethan 35): Azure Datatechnologies PaaS components (ADF ADB Data Lake) PL/SQL. Handson Azure Data technologies experience foratleast 2 years GoodtoHave : Goodcommunication skills AzureDevOps SQL Server Responsibility of / Expectations from the Role Develop & maintainAzure Data Factory(ADF) Pipelines and Azure...

  • Azure Data Engineer

    1 month ago

    sany, India Manvision Technologies Full time

    PySpark Development experienceespecially in Spark SQL and Complex Transformations Python development experience Experience in Azure Data Lake Azure Data Factory AzureDatabricks Azure Databases Azure Skills Must have working experience in Azure DataLake Azure Data Factory Azure Databricks Azure SQLDatabases Azure DevOps Azure AD Integration Service...

  • Azure Data Engineer

    1 month ago

    Sany, India Manvision Technologies Full time

    PySpark Development experienceespecially in Spark SQL and Complex TransformationsPython development experienceExperience in Azure Data Lake Azure Data Factory AzureDatabricks Azure Databases Azure Skills Must have working experience in Azure DataLake Azure Data Factory Azure Databricks Azure SQLDatabases Azure DevOpsAzure AD Integration Service Principal...

  • Azure Factory Data Azure Active Directory Developer withPythonSQL

    4 weeks ago

    sany, India Notus Solution Full time

    WIPRO (Permanent JobRole) Job Title:Azure Factory Data & Azure Active Directory Developer withPython/SQLcoding/programming. Immediate30 days joiner who are currently servingNP Any locationof Wipro in India Hybrid (Any 3 days of a weekonsite) JobDescription: Weare looking for a skilled Azure Factory Data and Azure ActiveDirectory Developer to join our team....

  • Azure Factory Data Azure Active Directory Developer withPythonSQL

    5 days ago

    Sany, India Notus Solution Full time

    WIPRO (Permanent JobRole)Job Title:Azure Factory Data & Azure Active Directory Developer withPython/SQLcoding/programming.Immediate30 days joiner who are currently servingNPAny locationof Wipro in India Hybrid (Any 3 days of a weekonsite)JobDescription:Weare looking for a skilled Azure Factory Data and Azure ActiveDirectory Developer to join our team. As a...

  • Data Engineer

    19 hours ago

    sany, India Randstad India Full time

    This role will design develop and maintainthe data processing platform on Azure. The purpose of thedataplatform is to integrate data across theorganization to empower and provide business partners vendorsandcustomers with actionable insights. The rightcandidate will implement best practices using expertise inAzureData Services to build a scalable secure...

  • ADF- Azure Data Factory

    3 months ago

    Sany, India sedin technogogies Full time

    • highproficiency and 6 – 10 years of experience in designing/developingdata analytics and data warehouse solutions with azure data factory(ADF) and azure databricks• experience indesigning large data distribution, integration withservice-oriented architecture and/or data warehouse solutions, datalake solution using azure databricks with large and...

  • ADF- Azure Data Factory

    4 weeks ago

    Sany, India sedin technogogies Full time

    • highproficiency and 6 – 10 years of experience in designing/developingdata analytics and data warehouse solutions with azure data factory(ADF) and azure databricks• experience indesigning large data distribution, integration withservice-oriented architecture and/or data warehouse solutions, datalake solution using azure databricks with large and...

  • ADF- Azure Data Factory

    2 weeks ago

    sany, India sedin technogogies Full time

    highproficiency and 6 – 10 years of experience in designing/developingdata analytics and data warehouse solutions with azure data factory(ADF) and azure databricks experience indesigning large data distribution, integration withservice-oriented architecture and/or data warehouse solutions, datalake solution using azure databricks with large and...

  • Azure big data specialist

    3 days ago

    Sany, India Overture Rede Private Limited Full time

    Responsibilities: Overall 7 8 years ofexperience with a minimum 5 years of relevant professional workExperience. Design implement and maintain datapipelines for data ingestion processing and transformation inAzure. Work together with data analysts to understandthe needs for data and create effective data workflows.Create and maintain data storage solutions...

  • Data Engineer

    2 weeks ago

    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Python Data Engineer

    4 weeks ago

    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Python Data Engineer

    5 days ago

    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Azure Cloud Engineer

    2 weeks ago

    Sany, India Pi Square Technologies Full time

    KeySkills:- Cloud Services, especially Microsoft Azure, focusing on enterprise scale, VM networking, and security best practices- Container Orchestration with Kubernetes and Container Engines like Docker- Azure identity management including Entra ID SPN RBAC- Azure Serverless with Azure Functions/Runbooks, ADO, CI/CD, PowerShell, Python- Windows and Red Hat...