Azure Data Factory- Indore

2 hours ago

Chennai Tamil Nadu, India Cognizant Full time

**Azure**Data Factory**

**Location: - Indore**

**Job type: Full time**

**Exp: 4-12 years**

**Key Responsibilities**:

- Design and maintain scalable data pipelines using Azure Data Factory (ADF) and Databricks.
- Use PySpark for efficient data processing of large volumes.
- Optimize SQL queries and scripts for ETL processes.
- Manage and integrate data from various sources, including Teradata, ensuring quality and consistency.
- Monitor and troubleshoot data pipelines for reliability.
- Implement best practices for data governance, security, and compliance.
- Stay updated with industry trends and technologies to enhance data engineering practices.

**Job Summary**

**Responsibilities**
- Develop and maintain data pipelines using Azure Data Factory to ensure seamless data flow.
- Oversee the integration of various data sources into Snowflake to create a unified data environment.
- Provide expertise in Python to automate data processing tasks and enhance efficiency.
- Ensure data integrity and accuracy by implementing robust validation and error-handling mechanisms.
- Optimize performance of data pipelines and queries to meet business requirements.
- Collaborate with data analysts and business stakeholders to understand data needs and deliver solutions.
- Monitor and troubleshoot data pipeline issues to minimize downtime and ensure reliability.
- Implement best practices for data security and compliance with industry standards.
- Lead efforts to improve data quality and governance across the organization.
- Conduct code reviews and provide feedback to junior developers to maintain high coding standards.
- Stay updated with the latest industry trends and technologies to continuously improve our data infrastructure.
- Document processes data flows and technical specifications for future reference and training purposes.
- Participate in agile development processes including sprint planning stand-ups and retrospectives.

**Qualifications**
- Possess strong experience in Azure Data Factory for developing and managing data pipelines.
- Demonstrate proficiency in Python for automating data processing tasks.
- Have extensive knowledge of Snowflake SQL for data integration and querying.
- Exhibit excellent problem-solving skills and attention to detail.
- Show ability to collaborate effectively with cross-functional teams.
- Display strong communication skills to articulate technical concepts to non-technical stakeholders.
- Have a proactive approach to learning and implementing new technologies.
- Show commitment to maintaining data security and compliance standards.
- Demonstrate experience in agile development methodologies.

**Certifications Required**

Azure Data Engineer Associate Snowflake SnowPro Core Certification

  • Azure Databricks

    2 hours ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Title: -Azure Databricks** **Location: - Indore** **Exp - 3 to 14 years** **Must Have Skills** - Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational database design, data warehousing...

  • Azure Databricks- Indore

    2 hours ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Azure**Databricks** **Location: - Indore** **Exp: 4-12 years** **Must Have Skills** - Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational database design, data warehousing and...

  • Azure Data Factory

    2 hours ago

    Coimbatore, Tamil Nadu, India Cognizant Full time

    **Skill: - Azure Bricks & Data Factory** **Experience: 3 to 14 years** **Location: - Coimbatore**(Walkin on 8th Feb)** - Hands on experience and good knowledge on Azure Data factory, Data bricks, PySpark, Mandatory skills* Should have Good Knowledge in Azure data Factory, Databricks. Hands on experience on PySpark development. Well versed with Agile way...

  • Azure Data Factory

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain data solutions using Azure SQL DB and Azure Data Factory. - Ensure the performance reliability and security of data systems. - Collaborate with cross-functional teams to gather and analyze requirements. - Design and implement data integration workflows and ETL processes. - Monitor and optimize data...

  • Azure Data Factory​

    1 week ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Azure Data Factory Job Location: Chennai Experience required : 5-12 Yrs Skills: Azure Data Factory Mandatory Technical Skill Set Azure Data Factory SQL- Advance SSIS Data Bricks SDFS Azure Data Factory (ADF) pipelines and Polybase Good knowledge of Azure Storage – including Blob Storage, Data Lake, Azure SQL, Data...

  • Azure Data Factory​

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Azure Data FactoryJob Location: ChennaiExperience required : 5-12 YrsSkills: Azure Data FactoryMandatory Technical Skill SetAzure Data FactorySQL- AdvanceSSISData BricksSDFSAzure Data Factory (ADF) pipelines and PolybaseGood knowledge of Azure Storage – including Blob Storage, Data Lake, Azure SQL, Data Factory V2,...

  • Azure Data Factory

    7 days ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Greetings from Colan InfotechWe are hiring Azure Data Factory urgent basisJob Location - Chennai / Bangalore (WFO only)Role: Azure Data FactoryExperience: 7+ YearsSkill set:ETL/ELT Pipeline and Azure Data Factory Roles and Responsibilities: yrs relevant experience in ADF2)     Experienced in Design, develop, and deploy scalable ETL/ELT data pipelines...

  • Azure Data Factory

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy ServicesThank you for expressing your interest in exploring a career possibility with the TCS Family.Hiring For: Azure Data Factory.Location: Chennai.Experience: 5+ Years.Mode Of Interview: Walk-In Drive (In-person Interview)Must Have:- Good know how of SDFS, Azure Data Factory (ADF) pipelines and Polybase.- Good knowledge of...

  • Azure Data Factory

    1 week ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For: Azure Data Factory. Location: Chennai. Experience: 5+ Years. Mode Of Interview: Walk-In Drive (In-person Interview) Must Have: Good know how of SDFS, Azure Data Factory (ADF) pipelines and Polybase. Good...

  • Azure Data Factory

    6 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Greetings from TATA Consultancy ServicesThank you for expressing your interest in exploring a career possibility with the TCS Family.Hiring For: Azure Data Factory.Location: Chennai.Experience: 5+ Years.Mode Of Interview: Walk-In Drive (In-person Interview)Must Have:Good know how of SDFS, Azure Data Factory (ADF) pipelines and Polybase.Good knowledge of...