Hiring For Azure Databricks, Data Factory

2 weeks ago

Delhi Hyderabad NCR Pune, India Coforge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Responsibilities

  • Lead a team of Data Engineers and Senior Data Engineers, providing technical guidance and mentorship.
  • Design, develop, and maintain scalable ETL pipelines using Azure Services.
  • Process, transform, and load large datasets into AWS Datalake or other data stores.
  • Collaborate with cross-functional teams including data architects, analysts, and business stakeholders to gather requirements and deliver efficient data solutions.
  • Implement and maintain data pipelines for ingestion, processing, and transformation in Azure.
  • Work closely with data scientists and analysts to understand data needs and create effective workflows.
  • Create and manage data storage solutions such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
  • Develop and maintain ETL operations using Azure Data Factory or similar technologies.
  • Ensure data quality, integrity, and reliability through validation and cleansing procedures.
  • Optimize data pipelines for scalability, efficiency, and cost-effectiveness.
  • Monitor and troubleshoot data pipeline issues to ensure data consistency and availability.

Key Skill Sets Required

  • Proven experience in designing and developing cloud-based analytics solutions.
  • Expert-level knowledge of:
  • Azure Data Factory
  • Azure Synapse
  • Azure SQL
  • Azure Data Lake
  • Azure App Service
  • Experience in building data pipelines using API and streaming ingestion methods.
  • Familiarity with DevOps processes including CI/CD and Infrastructure as Code.
  • Strong understanding of data warehouse modeling principles (Kimball, Inmon).
  • Desirable knowledge of:
  • Azure Databricks
  • Azure IoT
  • Azure HDInsight + Spark
  • Azure Stream Analytics
  • Power BI
  • Working knowledge of Python is a plus.
  • Experience in developing security models.

  • Azure Data Factory, Snowflake, Databricks

    1 week ago

    Hyderabad, India Teamware Solutions Full time

    Job Description - 5+ years of experience in Azure Data Factory, Snowflake, and Databricks - Understand business requirements and actively provide inputs from a data perspective - Understand the underlying data and data flow - Build simple to complex pipelines and dataflows - Work with other Azure stack modules like Azure Data Lake, Azure SQL, and Databricks...

  • Azure data factory

    1 week ago

    Pune, Maharashtra, India ID4 Consultancy Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Azure Data Factory: Experience in building and managing data pipelines. Azure Data Lake Gen 2: Proficient in data storage and management within Azure'sdata lake environment. Azure Databricks / Apache Spark: Hands-on skill with distributed data processing,transformations, and analytics. Power BI: Expertise in data visualization and reporting.Good to...

  • Azure Data Factory

    2 weeks ago

    Hyderabad, Telangana, India Yash Technologies Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Module Lead - Azure Data Factory (ADF) Job YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge...

  • Azure Data factory

    1 week ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Job Responsibilities: - Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory (ADF) and Azure Databricks. - Write proficient SQL queries to perform data mining and analysis, specifically focusing on Teradata as a primary RDBMS. - Develop complex SQL queries, including the use of window functions and...

  • Azure Data Factory

    1 week ago

    Hyderabad, India Spout Analytics, Inc Full time

    **Title - Azure Data Factory** **Location - Hyderabad, Chennai and Bengaluru** **Duration - Full Time** **Job description**: Specialized in cloud architect for developing solutions for Microsoft Azure cloud **Should have good Azure technical skills ** Should have good experience in Azure Data Lake, SQL DB, SQL queries, Databricks, ADF **Good knowledge in...

  • (3 Days Left) Azure Data Factory, Azure Databricks,Python/Pyspark Professional

    1 week ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Skill Set:Azure Data Factory, Azure Databricks, Python/Pyspark - Joining time ( Notice period) Immediate joiners only - AnAzure Data Factory, Azure Databricks, Python/PySpark Professional for Testingplays a vital role in ensuring the accuracy, performance, and reliability of data workflows that involve Azure Data Factory (ADF), Azure...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India Apex One Full time

    Job Description Key Responsibilities - Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. - Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). - Collaborate with data scientists, analysts, and engineering teams to design and...

  • Lead Data Engineer

    2 weeks ago

    Pune, India Arting Digital Full time

    Posting title : Lead Data Engineer (Databricks)Experience : 7+ YearsLocation : Pune/ AhmedabadWork mode : HybridPrimary skills : Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification : Any Technical DegreeRoles & Responsibilities :- Lead the design, development, and...

  • Azure Data Factory

    4 days ago

    Hyderabad, India Gleecus TechLabs Pvt. Ltd Full time

    **Azure Data Factory | Power BI Reporting |** **Immediate Joiner** **Hyderabad (Work From Office )** - 3+ years experience in Azure Stack(ADF,ADLS,Synapse,Databricks,PowerBI reporting ) and - Strong Data Warehouse, SQL DB, and Data Modelling Skills. Hands-on exposure to coding and mentor team on technical abilities." **Good Communication Skills** **Salary**:...

  • Azure Databricks Data Engineer

    6 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Scheduled in-person interview- Databricks with Python at TCS, Deccan Park Plot No 1, Software Units Layout, Madhapur, Hyderabad, Telangana 500081Job Role -Azure Databricks with PythonExperience Range: 5 to 9 yearsJob Location: HyderabadJob DescriptionMust Have: Extensive expertise in designing and implementing data load processes using Azure Data Factory,...