Azure Data Engineer

1 month ago

chennai, India Breezy Talent Full time
Vidpro Consultancy Services is seeking a Senior Databricks Engineer / Databricks Technical Lead / Data Architect with 510 years of experience.Location: Bangalore Chennai Delhi Pune Kolkata and GurgaonWork Type: HybridMandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory
Primary Roles and Responsibilities: Creating Modern Data Warehouse solutions using Databricks and AWS/Azure Stack Providing forwardthinking solutions in data engineering and analytics Collaborating with DW/BI leads for new ETL pipeline development requirements Troubleshooting issues in existing pipelines and addressing gaps Understanding reporting layer needs and developing data models Assisting team members with problem resolution and technical challenges Leading technical discussions with client architects and team members Orchestrating data pipelines in a scheduler via Airflow
Skills and Qualifications: Bachelors and/or master s degree in computer science or equivalent experience Minimum 3 years of experience in Data warehouse/ETL projects Deep understanding of Star and Snowflake dimensional modelling Strong knowledge of Data Management principles Proficiency in Databricks Data & AI platform and Databricks Delta Lake Architecture Handson experience in SQL Python and Spark (PySpark) Experience with AWS/Azure stack and ETL with batch and streaming (Kinesis) Building ETL/data warehouse transformation processes Familiarity with Apache Kafka for use with streaming data/eventbased data Working knowledge of Hadoop (incl. Hive Pig Impala) and nonrelational/NoSQL data repositories (incl. MongoDB Cassandra Neo4J) Experience with structured and unstructured data including imaging & geospatial data Proficiency in RDBMS complex SQL PL/SQL Unix Shell Scripting performance tuning and troubleshooting Databricks Certified Data Engineer Associate/Professional Certification (Desirable) Comfortable working in a dynamic fastpaced innovative environment with several ongoing concurrent projects Experience working in Agile methodology Strong verbal and written communication skills Strong analytical and problemsolving skills with a high attention to detail

circleci,pl/sql,python,azure datafactory,microsoft azure,sql,terraform,aws,cassandra,hadoop,extract, transform, load (etl),azure,hive,agile methodology,pipelines,rdbms,mongodb,data management,git,azure databricks,apache kafka,unix shell scripting,neo4j,data warehouse,databricks,databricks delta lake architecture,pyspark,etl,impala,databricks data & ai platform,pig,spark

  • Azure Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    Job SummaryWe are seeking a highly skilled Azure Data Engineer to join our team at Mastech InfoTrellis. As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design and develop data models, schemas, and data warehouses in Azure SQL Data Warehouse...

  • Azure Data Engineer

    4 weeks ago

    Chennai, India viraaj hr solutions Full time

    Overview An Azure Data Engineer plays a crucial role in designing implementing and managing data processing systems using the Microsoft Azure platform. They are responsible for developing and maintaining data pipelines and ensuring the efficient flow and processing of data within the organization. This role is vital in optimizing data storage ensuring data...

  • Azure Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India viraaj hr solutions Full time

    Job SummaryViraaj HR Solutions is seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing data processing systems using the Microsoft Azure platform.Key ResponsibilitiesDesign and develop data pipelines using Azure Data FactoryOptimize data...

  • Azure Data Engineer

    1 month ago

    Chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Chennai Job Mode: Work From Office Experience Range: Min 6 - 8 years Desired Competencies (Technical/Behavioral Competency): Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS management Azure Data Engineering skill sets (Azure Data Factory, Databricks,...

  • Azure Data Engineer

    2 months ago

    Chennai, India viraaj hr solutions Full time

    OverviewAn Azure Data Engineer plays a crucial role in designing implementing and managing data processing systems using the Microsoft Azure platform. They are responsible for developing and maintaining data pipelines and ensuring the efficient flow and processing of data within the organization. This role is vital in optimizing data storage ensuring data...

  • Azure Data Engineer

    1 month ago

    chennai, India viraaj hr solutions Full time

    OverviewAn Azure Data Engineer plays a crucial role in designing implementing and managing data processing systems using the Microsoft Azure platform. They are responsible for developing and maintaining data pipelines and ensuring the efficient flow and processing of data within the organization. This role is vital in optimizing data storage ensuring data...

  • Azure Data Engineer

    4 weeks ago

    chennai, India viraaj hr solutions Full time

    Overview An Azure Data Engineer plays a crucial role in designing implementing and managing data processing systems using the Microsoft Azure platform. They are responsible for developing and maintaining data pipelines and ensuring the efficient flow and processing of data within the organization. This role is vital in optimizing data storage ensuring data...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Job Title: Azure Data EngineerAbout the Role:We are seeking an experienced Azure Data Engineer to join our team at Skylark HR Solutions Pvt Ltd. As an Azure Data Engineer, you will lead the design, development, and maintenance of Prochant Azure-based database systems, ensuring optimal performance, scalability, and reliability.Key Responsibilities:Design and...

  • Azure data engineer

    1 month ago

    Chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Chennai Job Mode: Work From Office Experience Range: Min 6 - 8 years Desired Competencies (Technical/Behavioral Competency): Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, No SQL, RDBMS management Azure Data Engineering skill sets (Azure Data Factory, Databricks,...

  • Azure Data Engineer

    1 month ago

    Chennai, India Colan Infotech Pvt Ltd Full time

    Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at Colan Infotech Pvt Ltd. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Pyspark, Scala Spark, Databricks, Python, and SQL.Key Responsibilities:Design and develop...

  • Azure Data Engineer

    1 month ago

    Chennai, India Resourcetree Full time

    Job Title: Senior Data Engineer - AzureJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Resourcetree Global Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure Data Factory, Azure Data Lake, and Azure Databricks.Key...

  • Data engineer

    1 month ago

    Chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Job Description Experience - 6 to 10 yrs Requirement 6+ years as Data Architect/ Engineer with proficiency working in environments supporting solutions design. Design and Implementation experience with Bigdata platforms...

  • Data Engineer

    1 month ago

    Chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Job Description Experience - 6 to 10 yrs Requirement 6+ years as Data Architect/ Engineer with proficiency working in environments supporting solutions design. Design and Implementation experience with Bigdata platforms (On...

  • Data Engineer

    1 month ago

    chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Job DescriptionExperience - 6 to 10 yrsRequirement6+ years as Data Architect/ Engineer with proficiency working in environments supporting solutions design.Design and Implementation experience with Bigdata platforms (On premise...

  • Azure Data Engineer

    1 month ago

    Chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Chennai Job Mode: Work From Office Experience Range: Min 6 - 8 years Desired Competencies (Technical/Behavioral Competency): Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS management Azure Data Engineering skill sets (Azure Data Factory, Databricks,...

  • Azure Data Engineer

    1 month ago

    Chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data EngineerJob Location: ChennaiJob Mode: Work From OfficeExperience Range: Min 6 - 8 yearsDesired Competencies (Technical/Behavioral Competency):Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS managementAzure Data Engineering skill sets (Azure Data Factory, Databricks, Synapse, SQL,...

  • Azure Data Engineer

    1 month ago

    chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data EngineerJob Location: ChennaiJob Mode: Work From OfficeExperience Range: Min 6 - 8 yearsDesired Competencies (Technical/Behavioral Competency):Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS managementAzure Data Engineering skill sets (Azure Data Factory, Databricks, Synapse, SQL,...

  • Azure Data Engineer

    2 weeks ago

    chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Chennai Job Mode: Work From Office Experience Range: Min 6 - 8 years Desired Competencies (Technical/Behavioral Competency): Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS management Azure Data Engineering skill sets (Azure Data Factory, Databricks,...

  • Azure Data Engineer

    1 month ago

    Chennai, India Tata Consultancy Services Full time

    Job Role: Azure Data EngineerJob Location: ChennaiJob Mode: Work From OfficeExperience Range: Min 6 - 8 yearsDesired Competencies (Technical/Behavioral Competency):Azure Data Engineering, ETL Jobs development , Data Pipeline creation, Big Data processing, NoSQL, RDBMS managementAzure Data Engineering skill sets (Azure Data Factory, Databricks, Synapse, SQL,...

  • Data engineer

    4 weeks ago

    Chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Job Description Experience - 6 to 10 yrs Requirement 6+ years as Data Architect/ Engineer with proficiency working in environments supporting solutions design. Design and Implementation experience with Bigdata platforms (On...