ETL/Databricks Engineer

Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

Role: Azure ETL Tester., Databricks tester- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. - Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. - Well versed in Databricks, SQL Database, Azure...

Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

Experience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...

Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

About the job :Responsibilities :- Install, configure, and maintain Databricks environments to support data engineering and analytics activities.- Collaborate with cross-functional teams to understand data requirements and optimize Databricks clusters accordingly.- Monitor Databricks performance, troubleshoot issues, and implement solutions to ensure system...

Job Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria :- 4+ years of experience in Azure Data Engineer - ADF, ADB, ADLS- Notice period / Joining duration - Immediately / Less than 30 Days- Willing to...

Job Description :- Design the overall architecture and framework for data solutions and integration.- Collaborate with stakeholders to understand requirements and translate them into technical designs.- Provide technical guidance to the team, ensuring alignment with best practices.- Oversee the implementation and integration of data systems and processes.-...

Company Name : GrayMatterRequired Skills : Python, Machine Learning models and systems, Databricks, Pyspark, Proficiency in SCM Learning Engineering Experience: 1. A minimum of 4 years of hands-on experience in designing, developing, and deploying Machine Learning models and systems.2. Proficiency in Databricks: Strong familiarity and practical experience...

Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

Job Description:Proven expertise in designing, building, and optimizing scalable data pipelines and ETL/ELT processes within the Snowflake ecosystem.Cloud Platform by using services AWS Glue, Lambda, Redshift. Strong SQL, Python & Pyspark knowledge.Ensure data quality and accuracy in the Snowflake platform.Hands-on experience in AWS, Databricks, Snowflake...

Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...

Databricks AdministratorJob Title : Databricks Administrator. Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- We are seeking a skilled and experienced Databricks Administrator to join our team.- As a Databricks Administrator, you will be responsible for the installation, configuration, maintenance, and optimization of our Databricks...

Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...

Job Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

Job Description :- Data modeling, building physical data models, staging, normalized analyze complex business problems. Must be capable of writing SQL queries for validating dashboard/reporting outputs,- Must be able to translate visual requirements into detailed technical specifications, Reverse Engineer data specifications from source systems through data...

Key Responsibilities: - Build and maintain data pipelines to enable faster, better, data-informed decision-making through customer enterprise business analytics. - Support ETL processes, fixing errors, repairing data, upgrading designs and code for resiliency. - Monitor and support data platforms and services: respond to alerts, improve process efficiency,...

Job description : Responsibilities :- Provide consultation on appropriate use of AWS for Data Processing - Lead the design and implementation of new big data systems which would meet or exceed customers business objectives - Lead prototyping efforts to demonstrate the value of your proposed system - Define solution / project scope, estimates and delivery...