ETL/Databricks Engineer

4 weeks ago


bangalore, India RS Consultants Full time

ETL (Databricks)

Job description :

Responsibilities :

- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.

- Collaborate with Business Intelligence team and other stakeholders for data requirements

- Collaborate with the Data Management team to provide quality data to stakeholders.

- Build data expertise and learn company history needed to effectively design data pipelines.

General Requirements :

- Highly collaborative and empathic approach to problem solving

- Naturally curious with the drive to learn what is needed to identify root cause

- Capable of actioning high-level, sometimes ambiguous requirements into operational tools/dashboards

- Demonstrated organizational skills, attention to detail and ability to work independently while staying integrated with the broader Data Engineering team as well as stakeholders

- A strategist with sound business and technical acumen.

Proven ability to influence at various levels of leadership, without direct authority

- Strong problem-solving skills (critical, strategic, and evaluative thinking)

- Ability to synthesize complex data concepts into easily comprehended messages

Technical Skill Requirements :

- Data Collection Tools

- Knowledge of data modeling and design of schemas for read and write performance.

- Build Processes supporting data transformation, data structures, metadata, dependency, and workload management.

- Knowledge of message queuing, stream processing, API based extraction and highly scalable 'big data' data stores

- Experience in Python and SQL.

Experience with Boomi is a plus.

- ETL Automation - experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday and Jira

- Knowledge of Databricks Platform

- Knowledge of AI/ML/ Data Science

- Knowledge of BI Tools like Tableau, Looker etc

Education & Experience :

- Bachelor's degree required in related field

- Minimum 5 years related work experience

- Ongoing education in an area related to Data Analytics (Data Sciences, Mathematics, Statistics, Industrial Psychology, Organizational Behavior, or Finance/Accounting) preferred

- Experience working in a high growth company preferred

Keywords : ETL, Databricks, Python, databricks, SQL

Location : Remote

CTC : 18 LPA

(ref:hirist.tech)

  • Bangalore, India RS Consultants Full time

    ETL (Databricks)Job description : Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data...


  • Bangalore, Karnataka, India RS Consultants Full time

    ETL (Databricks)Job description : Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data...


  • Mumbai/Bangalore, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...


  • Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...


  • Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....

  • Databricks Engineer

    4 weeks ago


    bangalore, India Unilode Full time

    Databricks Engineer Position Overview The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization’s data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technical expertise, manage platform resources, and optimize data workflows...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • ETL Developer

    2 months ago


    Bangalore,Anywhere in India,Multiple Locations HIC Global Solutions Full time

    ETL Developer Job Description :- Consultant/Sr Consultant - ETL Development - Azure (ADF and DataBricks) Job Location : Gurugram, HaryanaA successful candidate will have the following characteristics:- Responsible for design, development, and implementation of solutions to exchange data using the required ETL tool, Azure Data Factory and DataBricks.- At...


  • bangalore, India RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...

  • Databricks Lead

    1 month ago


    bangalore, India Wipro Full time

    6-12+ years of experience in architecting large scale data & analytics systems,2+ years of handson experience in complex Databricks implementations,Architect level certification from Databricks,Strong written, verbal communication skills, ability to present to CXOs,Collaboration is key. He / She has to work with different sales, presales and partner teams in...


  • Bangalore/Chennai/Pune, India Tekfortune IT India Pvt. Ltd. Full time

    Title : Databricks Platform Administrator - SupportExperience : 4 to 10 YearsWork Location : Pune, Chennai & Bangalore LocationShift Timing : Max till 11PMNotice Period : Immediate to 45 DaysKey Skills : Databricks Support, SQL, Integration, Setup & Configuration of Databrick Clusters Job Description : We are seeking a highly skilled and experienced...

  • Engineering Manager

    3 weeks ago


    bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...


  • Bangalore, India Visara Full time

    Role: Azure ETL Tester., Databricks tester- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. - Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. - Well versed in Databricks, SQL Database,...

  • Databricks Engineer

    3 weeks ago


    bangalore, India Hunarstreet Technologies Full time

    Databricks Role Overview : As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...

  • Databricks Engineer

    3 weeks ago


    Bangalore, India Hunarstreet Technologies Full time

    Databricks Role Overview : As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...

  • Databricks Engineer

    3 weeks ago


    Bangalore, Karnataka, India Hunarstreet Technologies Full time

    Databricks Role Overview :As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...


  • bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Databricks Architect

    4 weeks ago


    bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...