ETL/Databricks Engineer
1 month ago
ETL (Databricks)
Job description :
Responsibilities :
- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.
- Collaborate with Business Intelligence team and other stakeholders for data requirements
- Collaborate with the Data Management team to provide quality data to stakeholders.
- Build data expertise and learn company history needed to effectively design data pipelines.
General Requirements :
- Highly collaborative and empathic approach to problem solving
- Naturally curious with the drive to learn what is needed to identify root cause
- Capable of actioning high-level, sometimes ambiguous requirements into operational tools/dashboards
- Demonstrated organizational skills, attention to detail and ability to work independently while staying integrated with the broader Data Engineering team as well as stakeholders
- A strategist with sound business and technical acumen.
Proven ability to influence at various levels of leadership, without direct authority
- Strong problem-solving skills (critical, strategic, and evaluative thinking)
- Ability to synthesize complex data concepts into easily comprehended messages
Technical Skill Requirements :
- Data Collection Tools
- Knowledge of data modeling and design of schemas for read and write performance.
- Build Processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Knowledge of message queuing, stream processing, API based extraction and highly scalable 'big data' data stores
- Experience in Python and SQL.
Experience with Boomi is a plus.
- ETL Automation - experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday and Jira
- Knowledge of Databricks Platform
- Knowledge of AI/ML/ Data Science
- Knowledge of BI Tools like Tableau, Looker etc
Education & Experience :
- Bachelor's degree required in related field
- Minimum 5 years related work experience
- Ongoing education in an area related to Data Analytics (Data Sciences, Mathematics, Statistics, Industrial Psychology, Organizational Behavior, or Finance/Accounting) preferred
- Experience working in a high growth company preferred
Keywords : ETL, Databricks, Python, databricks, SQL
Location : Remote
CTC : 18 LPA
-
ETL/Databricks Engineer
4 weeks ago
bangalore, India RS Consultants Full timeETL (Databricks)Job description : Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data...
-
ETL/Databricks Engineer
1 month ago
Bangalore, Karnataka, India RS Consultants Full timeETL (Databricks)Job description : Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data...
-
Senior Azure Data Engineer
1 month ago
Mumbai/Bangalore, Maharashtra, India Techno Wise Full timeResponsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...
-
Senior Azure Data Engineer
1 month ago
Mumbai/Bangalore, India Techno Wise Full timeResponsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...
-
Databricks Engineer
4 weeks ago
bangalore, India Unilode Full timeDatabricks Engineer Position Overview The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization’s data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technical expertise, manage platform resources, and optimize data workflows...
-
Azure Databricks Engineer
1 month ago
Bangalore, India ResourceTree Global Services Full timeJob Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....
-
ETL Data Engineer
4 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeJob Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...
-
ETL Data Engineer
4 weeks ago
Bangalore, India Codersbrain technology pvt ltd Full timeJob Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...
-
Azure Databricks Engineer
1 month ago
bangalore, India Tredence Inc. Full timeRole: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...
-
ETL Developer
2 months ago
Bangalore,Anywhere in India,Multiple Locations HIC Global Solutions Full timeETL Developer Job Description :- Consultant/Sr Consultant - ETL Development - Azure (ADF and DataBricks) Job Location : Gurugram, HaryanaA successful candidate will have the following characteristics:- Responsible for design, development, and implementation of solutions to exchange data using the required ETL tool, Azure Data Factory and DataBricks.- At...
-
Azure Synapse Developer
1 week ago
bangalore, India RapidBraiins Full timeOverview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...
-
Databricks Lead
1 month ago
bangalore, India Wipro Full time6-12+ years of experience in architecting large scale data & analytics systems,2+ years of handson experience in complex Databricks implementations,Architect level certification from Databricks,Strong written, verbal communication skills, ability to present to CXOs,Collaboration is key. He / She has to work with different sales, presales and partner teams in...
-
Databrick Platform Administrator
1 month ago
Bangalore/Chennai/Pune, India Tekfortune IT India Pvt. Ltd. Full timeTitle : Databricks Platform Administrator - SupportExperience : 4 to 10 YearsWork Location : Pune, Chennai & Bangalore LocationShift Timing : Max till 11PMNotice Period : Immediate to 45 DaysKey Skills : Databricks Support, SQL, Integration, Setup & Configuration of Databrick Clusters Job Description : We are seeking a highly skilled and experienced...
-
Databricks Engineer
3 weeks ago
bangalore, India Hunarstreet Technologies Full timeDatabricks Role Overview : As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...
-
Databricks Engineer
3 weeks ago
Bangalore, Karnataka, India Hunarstreet Technologies Full timeDatabricks Role Overview :As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...
-
Databricks Engineer
3 weeks ago
Bangalore, India Hunarstreet Technologies Full timeDatabricks Role Overview : As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...
-
Azure DataBricks Quality Assurance
2 months ago
Bangalore, India Visara Full timeRole: Azure ETL Tester., Databricks tester- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. - Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. - Well versed in Databricks, SQL Database,...
-
Engineering Manager
3 weeks ago
bangalore, India Databricks Full timeP-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...
-
Senior Databricks Engineer
1 week ago
bangalore, India BizViz Technologies Pvt Ltd Full timeJob Description : We are seeking an experienced Databricks Engineer to join our team of innovators. As a Databricks Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures using Databricks, Apache Spark, and other big data technologies. You will work closely with cross-functional teams to...
-
Senior Databricks Engineer
1 week ago
Bangalore, India BizViz Technologies Pvt Ltd Full timeJob Description : We are seeking an experienced Databricks Engineer to join our team of innovators. As a Databricks Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures using Databricks, Apache Spark, and other big data technologies. You will work closely with cross-functional teams to...