Databricks Data Engineer Consultant

7 days ago

Bengaluru, Karnataka, India BSR & Co Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Description

Job Requirements

Mandatory Skills

  • Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline
  • 5+ years of relevant experience in data engineering roles
  • Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding
  • Proficient in programming languages: Python
  • Experienced with Databricks designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools(Unity Catalog, Workflow, Autoloader, delta sharing) to process large datasets and extract actionable business insights.
  • Databrick (e.g., DBX notebooks, SQL, Python/Spark, asset bundles, GIT, etc.) 
  • Experience building metrics deck and dashboards for KPIs including the underlying data models.
  • Understand how to design, implement, and maintain a platform providing secured access to large datasets
  • Workday Integration experience (Preferred)
Responsibilities

Primary Roles and Responsibilities 

An Databricks Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency. 

Preferred Skills

  • Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline
  • 5+ years of work experience with ETL, Data Modelling, and Data Architecture.
  • Experienced with Databricks designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools(Unity Catalog, Workflow, Autoloader, delta sharing) to process large datasets and extract actionable business insights.
  • Workday Integration experience (Preferred)
  • Ability to develop experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations
  • Proven track record partnering with business owners to understand requirements and developing analysis to solve their business problems
  • Proven analytical and quantitative ability and a passion for enabling customers to use data and metrics to back up assumptions, develop business cases, and complete root cause analysis

  • Senior Technical Solutions Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    P-1377Databricks helps data teams solve the world's toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the original...

  • Sr. Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ426R101As a Senior Solutions Architect, you will shape the future of the Data & AI landscape by working with the most sophisticated data engineering and data science teams in the world. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers...

  • Engineering Manager

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Technical Solutions Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1364As a Spark Staff Technical Solutions Engineer, you will provide a deep dive technical and consulting related solutions for the challenging Apache Spark/ML/AI/Delta/Streaming/Lakehouse reported issues by our customers and resolve any challenges involving the Databricks unified analytics platform with your highly comprehensive technical and customer...

  • Sr Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 25,00,000 - ₹ 50,00,000 per year

    P-1348At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Our...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Software Engineer - Data Platform P-1348 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that...

  • Databricks Data Engineer Consultant

    1 week ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Job RequirementsMandatory SkillsBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 5+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic...

  • Engineering Manager

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Backline Engineer

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1386At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...