Senior Databricks Engineer

4 weeks ago

BangaloreChennaiDelhi NCRPuneKolkata, India Zyoin group Full time

Job Description :


Mandatory Skills : Python/ PySpark / Spark with Azure/ AWS Databricks


Primary Roles and Responsibilities :


- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack


- Ability to provide solutions that are forward-thinking in data engineering and analytics space


- Collaborate with DW/BI leads to understanding new ETL pipeline development requirements.


- Triage issues to find gaps in existing pipelines and fix the issues


- Work with businesses to understand the need in the reporting layer and develop a data model to fulfil reporting needs


- Help joiner team members to resolve issues and technical challenges.


- Drive technical discussions with client architects and team members


- Orchestrate the data pipelines in the scheduler via Airflow


Skills and Qualifications :


- Bachelor's and/or masters degree in computer science or equivalent experience.


- Must have a total 6+ years of IT experience and 3+ years' experience in Data warehouse/ETL projects.


- Deep understanding of Star and Snowflake dimensional modelling.


- Strong knowledge of Data Management principles


- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture


- Should have hands-on experience in SQL, Python and Spark (PySpark)


- Candidate must have experience in AWS/ Azure stack


Desirable to have :


- ETL with batch and streaming (Kinesis).


- Experience in building ETL / data warehouse transformation processes


- Experience with Apache Kafka for use with streaming data / event-based data


- Experience with other Open-Source big data products, Hadoop (incl. Hive, Pig, Impala)


- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)


- Experience working with structured and unstructured data, including imaging and geospatial data.


- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, and GIT.


- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, and troubleshooting


- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).


- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects


- Should have experience working in Agile methodology


- Strong verbal and written communication skills.


- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)

  • Senior Software Engineer

    7 days ago

    bangalore, India Databricks Full time

    P-926 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Sr Recruiter

    5 days ago

    bangalore, India Databricks Full time

    We are looking for a Senior Tech Recruiter to help grow & expand our Engineering vertical in India. You will be the driving force behind finding and engaging with some of the finest Engineering talent in the industry as we continue to scale our team on all fronts. This is an exciting time to be part of the rocketship and the Databricks expansion in India!...

  • Apache Spark™ Backline Engineer

    7 days ago

    bangalore, India Databricks Full time

    Mission As a Apache Spark™ Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all...

  • Senior Security Engineer

    5 days ago

    Chennai, India Databricks Full time

    RDQ324R4TheIncident Responseteam's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...

  • Technical Solutions Engineer- Apache Spark™

    4 hours ago

    bangalore, India Databricks Full time

    CSQ125R2 Mission As a Technical Solutions Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that...

  • Sr Technical Solutions Engineer- Apache Spark™

    4 hours ago

    bangalore, India Databricks Full time

    CSQ125R2 Mission As a Sr Technical Solutions Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure...

  • Senior Security Engineer

    7 days ago

    chennai, India Databricks Full time

    RDQ324R4 The Incident Response team's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...

  • Senior Security Engineer

    1 week ago

    Chennai, India Databricks Full time

    RDQ324R4The Incident Response team's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...

  • Databricks Engineer

    1 week ago

    bangalore, India Unilode Full time

    Databricks Engineer Position Overview The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization’s data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technical expertise, manage platform resources, and optimize data workflows...

  • Sr Data Engineer

    1 week ago

    Chennai, India Databricks Full time

    CSQ125R30As a Sr Data Engineer (Sr Solutions Consultant) in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training,...

  • Sr Data Engineer

    7 days ago

    chennai, India Databricks Full time

    CSQ125R30 As a Sr Data Engineer (Sr Solutions Consultant) in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems,...

  • Backline Engineer, Platform

    7 days ago

    bangalore, India Databricks Full time

    At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve...

  • Sr Data Engineer

    7 days ago

    Chennai, India Databricks Full time

    CSQ125R30As aSr Data Engineer (Sr Solutions Consultant)in our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Senior Data Engineer

    4 weeks ago

    Bangalore,Trivandrum,Thiruvananthapuram,Chennai,Pune, India Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Azure Databricks Engineer

    2 weeks ago

    Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....

  • Technical Services Engineer

    4 hours ago

    bangalore, India Databricks Full time

    CSQ325R3 Mission :At Databricks, we are on a mission to empower our customers to solve the world’s toughest data problems by utilizing the Data Intelligence platform. As a Technical Services Engineer you will play a critical role in advising Customers in their onboarding journey. You will directly work with customers to help them onboard and deploy...

  • Sr Manager, Product Security

    4 hours ago

    bangalore, India Databricks Full time

    RDQ124R86 The Product Security Team's mission is to Left-shift SDLC (Security Development Lifecycle) processes for ALL code written in Databricks (for Customer Use or Supporting Customer internally) to reduce the likelihood of introducing new vulnerabilities in production and minimize the count and effect of externally identified vulnerabilities on...

  • FHN - Senior Databricks Developer

    3 weeks ago

    Delhi, India Marlabs LLC Full time

    Description:Job Title: Senior Data Engineer - Azure Databricks and Azure Native ServicesLocation: Bangalore,IndiaPosition Overview:We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for designing, building, and...

  • Staff Software Engineer

    7 days ago

    bangalore, India Databricks Full time

    P-926 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...