Senior Databricks Engineer
4 days ago
About the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.Key ResponsibilitiesDesign &- Development:- Build and maintain scalable ETL/ELT data pipelines using Apache Spark and Databricks.- Develop Delta Lake architectures and optimize data storage for performance and cost.- Automate data ingestion, transformation, and orchestration processes across multiple data sources.- Build different stages of medallion architecture such as Bronze, Silver and Gold layerData Architecture & Modeling:- Collaborate with data architects to design data lakehouse and warehouse solutions.- Implement data quality frameworks, versioning, and governance standards (e.g., Unity Catalog).- Optimize Spark jobs, cluster configurations, and query performance.- Cloud & Infrastructure:- Work with Azure Databricks or AWS to configure and manage cloud-based data platforms.- Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs.- Implement security best practices for data access, encryption, and compliance.Collaboration & Leadership:- Partner with data scientists, analysts, and product teams to enable data-driven decisions.- Provide technical mentorship to junior engineers.- Contribute to strategic planning and architecture reviews.Required Qualifications- Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.- 6+ years of experience in data engineering or software development.- 4+ years hands-on experience with Databricks and Apache Spark.- Strong proficiency in Python, SQL, and PySpark.- Experience with Delta Lake, Data Lakehouse, and Data Warehousing concepts.- Solid understanding of data modeling, ETL design, medallion architecture and distributed data processing.- Familiarity with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins, etc.).- Cloud platform expertise in Azure, AWS, or GCP.Preferred Qualifications- Experience with machine learning pipelines in Databricks (MLflow).- Knowledge of data governance and compliance frameworks.- Experience integrating Databricks with BI tools like Power BI, Tableau, or Looker.- Certifications such as:- Databricks Certified Data Engineer Associate or Professional- Azure Data Engineer Associate- AWS Big Data SpecialtySoft Skills- Strong problem-solving and analytical thinking.- Excellent communication and collaboration abilities.- Proactive mindset with ownership of deliverables.- Passion for learning emerging data technologies.Why Join Us- Work with cutting-edge data technologies on large-scale projects.- Opportunity to shape the organization’s data strategy and architecture.- Collaborative and innovative culture focused on continuous growth.
-
Senior Databricks Engineer
5 days ago
Pune, India Newscape Consulting Full timeAbout the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
5 days ago
Pune, India Newscape Consulting Full timeAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
7 days ago
Pune, India Newscape Consulting Full timeAbout the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
7 days ago
pune, India Newscape Consulting Full timeAbout the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
12 hours ago
Pune, India Whatjobs IN C2 Full timeAbout the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
7 days ago
Pune, India Newscape Consulting Full timeAbout the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
7 days ago
pune, India Newscape Consulting Full timeAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Databricks Engineer
7 days ago
Pune, India Newscape Consulting Full timeAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Senior Azure Databricks Engineer
1 week ago
Pune, India TN BUSINESS SERVICES PRIVATE LIMITED Full timeAbout the job : We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole : Senior Azure Databricks EngineerExp : 8 to 12 yrsLocation : Pune/IndoreNotice Period : Immediate to 30 DaysMust-have skills : Azure Databricks heavyYou will play a...
-
Senior Databricks Engineer
2 weeks ago
Pune, Maharashtra, India Newscape Consulting Full time US$ 80,000 - US$ 1,20,000 per yearAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant...
