Senior Databricks Engineer/Technical Lead/Data Architect
6 days ago
Primary Roles And Responsibilities :
Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack.
Ability to provide solutions that are forward-thinking in data engineering and analytics space.
Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.
Help joiner team members to resolve issues and technical challenges.
Drive technical discussion with client architect and team members.
Orchestrate the data pipelines in scheduler via Airflow.
Skills And Qualifications :
Bachelor's and/or masters degree in computer science or equivalent experience.
Must have total 6+ yrs of IT experience and 3+ years' experience in Data warehouse/ETL projects.
Deep understanding of Star and Snowflake dimensional modelling.
Strong knowledge of Data Management principles.
Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
Should have hands-on experience in SQL, Python and Spark (PySpark).
Candidate must have experience in AWS/ Azure stack.
Desirable to have ETL with batch and streaming (Kinesis).
Experience in building ETL / data warehouse transformation processes.
Experience with Apache Kafka for use with streaming data / event-based data.
Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).
Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
Experience working with structured and unstructured data including imaging & geospatial data.
Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot.
Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
Should have experience working in Agile methodology.
Strong verbal and written communication skills.
Strong analytical and problem-solving skills with a high attention to detail.
-
Technical Architect-Databricks
1 week ago
Pune, Maharashtra, India Atos Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole OverviewThe Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.ResponsibilitiesDesign and implement Databricks-based data architectures to meet business...
-
Technical Architect-Databricks
1 week ago
Pune, Maharashtra, India Atos Full time ₹ 8,00,000 - ₹ 20,00,000 per yearRole Overview:The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.Responsibilities:Design and implement Databricks-based data architectures to meet business...
-
Databricks Solution Architect
5 days ago
Pune, Maharashtra, India Codvo Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Databricks Solution ArchitectExperience: 10+ yearsAbout UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with...
-
Databricks Solution Architect
6 days ago
Pune, Maharashtra, India Codvo Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per yearJob Title: Databricks Solution ArchitectExperience: 10+ yearsAbout UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges...
-
Senior Azure Databricks Engineer
2 weeks ago
Pune, Maharashtra, India Newscape Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe're Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face interviews....
-
Senior Databricks Engineer
2 days ago
Pune, Maharashtra, India Newscape Consulting Full time US$ 80,000 - US$ 1,20,000 per yearAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant...
-
Technical Architect-Azure Data Engineering
1 week ago
Pune, Maharashtra, India Atos Full time ₹ 15,00,000 - ₹ 30,00,000 per yearAtos is a global leader in digital transformation.European number one in Cloud, Cybersecurity and High-Performance Computing, the Group provides end-to-end Orchestrated Hybrid Cloud, Big Data, Business Applications and Digital Workplace solutions. The Group is the Worldwide Information Technology Partner for the Olympic & Paralympic Games and operates under...
-
Senior Solution Architect
1 week ago
Pune, Maharashtra, India Thermax Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description : Senior Solution Architect Data.Role OverviewExperienced Senior Solution Architect Data to lead the design and governance of enterprise-wide data platforms and analytics solutions.Lead design and optimization of the data ecosystem for a large engineering enterprise with a diverse application landscape that includes multiple ERPs (Baan,...
-
Azure Data Lead
2 weeks ago
Pune, Maharashtra, India Bridgenext Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAzure Data LeadJob ID: Azu-ETP-Pun-1198Location: Pune,OtherThe Role: As a Lead Data Engineer specializing in Databricks & Master Data Management, you will be a key player in designing, developing, and optimizing our next-generation data platform. You will lead a team of data engineers, providing technical guidance, mentorship, and ensuring the scalable, and...
-
Opportunity Senior Tech Lead
1 week ago
Pune, Maharashtra, India Atos Full time ₹ 12,00,000 - ₹ 24,00,000 per yearDear Candidate,This is with reference for Opportunity Senior Tech Lead Databricks professionalsPFB the Job DescriptionResponsibilities:Lead the design and implementation of Databricks-based data solutions.Architect and optimize data pipelines for batch and streaming data.Provide technical leadership and mentorship to a team of data engineers.Collaborate with...