Databricks Architect

3 weeks ago

Delhi, Delhi, India Kokken Robotics Full time

Job Description :

- Overall 10-18 yrs. of Data Engineering experience with Minimum 4+ years of hands on experience in Databricks. Ready to travel Onsite and work at client location.

- Proven hands-on experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities.

- Analyze business requirements and translate them into technical specifications for data pipelines, data lakes, and analytical processes on the Databricks platform.

- Design and architect end-to-end data solutions, including data ingestion, storage, transformation, and presentation layers, to meet business needs and performance requirements.

- Lead the setup, configuration, and optimization of Databricks clusters, workspaces, and jobs to ensure the platform operates efficiently and meets performance benchmarks.

- Manage access controls and security configurations to ensure data privacy and compliance.

- Design and implement data integration processes, ETL workflows, and data pipelines to extract, transform, and load data from various sources into the Databricks platform.

- Optimize ETL processes to achieve high data quality and reduce latency.

- Monitor and optimize query performance and overall platform performance to ensure efficient execution of analytical queries and data processing jobs.

- Identify and resolve performance bottlenecks in the Databricks environment.

- Establish and enforce best practices, standards, and guidelines for Databricks development, ensuring data quality, consistency, and maintainability.

- Implement data governance and data lineage processes to ensure data accuracy and traceability.

- Mentor and train team members on Databricks best practices, features, and capabilities.

- Conduct knowledge-sharing sessions and workshops to foster a data-driven culture within the organization.

- Will be responsible for Databricks Practice Technical/Partnership initiatives.

- Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.

Roles & Responsibilities :

- Bachelor's or Masters degree in Computer Science, Information Technology, or related field.

- In depth hands-on implementation knowledge on Databricks. Delta Lake, Delta table - Managing Delta Tables, Databricks Cluster Configuration, Cluster policies.

- Experience handling structured and unstructured datasets

- Strong proficiency in programming languages like Python, Scala, or SQL.

- Experience with Cloud platforms like AWS, Azure, or Google Cloud, and understanding of cloud-based data storage and computing services.

- Familiarity with big data technologies like Apache Spark, Hadoop, and data lake architectures.

- Develop and maintain data pipelines, ETL workflows, and analytical processes on the Databricks platform.

- Should have good experience in Data Engineering in Databricks Batch process and Streaming

- Should have good experience in creating Workflows & Scheduling the pipelines.

- Should have good exposure on how to make packages or libraries available in DB.

- Familiarity in Databricks default runtimes

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills :

Databricks, Unity Catalog, Pyspark, ETL, SQL, Delta Live Tables

(ref:hirist.tech)

  • TCS Hiring for Multi cloud Databricks Data Architect_PAN India

    4 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    TCS Hiring for Multi cloud Databricks Data Architect_PAN IndiaExperience: 7 to 15 Years OnlyJob Location: PAN IndiaTCS Hiring for Multi cloud Databricks Data Architect_PAN IndiaRequired Technical Skill Set:7 to 15 yrs. of experience of Data ArchitectingExperience complex data warehousing and data transformation engagements spanning the entire data management...

  • Transformative Data Architect

    1 day ago

    Delhi, Delhi, India beBeeData Full time ₹ 13,70,934 - ₹ 25,15,920

    Job Title: Senior Data Solutions ArchitectAs a seasoned Senior Data Solutions Architect, you will be responsible for designing, building, and optimizing end-to-end data solutions using Microsoft's data platforms.You will work with cross-functional teams to implement contemporary data architecture patterns, create robust data pipelines, and deliver...

  • Senior Data Solutions Architect

    3 days ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking an experienced data architect to design and implement scalable data pipelines and integration solutions using Databricks and Azure Data Factory (ADF).The ideal candidate will have a solid background in big data technologies, cloud platforms, and data processing frameworks to support enterprise-level data transformation and analytics...

  • Cloud Data Architect

    3 days ago

    Delhi, Delhi, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Cloud Data ArchitectWe're seeking a highly skilled Cloud Data Architect to lead our data engineering initiatives. As a key member of our team, you will be responsible for designing and implementing scalable cloud-based data architectures that meet the needs of our clients.The ideal candidate will have hands-on experience with cloud platforms such as AWS,...

  • Lead Oracle HCM Security Architect

    3 weeks ago

    Delhi, Delhi, India EGISEDGE TECHNOLOGIES PVT LTD Full time

    Job Title : Lead Oracle HCM Security ArchitectLocation : RemoteExperience Required : 8+ YearsStart Date : ImmediateJob Description : - Lead the transition to RBAC across Oracle HCM (Core HR, Payroll, Absence, Time, Talent) and downstream systems with complex integrations.- Architect an end-to-end access governance framework, covering application,...

  • Engineering Manager – Big Data, Azure

    4 weeks ago

    Delhi, Delhi, India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms , Microsoft Azure , and ...

  • Cloud Data Architect

    18 hours ago

    Delhi, Delhi, India beBeeCloudDataEngineer Full time ₹ 2,16,00,000 - ₹ 2,59,20,000

    Job Title: Cloud Data ArchitectData Engineering Role Summary:We are seeking a Senior Cloud Data Architect with expertise in cloud-native data engineering, primarily on Microsoft Azure.This role will play a pivotal part in designing and developing data ingestion, transformation, and governance frameworks, enabling real-time and batch data analytics across our...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India SyncWave Corporation Full time

    Job Description : - Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.- Set up and manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS/ACI), Storage Accounts, and Networking.- Design and implement a monitoring and observability framework...

  • Data Engineer

    1 day ago

    Delhi, Delhi, India MindPec Solutions Full time

    - 5 years of hands-on experience in using Python, JVM and Shell Scripting with production experience.- 3 years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must and good to have experience in GCP.- Experience on Data Warehouse design and development per the business nature using any of the...

  • Chief Data Architect

    3 days ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    We are currently seeking a highly skilled professional with 4+ years of experience in Azure Data Engineering and strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies.The ideal candidate will have hands-on experience designing, building, and optimizing ETL pipelines, working with Databricks, and managing large-scale...