Senior Databricks Data Architect

2 weeks ago

Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

Job Overview:

We are seeking a highly skilled Data Architect to design and implement scalable, high-performance data solutions using Databricks.

The ideal candidate will have hands-on experience in Databricks production environments and a deep understanding of modern data architecture.

As a key member of our team, you will work closely with cross-functional teams to create robust data pipelines and ensure the reliability, quality, and observability of data across platforms.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain data pipelines and ETL processes on Databricks.
  • Architecture and Implementation: Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaboration: Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimization: Optimize data workflows for performance, cost-efficiency, and reliability.
  • Data Integration: Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Data Governance: Implement best practices in data governance, security, and quality management.
  • Troubleshooting: Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity.

Required Skills & Experience:

  • 6-7 years of experience in Data Engineering.
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines for data solutions.

Mentorship and Leadership: Mentor junior engineers and provide technical leadership in data engineering best practices.

What We Offer:

  • Opportunities for professional growth and development.
  • A collaborative and dynamic work environment.
  • A competitive salary and benefits package.

  • Senior Data Solutions Architect

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Solutions ArchitectWe are seeking a highly skilled Senior Data Solutions Architect to join our team.As a Senior Data Solutions Architect, you will be responsible for designing and implementing data architecture solutions that meet the evolving needs of our organization.The ideal candidate should have a strong background in:Azure Synapse...

  • Data Architect Leader

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Data Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and optimizing cloud-native data architectures on platforms like Databricks and Snowflake. Your expertise in data engineering, data architecture, or analytics will enable us to...

  • Chief Data Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data EngineerJob OverviewWe are seeking a skilled professional to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM.The ideal candidate will have expertise in data integration, ETL/ELT, APIs, and Databricks. They will...

  • Databricks Data Ingestion Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Databricks Data Ingestion SpecialistWe are seeking a skilled data ingestion specialist to join our team. As an expert in designing and developing efficient data pipelines, you will play a key role in integrating multiple sources into Databricks.This is an exciting opportunity for individuals who are passionate about working with big data, cloud...

  • Senior Data Architect Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Expertise SoughtWe are looking for an accomplished Senior Data Engineer to join our team.Key Responsibilities:Design and implement efficient data pipelines, processing, and transformation logic using Snowflake.Develop and maintain scalable and modular data pipelines using Databricks and Apache Spark.Experience working on cloud storage...

  • Senior Data Architect

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title">Senior Data Architect">Our company is seeking a skilled and experienced Senior Data Architect to join our team. As a Senior Data Architect, you will be responsible for designing, implementing, and managing data pipelines using AWS services such as Glue, Lambda, EMR, Step Functions, ECS, EC2, and S3.">Responsibilities include:">">Designing and...

  • High-Performance Data Architect

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,24,00,000

    Senior Data Engineer Role Overview">We are seeking an experienced Senior Data Engineer to lead the design, development and optimization of large-scale data processing systems that enable advanced analytics and business intelligence.As a key member of our team, you will collaborate closely with data scientists, analysts, and other engineers to ensure the...

  • Chief Data Technologist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 20,00,000

    Senior Data ArchitectWe are seeking a highly skilled and experienced Senior Data Architect to lead the development of our data strategy and design.The ideal candidate will have hands-on experience with modern unified data platforms (e.g., Databricks, Snowflake) and exposure to Microsoft Azure Fabric (nice to have).Key Responsibilities:Develop and...

  • Senior Data Solutions Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Azure Data EngineerThis pivotal role requires deep technical expertise and leadership to deliver scalable data solutions. We're seeking an experienced Azure Data Engineer to join our team.Key Responsibilities:Lead Databricks architecture, development & operations.Build and optimize ETL/ELT pipelines with Python (PySpark).Set up and maintain CI/CD...

  • Expert Data Solutions Leader

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Chief Data ArchitectWe are seeking a seasoned Chief Data Architect to lead our data strategy and implement scalable, secure, and efficient solutions.The successful candidate will have a strong background in data engineering, including data warehousing, ETL, and data governance. They will be responsible for designing and implementing Databricks...