Data Solutions Architect

1 week ago

Thiruvananthapuram, Kerala, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 20,00,000

Role Summary

We are seeking a highly skilled Databricks PySpark Developer to join our team in designing, developing and maintaining ETL processes. In this role, you will be instrumental in extracting, transforming and loading data from various sources into data lake and data warehouse.

Key Responsibilities
  • ETL Development:
    • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
    • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
    • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
    • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
    • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.
  • Data Pipeline Management:
    • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
    • Collaborate with data engineering, data science, and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.
  • Data Analysis and Query Optimization:
    • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
  • Project Coordination and Continuous Improvement:
    • Participate in project planning and coordination activities to ensure timely delivery of ETL solutions.
    • Stay updated on the latest developments in Databricks PySpark, Spark SQL, and related technologies, recommending and implementing best practices and optimizations.
    • Document ETL processes, data lineage, and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.

  • Data Solutions Architect

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeFabric Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Architect OpportunityDescription:We are seeking a skilled Cloud Data Architect to design and implement scalable analytics platforms in the Microsoft ecosystem. This role is remote, where you will define architecture, guide implementation, and enable data teams to deliver insights faster and with enterprise-grade governance.Key...

  • Senior Salesforce Technical And Solution Architect

    1 week ago

    Thiruvananthapuram, Kerala, India Epergne Solutions Full time

    Role Senior Salesforce Technical and Solution Architect Experience 10 Years Location Bengaluru Bhubaneswar Chandigarh Chennai Gurgaon Hyderabad Indore Jaipur Mangalore Mohali Mumbai Mysore Nagpur Pune Thiruvananthapuram Notice Period Immediate 15 Days NP Job Summary We are seeking a highly experienced and strategic Senior...

  • AWS Cloud Data Solutions Architect

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionWe are seeking a highly skilled professional with expertise in designing, architecting, and implementing scalable data engineering solutions on the AWS Cloud. As a Big Data Engineer, you will play a critical role in developing and optimizing large-scale data processing systems, ensuring high-quality, reliable data delivery for...

  • Senior Data Solutions Architect

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Job DescriptionWe are seeking a skilled data professional to design, develop and manage data pipelines and transformation frameworks that enable analytics, reporting and business intelligence capabilities across the enterprise.The ideal candidate will play a critical role in working closely with data architects, platform engineers and DevOps teams to build...

  • AI Solutions Architect

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeArtificialintelligence Full time ₹ 15,00,000 - ₹ 20,00,000

    AI Solutions ArchitectWe are seeking a highly skilled Artificial Intelligence Solutions Architect to join our team. As an AI Solutions Architect, you will be responsible for designing and developing innovative solutions using artificial intelligence, machine learning, and data science.Your primary focus will be on creating business value through the...

  • Search Solutions Architect

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeSearch Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Search Solutions ArchitectWe are seeking a seasoned Search Solutions Architect to design and implement cutting-edge search solutions that utilize OpenSearch/Elasticsearch.About the Role:The ideal candidate will have extensive experience with Elasticsearch or OpenSearch in production environments, including expertise in AI/LLM-based search...

  • Expert Data Solutions Leader

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Chief Data ArchitectWe are seeking a seasoned Chief Data Architect to lead our data strategy and implement scalable, secure, and efficient solutions.The successful candidate will have a strong background in data engineering, including data warehousing, ETL, and data governance. They will be responsible for designing and implementing Databricks...

  • Advanced Cloud Data Solutions Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 14,00,000 - ₹ 17,00,000

    Cloud Data Engineer PositionWe are seeking a skilled Cloud Data Engineer to join our elite team addressing complex industry problems. As a Cloud Data Engineer, you will provide technical expertise in agile development teams for a next-generation healthcare data and analytics platform.You are expected to be an accomplished software engineer with experience in...

  • Senior Solutions Architect

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 31,00,000

    Solutions Architect RoleWith 8-10 years of experience in designing, implementing, and maintaining data solutions on Microsoft Azure Data platform and SQL Server.Design scalable and reliable data pipelines using Azure Data Factory and Databricks for efficient data processing.Main Responsibilities:Build solutions in Azure Data Factory and Databricks to...

  • Lead Data Architect

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Architect Job DescriptionWe are seeking a highly skilled and experienced Senior Data Architect to join our team. As a Senior Data Architect, you will play a key role in designing and implementing cutting-edge data architectures that drive business success.Job Responsibilities:Design and implement enterprise-wide data architectures that meet...