Current jobs related to Databricks Engineer - Palakkad, Kerala - beBeeDatabricks

  • Azure Databricks Engineer with Injection experience

    3 weeks ago

    Palakkad, Kerala, India Nexify Infosystems Full time

    Title: Azure Databricks Engineer with Injection experience Location: Remote (India)Duration: 6 Month, (if the candidate is good with work, it can be extended to 1+ year )Time: 10.00 AM- 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesfor clarity : We are seeking an Ingestion Engineer with expertise in CI/CD and...

  • Databricks Solution Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Summary:We are seeking an experienced professional to lead the design and development of scalable, secure, and high-performance data solutions on Databricks.About the Role:Design, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of enterprise-grade data solutions that meet business...

  • Senior Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Driven by innovation, we are seeking a seasoned Modern Data Solutions Architect to shape the future of data engineering. This pivotal role demands technical expertise, strategic vision, and leadership to deliver cutting-edge data solutions.Key Responsibilities:Design and lead advanced Databricks architectures, fostering scalability and performance.Develop...

  • Cloud Data Engineer

    1 week ago

    Palakkad, Kerala, India beBeeCloud Full time ₹ 12,99,150 - ₹ 20,31,757

    Cloud Data Engineering ExpertWe are seeking a highly skilled Cloud Data Engineering Expert to join our team.The ideal candidate will have extensive experience working with cloud-based data platforms, including Azure Data Factory and Databricks.They will be responsible for designing, implementing, and maintaining large-scale data pipelines, as well as...

  • Lead Data Engineering Expert

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,40,000 - ₹ 2,01,60,000

    Job Title: Senior Data Engineering LeadWe are seeking a visionary data engineering leader with strong focus on Databricks and cloud-based data engineering to design, develop, and manage scalable data infrastructure and pipelines. This role requires collaboration with business stakeholders, data scientists, and software teams to understand requirements and...

  • Data Engineering Lead

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock the power of big data and propel your career as a Data Engineer. We seek a skilled professional with expertise in Spark and SQL to join our innovative team.Key Responsibilities:Design and develop scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark)Integrate data from various sources, ensuring data quality and...

  • Data Engineering Leadership Role

    1 week ago

    Palakkad, Kerala, India beBeeData Full time US$ 1,62,000 - US$ 2,43,000

    Senior Data Engineer Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our technology team. This individual will be responsible for leading the development of a self-service data platform for reporting and analytics, building scalable data solutions with Databricks, SQL, Python, Spark, and Delta Lake on Azure, and ensuring best...

  • High-Performance Data Engineering Leader

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Data EngineerAt our organization, we are seeking a visionary Senior Lead Data Engineer to spearhead the development of high-performance data solutions across multiple domains.The ideal candidate will have extensive hands-on experience with Databricks and expert-level proficiency in Python, PySpark, and distributed data processing, as well as a profound...

  • Azure Data Engineer

    2 weeks ago

    Palakkad, Kerala, India Texplorers Inc Full time

    We are seeking a skilled Data Engineer with proficient knowledge in Spark and SQLto join our dynamic team. The ideal candidate will be responsible for designing,implementing, and optimizing data pipelines on our Data platform. You will workclosely with data architects, and other stakeholders to ensure data accessibility,reliability, and performance.Key...

  • AWS Data Engineer

    2 weeks ago

    Palakkad, Kerala, India Reveille Technologies,Inc Full time

    Hiring: Data Engineer - FTE Location: Coimbatore Experience: 3–5 Years | Type: Full-Time (FTE) Budget: Up to ₹14 LPA Notice Period: Immediate Joiners Only Mandatory Skills:AWSPythonPySparkDatabricks Interested? DM or share your resume : rajesh@reveilletechnologies.com ./.

Databricks Engineer

3 weeks ago

Palakkad, Kerala, India beBeeDatabricks Full time ₹ 10,00,000 - ₹ 20,00,000

Job Title: Databricks Engineer

Summary:
  • This role involves designing and developing scalable ETL processes to efficiently extract, transform, and load data from various sources into our data lake and data warehouse.

We are looking for an experienced ETL developer with a strong background in Databricks PySpark development to join our team.

Key Responsibilities:
  • Data Engineering:
    • Design and develop efficient ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources.
    • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL.
    • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Data Pipeline Management:
    • Create and maintain advanced data pipelines using Databricks workflows.
    • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
  • Query Optimization:
    • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.

Required Qualifications:

  • Bachelor's degree in Computer Science or related field.
  • Minimum 3 years of experience as an ETL developer with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming with extensive experience in developing and debugging Databricks PySpark applications.
  • Expertise in writing and optimizing complex SQL queries.
  • Strong understanding of data governance and data quality principles.

Preferred Qualifications:

  • Experience with cloud platforms such as AWS.
  • Relevant certifications in Databricks PySpark or related technologies.