Senior Databricks Developer

3 weeks ago

Remote, India AsalJobs Full time
Job Title: Senior Databricks Engineer

Job Summary:

We are seeking a highly skilled Senior Databricks Engineer to join our team at AsalJobs. The ideal candidate will have a strong background in data engineering, with expertise in Databricks, Spark, and Azure Data Factory.

Key Responsibilities:

  • Design, implement, and optimize end-to-end data pipelines using Azure Databricks.
  • Utilize Azure Databricks for data transformation tasks, including cleansing, aggregation, and enrichment of datasets.
  • Implement automation for data workflows and monitoring pipelines to ensure data integrity and availability.
  • Collaborate with actuarial scientists and analysts to deliver high-quality data solutions.

Requirements:

  • 6-10 years of hands-on experience in SQL and Python development.
  • Proven track record of building complex data validation and transformation projects using both SQL and Python.
  • Demonstrated experience working in a financial services company, with a focus on life insurance sector.
  • Strong practical knowledge in SQL and Python, with an emphasis on creating reusable code.
  • Experience with data manipulation tools and libraries, including Pandas and NumPy.
  • Experience with relational and NoSQL databases, including SQL Server and CosmosDB.
  • Experience with data integration tools and techniques, including ETL processes and data pipelines.
  • Proficient in writing base code that dynamically generates multiple code instances based on a configuration file.
  • Experience working in Azure cloud environment, particularly with data lakes.
  • A solid knowledge and experience in well-architected frameworks for data platforms in the cloud.
  • Familiarity with writing SQL or Python code for accessing and processing data in a data lake.
  • Knowledge of Databricks, Spark, or similar frameworks for processing large datasets.
  • Knowledge of Apache Spark, including Spark SQL and DataFrame/Dataset API.
  • Proficiency in setting up and managing Databricks clusters, notebooks, and jobs within the Azure ecosystem.
  • Understanding of Azure security best practices and compliance standards relevant to data engineering workflows in Azure Databricks.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work with a talented team of data engineers and scientists.
  • A collaborative and dynamic work environment.

How to Apply:

Please submit your resume and a cover letter outlining your experience and qualifications for this role.

  • Big Data Architect

    5 months ago

    Remote, India Databricks Full time

    CSQ424R34 As a** Big Data Architect **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    5 months ago

    Remote, India Databricks Full time

    CSQ225R24 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Big Data Architect

    5 months ago

    Remote, India Databricks Full time

    As an **Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help...

  • Architect : Big Data

    5 months ago

    Remote, India Databricks Full time

    CSQ225R23 As a** Resident Solutions Architect (Big Data)**, you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Architect - Big Data

    5 months ago

    Remote, India Databricks Full time

    CSQ125R88 As an **Architect (Big Data) **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Databricks Support

    2 weeks ago

    Remote, India NewPage Digital Healthcare Solutions Full time

    **Benefits**: Flexible and remote work Employee-centric culture Supportive peers Work-life balance Generous earnings Opportunities for growth Who Are We? NewPage is a digital health solutions company. We devote ourselves to advancing the quality of life by enhancing the health and optimizing the longevity of people. We do this by, passionately building...

  • Databricks Technical Architect

    4 weeks ago

    Remote, India ASOKAA DEVELOPERS PRIVATE LIMITED Full time

    Job Title: Databricks Technical ArchitectASOKAA DEVELOPERS PRIVATE LIMITED is seeking a highly skilled Databricks Technical Architect to join our team. The ideal candidate will have a strong background in data engineering and AI/ML solutioning, with significant experience in Databricks and Generative AI technologies.Key Responsibilities:Design and implement...

  • Senior Data Architect

    1 month ago

    Remote, IN HNM Solutions Full time

    Job Description :- Design and implement scalable data architectures to support complex analytics and business intelligence requirements.- Develop data models, data flow diagrams, and data integration strategies.- Create and maintain comprehensive data dictionaries and metadata repositories.- Lead the development and optimization of data pipelines using...

  • Senior Data Architect

    4 weeks ago

    Remote, India HNM Solutions Full time

    Job Description : - Design and implement scalable data architectures to support complex analytics and business intelligence requirements.- Develop data models, data flow diagrams, and data integration strategies.- Create and maintain comprehensive data dictionaries and metadata repositories.- Lead the development and optimization of data pipelines using...

  • Data Engineer

    1 month ago

    Remote, IN ThinkMove Solutions Full time

    Salary : 14 - 18 LPA Overview :We are seeking a skilled and experienced Data Engineer with a specialization in DataBricks to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing and analytics. Your...

  • Data Architect with DataBricks Expertise

    2 weeks ago

    Remote, India ThinkMove Solutions Full time

    Overview :We are seeking a skilled Data Engineer with a specialization in DataBricks to join our dynamic team at ThinkMove Solutions. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing and analytics. Your expertise in...

  • Senior Databricks Engineer

    1 month ago

    Remote, IN AsalJobs Full time

    Mandatory Skills : Python, SQL, Spark,, Azure Databricks, Azure Data Factory , NoSQLJob Description :This candidate brings a unique blend of technical expertise in SQL and Python, coupled with industry specific experience in financial services, making them well-suited to tackle complex data challenges within a life insurance setting.Experience :- 6-10 years...

  • Databricks Technical Architect

    2 weeks ago

    Remote, India ASOKAA DEVELOPERS PRIVATE LIMITED Full time

    Databricks Technical Architect RoleAt ASOKAA DEVELOPERS PRIVATE LIMITED, we are seeking an experienced Databricks Technical Architect to join our team.This is a pre-sales role that requires a strong understanding of Databricks architecture, Spark, Delta Lake, and data lake house concepts, as well as experience with Generative AI technologies.The successful...

  • Looking for Azure Databricks Trainer

    1 month ago

    Remote, India Intellecto Global Services Full time

    We are looking for a skilled and enthusiastic Part-Time Azure Databricks Trainer to join our team. In this role, you will provide hands-on training to learners, helping them harness the power of Azure Databricks for big data analytics and machine learning. **Key Responsibilities**: - Develop and deliver comprehensive training materials, including...

  • Azure Platform Subject Matter Expert

    1 month ago

    Remote, IN TETRAHED INC Full time

    Mandatory Skills : Azure Cloud Platform, Azure services including advanced knowledge of Azure Databricks, Hive Metastore, and Presto, Azure Kubernetes Service (AKS) Terraform, Ansible, Azure DevOps tools, Azure Databricks, GitHubLocation : RemoteResponsibilities : - Azure Databricks Management : Oversee and optimize Azure Databricks environments to ensure...

  • Azure Platform Subject Matter Expert

    1 month ago

    Remote, India TETRAHED INC Full time

    Mandatory Skills : Azure Cloud Platform, Azure services including advanced knowledge of Azure Databricks, Hive Metastore, and Presto, Azure Kubernetes Service (AKS) Terraform, Ansible, Azure DevOps tools, Azure Databricks, GitHubLocation : RemoteResponsibilities : - Azure Databricks Management : Oversee and optimize Azure Databricks environments to ensure...

  • Azure Data Engineer

    1 month ago

    Remote, India Intigniz Solutions Pvt Ltd Full time

    Job role : Azure Data EngineerLocation : Hyderabad/ RemoteJob Overview :We are seeking an experienced Senior and Lead Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Azure big data tools and a proven track record in managing complex data engineering projects. This role demands hands-on experience in building...

  • Senior Data Engineer

    4 weeks ago

    Remote, India AsalJobs Full time

    Job DescriptionRole SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at AsalJobs. The ideal candidate will have a strong background in data engineering, with expertise in Databricks, Spark, and Azure cloud environment.Key ResponsibilitiesDesign, implement, and optimize end-to-end data pipelines using Azure Databricks, ensuring...

  • Senior Data Architect

    1 week ago

    Remote, India HNM Solutions Full time

    **Job Title:** Senior Data ArchitectAbout the Role:HNM Solutions is seeking an experienced Senior Data Architect to design and implement scalable data architectures that support complex analytics and business intelligence requirements.Responsibilities:Develop data models, data flow diagrams, and data integration strategies to optimize data pipelines.Create...

  • Senior Data Architect

    2 weeks ago

    Remote, India Informica Full time

    Job Description for Senior Data Architect:fintech data lake project. The ideal candidate will have strong experience in data warehousing systems, Oracle Fusion ecosystem, and big data/Databricks environment.Key Responsibilities:Design and develop data ingestion pipelines from Oracle Fusion Cloud to a Databricks environment.Develop strong data...