Databricks Engineer

1 week ago

Mount Abu, India TTC Group Full time

Role: Databricks EngineerPosition: RemoteType: ContractDuration: 3 - 6 months (extendable) Role OverviewWe are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI/CD for data workloads, and optimizing Spark jobs for performance and reliability.Required SkillsStrong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQLStrong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)Hands-on working experience with Azure DevOps Repo and CI/CDStrong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL/ELT processes Understanding of Agile ways of workingAny experience working in DBT is a plusWorking with Retail Domain is a plusPlatform Engineering & OperationsConfigure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection.Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization.Work with catalogs, Unity Catalog (UC), and access controls for secure data governance.Monitor and troubleshoot performance issues across jobs, clusters, and workflows.CI/CD & DevOpsImplement CI/CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab.Work with Databricks Repos and Git workflows (branching, PRs, code reviews).Version and promote data pipelines across environments.Cloud & IntegrationIntegrate Databricks with cloud services such as:Azure: ADLS Gen2, Key Vault, ADF, Event Hub, SynapseAWS: S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment)Work with data ingestion frameworks, messaging systems, and event-driven architectures.Quality, Testing & DocumentationImplement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks.Maintain pipeline documentation, data dictionaries, and technical design artifacts.Ensure high data quality, reliability, and observability.

  • Data engineer lead

    2 weeks ago

    Mount Abu, India JRD Systems Full time

    About the Role We are seeking an experienced Data Engineer Lead to design, develop, and maintain scalable data solutions on Azure and Databricks as part of our enterprise data modernization initiatives. The ideal candidate will have a strong background in data pipeline development, data integration frameworks , and cloud-based data engineering , with deep...

  • Data Engineer

    1 week ago

    Mount Abu, India Sourcebae Full time

    🚀 Join Our Data Engineering Team in Mumbai! (5-8 Yrs Exp.)We're looking for an experienced and driven Data Engineer to join our team in Mumbai. If you are passionate about building scalable, high-performance data platforms and mentoring the next generation of engineers, this role is for you!This is a Full-Time role with exciting short/medium-term travel...

  • Data Engineer

    1 week ago

    Mount Abu, India Sourcebae Full time

    🚀 Join Our Data Engineering Team in Mumbai! (5-8 Yrs Exp.)We're looking for an experienced and driven Data Engineer to join our team in Mumbai. If you are passionate about building scalable, high-performance data platforms and mentoring the next generation of engineers, this role is for you!This is a Full-Time role with exciting short/medium-term travel...

  • Tavs senior data engineer | pune

    2 days ago

    Mount Abu, India DigiHelic Solutions Pvt. Ltd. Full time

    Job Titile: TAVS Senior Data Engineer Experience : 5+ Years Location: Pune 1. 5+ years in data engineering 2. Proficient in Postgre SQL – design, optimization, management 3. Strong Python skills (Pandas, Num Py) and Databricks/Spark experience 4. Hands-on with Azure data services and scalable pipeline development. (e.g., Data Lake, Data Factory, Synapse)...

  • Data modeler

    2 weeks ago

    Mount Abu, India Stratus Full time

    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks Experience with Agile development methodologies and tools, such as Jira, to plan out Program Increments and Sprints Experienced in end-to-end development of data solutions on Azure using Databricks/Snowflake Perform code reviews and...

  • Data Engineer(Intern)

    3 days ago

    Mount Abu, India Tech Phoenix Full time

    About Tech PhoenixTech Phoenix is a data science and AI startup that delivers cutting-edge solutions to clients across industries. We take on challenging projects ranging from advanced analytics and machine learning to AI-driven automation, helping businesses unlock the full potential of their data. As a growing company, we're constantly pushing boundaries...

  • Data Engineer(Intern)

    4 days ago

    Mount Abu, India Tech Phoenix Full time

    About Tech PhoenixTech Phoenix is a data science and AI startup that delivers cutting-edge solutions to clients across industries. We take on challenging projects ranging from advanced analytics and machine learning to AI-driven automation, helping businesses unlock the full potential of their data. As a growing company, we're constantly pushing boundaries...

  • Senior Data Engineer

    6 hours ago

    Mount Abu, India Sonatype Full time

    Sonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain...

  • Senior Data Engineer

    25 minutes ago

    Mount Abu, India Sonatype Full time

    Sonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain...

  • Data Engineer

    3 days ago

    mount, India NielsenIQ Full time

    Job DescriptionResponsible to assemble large, complex sets of data that meet non-functional and functional business requirements. Responsible to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Building required...