Databricks Data Engineer

2 weeks ago

Ahmedabad, Gujarat, India Steady Rabbit Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title: Databricks Data Engineer

Experience Level: 5 to 7 Years

Location: Ahmedabad

Employment Type: Full-Time

Certifications Required:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Cloud Certifications (Preferred): Azure, AWS, GCP

Job Summary:

We are seeking a highly skilled and certified Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will have hands-on experience in implementing Lakehouse architectures, upgrading to Unity Catalog, and building robust data ingestion pipelines. This role demands proficiency in Python, PySpark, SQL, and Scala, along with a strong understanding of big data technologies, streaming workflows, and multi-cloud environments.

Key Responsibilities:

Lakehouse Implementation:

  • Design and implement scalable Lakehouse architecture using Databricks.
  • Optimize data storage and retrieval strategies for performance and cost-efficiency.

Unity Catalog Upgrade:

  • Lead and execute Unity Catalog upgrades across Databricks workspaces.
  • Ensure secure and compliant data governance and access control.

Data Ingestion & Migration:

  • Develop and maintain data ingestion pipelines from various sources (structured, semi-structured, unstructured).
  • Perform large-scale data migrations across cloud platforms and environments.

Pipeline Development:

  • Build and manage ETL/ELT pipelines using PySpark and SQL.
  • Ensure data quality, reliability, and performance across workflows.

Big Data Streaming & Workflows:

  • Implement real-time data streaming solutions using Spark Structured Streaming or similar technologies.
  • Design workflow orchestration using tools like Airflow, Databricks Workflows, or equivalent.

Multi-Cloud Expertise (Preferred):

  • Work across Azure, AWS, and GCP environments.
  • Understand cloud-native services and integration patterns for data engineering.

Collaboration & Documentation:

  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
  • Document technical designs, data flows, and operational procedures.

Required Skills & Qualifications:

  • 57 years of hands-on experience in data engineering roles.
  • Strong expertise in Databricks platform and ecosystem.
  • Proficiency in Python, PySpark, SQL, and Scala.
  • Experience with Lakehouse architecture and Unity Catalog.
  • Proven track record in building scalable data ingestion pipelines and performing data migrations.
  • Familiarity with big data technologies such as Delta Lake, Apache Spark, Kafka, etc.
  • Understanding of data lake concepts and best practices.
  • Experience with streaming data and workflow orchestration.
  • Certified as Databricks Data Engineer Associate and Professional (mandatory).
  • Cloud certifications in Azure, AWS, or GCP are a strong plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Nice to Have:

  • Experience with CI/CD pipelines and DevOps practices in data engineering.
  • Exposure to data cataloging tools and metadata management.
  • Knowledge of data security, privacy, and compliance standards.

  • Sr. Databricks Engineer

    1 week ago

    Ahmedabad, Gujarat, India XpertNest Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for an experiencedDatabricks Engineerto join our data engineering team. The role involves designing, building, and optimizingdata pipelines and workflowson Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience withSpark, PySpark, and SQL, and can work across...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India FastHire Manpower Solution Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Role: Sr. Data EngineerLocation: Navrangpura, AhmedabadWORK FROM OFFICE - 5 DAYS A WEEK (UK Shift)Job Description5+ years of core experience in python & Data Engineering.Must have experience with Azure Data factory and Databricks.Exposed to python-oriented Algorithm's libraries such as NumPy, pandas, beautiful soup, Selenium, pdfplumber, Requests...

  • Lead Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 16,700 stores in 31 countries, serving more than 9 million customers each day. At Circle K, we are building a best-in-class global data engineering practice to support intelligent business decision-making and drive...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Smart Lion Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Design, build, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse, and Databricks.Develop, optimize data models for reporting and analytics in Power BI.Create and maintain dashboards and reports to support business decision-making. Required Candidate profileStrong experience with Azure Data Factory, Synapse Analytics, and Databricks, Power BI...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India NowWiN International Full time

    Job Title: Senior Data EngineerLocation:Indore / Ahmedabad (India)Experience:7+ yearsType:Full-time / ContractJoining:Immediate preferredAbout the RoleWe are looking for an experiencedLead Data Engineerto design, build, and maintain scalabledata pipelines and ETL workflowsusingAzure Data Factory (ADF),Databricks, andPower BI / Fabric.You'll collaborate with...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy...

  • Opening for Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opportunity: Data EngineerLocation:Pune /Indore/AhmedabadNotice Period:Immediate to 30 DaysWe have two open positions.1).Data Engineers with Snowflake -Snowflake, Databricks, SQL databases , PySpark, Tableau, ETL processes2) Data Engineer -No SQL and SQL databases, DynamoDB, PowerBI, data modeling, ETL processes and data warehousing, AWS Services like...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Source-Right Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Data Engineer (CE60SF RM 3570)Shift timing : General ShiftRelevant Experience required : 4+ yearsEducation Required : Bachelor's / Masters / PhD : B.E Computers, MCA is preferableMust have skills:Azure Data Factory and Databricks (PySpark/SQL)Python (pandas/PySpark)SQLCI/CD (Azure DevOps/GitHub Actions/Jenkins).exposure to drift detection and...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy...

  • Data Modeler

    1 week ago

    Ahmedabad, Gujarat, India Vikash Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role : We are seeking a highly skilled Data Engineer / Data Modeller with deep expertise in dimensional data modelling, data warehousing, and SQL-based analytics architecture. The ideal candidate will have strong experience in designing data models optimized for business intelligence (BI), analytics, and reporting performance across platforms...