Sr. Databricks Engineer

1 week ago

Ahmedabad, Gujarat, India XpertNest Full time ₹ 20,00,000 - ₹ 25,00,000 per year

We are looking for an experienced
Databricks Engineer
to join our data engineering team. The role involves designing, building, and optimizing
data pipelines and workflows
on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with
Spark, PySpark, and SQL
, and can work across diverse data sources in a modern cloud environment.

Key Responsibilities

  • Design, build, and maintain
    data pipelines
    and workflows on Databricks.
  • Implement
    data transformations, aggregations, and validations
    for large datasets.
  • Work with
    structured, semi-structured, and unstructured data
    across multiple sources.
  • Optimize Databricks jobs for
    performance, scalability, and cost efficiency
    .
  • Collaborate with stakeholders to understand business requirements and deliver data-driven solutions.
  • Ensure
    data integrity, security, and compliance
    across all processes.
  • Document solutions, workflows, and provide knowledge transfer to team members.
  • Stay updated with the latest
    Databricks and cloud ecosystem features
    .

Required Skills & Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, or equivalent experience.
  • Proven hands-on experience (X+ years) with
    Databricks
    and
    Apache Spark (PySpark/Scala)
    .
  • Strong proficiency in
    SQL
    and data modeling.
  • Experience with
    Delta Lake
    and modern
    data lakehouse architectures
    .
  • Familiarity with
    cloud platforms
    (Azure, AWS, or GCP).
  • Understanding of
    data governance, lineage, and role-based security
    .
  • Ability to work in
    agile teams
    and communicate effectively with both technical and business stakeholders.

Nice to Have

  • Experience with
    orchestration tools
    (Airflow, Azure Data Factory, AWS Glue).
  • Exposure to
    real-time/streaming data
    (Kafka, EventHub, Kinesis).
  • Knowledge of
    CI/CD for data pipelines
    and Infrastructure-as-Code (Terraform, ARM templates).
  • Familiarity with
    data warehouse solutions
    (Snowflake, BigQuery, Redshift).

  • Databricks Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Steady Rabbit Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks Data EngineerExperience Level: 5 to 7 YearsLocation: AhmedabadEmployment Type: Full-TimeCertifications Required:Databricks Certified Data Engineer AssociateDatabricks Certified Data Engineer ProfessionalCloud Certifications (Preferred): Azure, AWS, GCPJob Summary:We are seeking a highly skilled and certified Databricks Data Engineer to...

  • Sr SQL Test Engineer

    4 days ago

    Ahmedabad, Gujarat, India Gray Acumen Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Sr SQL Test Engineer Databricks (Data Migration)Location: Remote Experience: 5+ YearsEmployment Type: Contract 2 months (Can Extend )Job OverviewWe are seeking a highly skilled SQL Test Engineer with advanced SQL expertise and strong experience in data validation for data migration projects to Databricks. The ideal candidate will have hands-on...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India FastHire Manpower Solution Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Role: Sr. Data EngineerLocation: Navrangpura, AhmedabadWORK FROM OFFICE - 5 DAYS A WEEK (UK Shift)Job Description5+ years of core experience in python & Data Engineering.Must have experience with Azure Data factory and Databricks.Exposed to python-oriented Algorithm's libraries such as NumPy, pandas, beautiful soup, Selenium, pdfplumber, Requests...

  • Sr. Technical Consultant

    5 days ago

    Ahmedabad, Gujarat, India Intech Systems : Microsoft Solutions Partner Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionDesign, develop, and maintain scalable data pipelines using Azure Databricks.Integrate and manage data across Microsoft Fabric, including OneLake, Lakehouse, and Real-Time Analytics.Good to have hands on experience dashboards and reports development using Power BI.Collaborate with cross-functional teams to gather requirements and deliver...

  • Sr. Site Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India hpad Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionHPA Design began as a humble vision by architect Hiren Patel in the late 80s and has since evolved into a beacon of architectural excellence. Rooted in Ahmedabad, our journey started with designing high-rises that set new benchmarks. Today, we've grown into a multifaceted practice delivering diverse projects ranging from private luxury...

  • Sr. Graphics design engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Eunoia Designtech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionEunoia Designtech is a leading design consultancy based in Gujarat. We provide a variety of design services, including mechanical design, civil design, web design and development, graphic design, and social media marketing. Our multidisciplinary team ensures high-quality and innovative solutions for our clients' diverse needs.Role...

  • Sr Full Stack Engineer

    3 days ago

    Ahmedabad, Gujarat, India DXFactor Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    DXFactoris a"Great place to work certified company"We are looking for aPython/FullStack Engineerfor Ahmedabad location.DXFactor is aUS-based tech company working with reputed Health and Fitness companies across the USWe have our presence in:USIndia (Ahmedabad, Bangalore)Web-site: Company DescriptionDXFactor delivers revenue machines for fitness and wellness...

  • Sr. AI/ML Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India TechFlitter Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Sr. AI/ML Ops EngineerAhmedabad - Onsite2-4 yrs expKey ResponsibilitiesDevelop ML & RAG models with Python, CatBoost/XGBoost/LightGBM, LangChain, FAISS; deploy via Docker/FastAPI; integrate APIs; manage CI/CD, Git, cross-team collaboration.Provident fund

  • Sr. Deployment Engineer

    7 days ago

    Ahmedabad, Gujarat, India NEXPLAY SECURE Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    POSITION:Sr. Deployment Engineer (Hosted)REPORTS TO: Director of Telephony ImplementationLOCATION:Ahmedabad, GujaratPRIMARY RESPONSIBILITIES INCLUDE, but are not limited to:We're looking for a Sr. Deployment Engineer to join our team. In this role, you will be a member of the team responsible for deploying voice installations, resources, and...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy...