Databricks Developer

3 weeks ago

Mumbai, Maharashtra, India Seaspan Corporation Full time

Position Description :

We are seeking a skilled Databricks Developer to join our Data Development team. Reporting to the Team Lead, Data Development, the Databricks Developer implements robust data pipelines using Apache Spark on Databricks, supports advanced data transformation, and enables scalable data products that serve enterprise analytics and reporting needs. Youll work closely with data engineers and analysts to ensure high-performance, reliable data pipelines and quality outputs.

This is a hands-on development role focused on engineering scalable, maintainable, and optimized data flows in a modern cloud-based environment.

Job Responsibilities :

- Design, build, and maintain scalable data pipelines and workflows using Databricks (SQL, PySpark, Delta Lake).

- Develop efficient ETL/ELT pipelines for structured and semi-structured data using Azure Data Factory (ADF) and Databricks notebooks/jobs.

- Integrate and transform large-scale datasets from multiple sources into unified, analytics-ready outputs.

- Optimize Spark jobs and manage Delta Lake performance using techniques such as partitioning, Z-ordering, broadcast joins, and caching.

- Design and implement data ingestion pipelines for RESTful APIs, transforming JSON responses into Spark tables.

- Apply best practices in data modeling and data warehousing concepts.

- Perform data validation and quality checks.

- Work with various data formats, including JSON, Parquet, and Avro.

- Build and manage data orchestration pipelines, including linked services and datasets for ADLS, Databricks, and SQL Server.

- Create parameterized and dynamic ADF pipelines, and trigger Databricks notebooks from ADF.

- Collaborate closely with Data Scientists, Data Analysts, Business Analysts, and Data Architects to deliver trusted, high-quality datasets.

- Contribute to data governance, metadata documentation, and ensure adherence to data quality standards.

- Use version control tools (e.g., Git) and CI/CD pipelines to manage code deployment and workflow changes.

- Develop real-time and batch processing pipelines for streaming data sources such as MQTT, Kafka, and Event Hub.

Requirements :

- 5+ years of experience in data engineering or big data development.

- Bachelor's degree in computer science or a relevant field, or equivalent training and work experience

- Strong hands-on experience with Databricks and Apache Spark (PySpark/SQL).

- Proven experience with Azure Data Factory, Azure Data Lake, and related Azure services.

- Experience integrating with APIs using libraries such as requests and http.

- Deep understanding of Delta Lake architecture, including performance tuning and advanced features.

- Proficiency in SQL and Python for data processing, transformation, and validation.

- Familiarity with data lakehouse architecture and both real-time and batch processing design patterns.

- Comfortable working with Git, DevOps pipelines, and Agile delivery methodologies

Additional Desired Qualifications :

- Experience with dbt, Azure Synapse, or Microsoft Fabric.

- Familiarity with Unity Catalog features in Databricks.

- Relevant certifications such as Azure Data Engineer, Databricks, or similar.

- Understanding of predictive modeling, anomaly detection, or machine learning, particularly with IoT datasets.

Job Demands and/or Physical Requirements :

As Seaspan is a global company, occasional work outside of regular office hours may be required.

(ref:hirist.tech)

  • Databricks Developer

    3 days ago

    Mumbai, Maharashtra, India Stanra Tech Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal...

  • Databricks

    6 days ago

    Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Freelancer For Databricks With Spark

    3 days ago

    Mumbai, Maharashtra, India Mindmajic Technologies Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionMindmajic Technologies provides comprehensive cloud services for the design, development, integration, and maintenance of cloud-based apps, with expertise in AWS. We focus on personal interaction and mutual trust to achieve our goals, emphasizing cooperation and teamwork. We are committed to providing the best service and support to our...

  • AWS Databricks

    3 days ago

    Mumbai, Maharashtra, India Future Focus Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Greetings from Future Focus InfotechWe have multiple opportunities AWS Databricks DeveloperExp: 5+yrsLocation : MumbaiJob Type- This is a Permanent position with Future Focus Infotech Pvt Ltd & you will be deputed with our client.A small glimpse about Future Focus Infotech Pvt Ltd. (Company URL: )If you are interested in above opportunity, send updated CV...

  • Senior Azure Databricks Engineer

    3 days ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • BI Reports Developer

    2 weeks ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ROLES & RESPONSIBILITIESJob Description – Databricks BI / AI BI Genie Specialist (AWS Cloud)Position: Senior Data & BI EngineerLocation: [Hybrid]Experience: 6–10 yearsDomain: Data Engineering, Business Intelligence, Cloud AnalyticsRole OverviewWe are seeking a highly skilled Databricks BI Specialist with expertise in AI BI Genie (or similar BI/AI-driven...

  • BI Reports Developer

    2 weeks ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ROLES & RESPONSIBILITIESJob Description – Databricks BI / AI BI Genie Specialist (AWS Cloud)Position: Senior Data & BI EngineerLocation: [Hybrid]Experience: 6–10 yearsDomain: Data Engineering, Business Intelligence, Cloud AnalyticsRole OverviewWe are seeking a highly skilled Databricks BI Specialist with expertise in AI BI Genie (or similar BI/AI-driven...

  • Java Full Stack Developer

    3 days ago

    Mumbai, Maharashtra, India Oracle Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job ResponsibilitiesDesign, develop, and maintain scalable enterprise applications using Java, Spring Boot, and Python .Build and manage data pipelines and work on Databricks for analytics and transformation tasks.Develop, optimize, and maintain solutions using Oracle databases with strong SQL and PL/SQL.Deploy and manage applications on AWS cloud , ensuring...

  • 3 Days Left Java Full Stack Developer

    4 weeks ago

    Mumbai, Maharashtra, India Oracle Full time

    Job DescriptionJob Responsibilities- Design, develop, and maintain scalable enterprise applications using Java, Spring Boot, and Python.- Build and manage data pipelines and work on Databricks for analytics and transformation tasks.- Develop, optimize, and maintain solutions using Oracle databases with strong SQL and PL/SQL.- Deploy and manage applications...

  • Java Full Stack Developer

    7 days ago

    Mumbai, Maharashtra, India Oracle Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job ResponsibilitiesDesign, develop, and maintain scalable enterprise applications using Java, Spring Boot, and Python. Build and manage data pipelines and work on Databricks for analytics and transformation tasks. Develop, optimize, and maintain solutions using Oracle databases with strong SQL and PL/SQL. Deploy and manage applications on AWS cloud,...