
Databricks Developer
23 hours ago
Role Description
Job Summary
As a Databricks Developer, you will be responsible for developing, optimizing, and maintaining data pipelines and analytic workflows on Databricks. You will collaborate with data engineers, analysts, data scientists, and business stakeholders to transform raw data into actionable insights. This role requires hands-on expertise with Databricks, Apache Spark, and cloud data platforms such as Azure, AWS, or GCP. You will play a key part in architecting scalable data solutions, ensuring data quality, and enabling advanced analytics and machine learning capabilities across the organization.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark to ingest, process, and transform large data sets from diverse sources.
- Implement ETL (Extract, Transform, Load) workflows to support analytics, reporting, and machine learning initiatives.
- Optimize data jobs for performance, scalability, and cost efficiency within the Databricks environment.
- Collaborate with data engineers, data scientists, analysts, and business stakeholders to understand requirements and translate them into technical solutions.
- Develop and maintain notebooks in Databricks using Python, Scala, SQL, or R.
- Ensure data quality by implementing data validation, testing, and monitoring procedures.
- Integrate Databricks with cloud storage services (such as Azure Data Lake, AWS S3, or Google Cloud Storage) and other data sources.
- Automate data workflows and job schedules using Databricks Jobs, Workflows, or orchestration tools such as Apache Airflow or Azure Data Factory.
- Participate in code reviews, support best practices in software development, and contribute to process improvements.
- Monitor, troubleshoot, and resolve issues related to data pipelines and Databricks environment.
- Contribute to the design and implementation of data architectures, including data lakes, data warehouses, and streaming data solutions.
- Document technical designs, data flows, and process workflows for knowledge sharing and compliance requirements.
- Stay current with Databricks platform updates, industry trends, and best practices for big data, analytics, and cloud technologies.
Skills
Mandatory Skills : Databricks, Spark, Azure/AWS
-
Azure Databricks Developer
4 weeks ago
Pune, Maharashtra, India People Prime World Wide Full timeAbout Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...
-
Azure Databricks
4 weeks ago
Pune, Maharashtra, India Phygital Insights Private Limited Full timeJob DescriptionDescriptionWe are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and be proficient in leveraging Azure Databricks to build robust data solutions.Responsibilities- Design and implement data pipelines using Azure Databricks to process large...
-
Databricks Engineer
22 hours ago
Pune, Maharashtra, India Bitwise Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per yearRole: DataBricks EngineerNotice Period: Immediate joiners onlyLocation: PuneWork Mode: HybridPosition Overview:We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a...
-
Databricks Lead
6 days ago
Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000Senior Databricks Engineer OpportunityWe're seeking a seasoned Databricks expert to lead our Azure data engineering projects.Develop scalable data pipelines with Databricks, PySpark & Spark SQLImplement & manage Delta Lake & modern data lakehouse architectureConfigure & administer Databricks (Workspace, Jobs, DLT, Unity Catalog)Design CI/CD pipelines using...
-
Databricks Data Engineer
1 week ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title:Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have hands-on experience with Databricks, including expertise in Databricks SQL, PySpark, and Spark SQL.Key Responsibilities:Migrate SQL Server Stored Procedures to Databricks Notebooks, leveraging PySpark and Spark SQL for complex...
-
ETL Databricks
22 hours ago
Pune, Maharashtra, India Virtusa Full time US$ 90,000 - US$ 1,20,000 per yearLooking for a offshore Techlead with databricks engineer experience and lead the team from offshore.Develop and maintain a metadata driven generic ETL framework for automating ETL codeDesign, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS .Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files,...
-
Databricks Architect
24 hours ago
Pune, Maharashtra, India ARA Resources Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAbout ARAs ClientARAs Client is a global leader in end-to-end data and analytics solutions with nearly two decades of experience in enabling organizations to derive business value from modern data capabilities. Operating with the scale of a global consulting firm and the depth of a niche partner, ARAs Client has delivered cutting-edge data modernization,...
-
Databricks Data Engineer
4 days ago
Pune, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000We are seeking a skilled data engineer to design, develop and optimize data processing pipelines on the Databricks platform. Your primary responsibilities will include architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data infrastructure.Key...
-
Databricks Platform Specialist
2 days ago
Pune, Maharashtra, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000Platform Configuration ExpertWe are seeking a skilled Platform Configuration Expert to join our team and play a key role in managing and supporting Databricks environments across multiple clouds.Main Responsibilities:Databricks Management: Configure and manage Databricks workspaces for optimal performance and resource utilization.Data Governance: Implement...
-
Databricks Data Engineer
4 weeks ago
Pune, Maharashtra, India Ascendion Full timeJob Title: Senior Data Engineer Experience : 3+ years Location: Gurgaon Skills: PySpark, SQL, Databricks, AWS. Role Summary: We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...