Databricks Developer
4 days ago
Dear Candidate,
We at TATA Technologies looking for an experienced candidate for Databricks. Please check the below JD for more details
Job Title : Databricks Developer
Total Exp:3-6 Years
Location: Pune
Notice Period: Immediate-30 Days
Role & responsibilities
- Design and implement Databricks-based data architectures to meet business requirements.
- Develop and optimize data pipelines using PySpark, Scala, or SQL.
- Establish the Databricks Lakehouse architecture for batch and streaming data.
- Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP).
- Ensure data security and compliance with best practices.
- Monitor and troubleshoot Databricks environments for performance and reliability.
- Stay updated on Databricks advancements and industry trends.
Desired Candidate Profile:
- Experience in data engineering using Databricks or Apache Spark-based platforms.
- Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.
- Good understanding of AWS cloud services
- Proficiency in programming languages such as Python, Scala, or SQL for data processing and transformation.
- Expertise in Spark (PySpark,Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
- Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing. ions.
- Build and query delta lake storage solutions
- Process streaming data with Azure Databricks structured streaming
- Design Azure Databricks security and data protection solutions
- Flatten nested structures and explode arrays with spark
- Experience with orchestration tools like Databricks Jobs for scheduling and automation.
- Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.
- Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
- Ability to create reusable components, templates, and documentation to standardize data engineering workflows.
- Solutioning and presales - Architecting frameworks, defining roadmaps, and engaging with stakeholders.
- Experience in defining data strategy, evaluating new tools/technologies, and driving adoption across the organization.
- Must have experience of working with streaming data sources and Kafka.
Preferred Experience:
- Bachelors degree in computer science, Information Technology, or related field
- Proven experience as a Databricks Architect or similar role
- Complete knowledge in Azure Databricks platform architecture
- Databricks certification (e.g. Certified Data Engineer, Associate Developer)
- Expertise in Python/Scala/ SQL/R
- Experience with cloud platforms like AWS, Azure, or GCP
Strong understanding of data modelling and cloud integration
Note: Candidates who are currently working with TCS, not eligible to apply
-
Databricks Developer
2 days ago
Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per yearProject descriptionYou will be working in a global team that manages and performs a global technical control. You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling. As an IT engineer you'll play an important role in ensuring the development methodology is...
-
Azure Databricks Developer
2 weeks ago
Pune, Maharashtra, India Newscape Consulting Full time ₹ 8,00,000 - ₹ 16,00,000 per yearWe're Hiring: Senior Databricks Engineer / Azure Data Engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates or those willing to relocate to Pune may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face...
-
Databricks Engineer
17 hours ago
Pune, Maharashtra, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
AI and Databricks
2 weeks ago
Pune, Maharashtra, India Quantum Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole: AI and Databricks EngineerLocation: Pune/Nagpur :: WFODuration: FulltimeJob Description:Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experience with Databricks (Spark, Delta Lake, MLflow, Databricks Notebooks, Unity Catalog).Expertise in Python for building...
-
Databricks Administrator
1 week ago
Pune, Maharashtra, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per yearRole & responsibilitiesDatabricks AdministratorLocation : Pune (3 days WFO, but will change based on the business need)Shift timings : Night shift (6.30PM IST to 2.30AM IST / it will get shift by 1hr in day light saving)Position : 2Notice period : Immediate joiner or less than 30daysExperience: (Overall 5 to 7 yrs)Must Have Skills:Must Have Skills: 2 to 4...
-
Databricks Engineer
15 hours ago
Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per yearPosition: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...
-
Technical Architect-Databricks
2 weeks ago
Pune, Maharashtra, India Atos Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole OverviewThe Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability.ResponsibilitiesDesign and implement Databricks-based data architectures to meet business...
-
Databricks Lead Developer
12 hours ago
Pune, Maharashtra, India BRISKWIN IT SOLUTIONS Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWork Mode: 5 Days Work From OfficeShift: 12:30 PM – 9:30 PM ISTNotice Period: Immediate to 60 DaysExperience : 6-15yrsPrimary: Azure, Databricks, ADF, PySpark/PythonSecondary: Data WarehousingWhat You'll Bring10+ years of IT experience in Data Warehousing & ETL5+ years of hands-on Databricks experienceStrong foundation in cloud data engineering using...
-
Databricks Engineer
15 hours ago
Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 20,00,000 per yearAbout Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Role: Databricks EngineerLocation: Pune & MumbaiExperience: 8 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do:3+ years of experience in data engineering or analytics roles.Strong hands-on experience with Databricks and Apache...
-
Databricks Solution Architect
11 hours ago
Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescriptionAbout InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance...