Databricks Platform Engineer
3 weeks ago
Experience:3 to 6 years Notice Period:Immediate to 15 days Location:Bangalore Work from officeJOB DESCRIPTIONJob Description: Databricks Platform Engineer / Administrator (AWS) Department: Data Engineering / Cloud Platform / DevOpsAbout the Role We are looking for a skilled and proactiveDatabricks Platform Engineer / Administratorto manage, optimize, and govern our Databricks environment on AWS. The ideal candidate will be responsible for overseeing platform operations, optimizing performance and cost, and ensuring secure and efficient use of Databricks and integrated AWS services. This role sits at the intersection of platform engineering, data infrastructure, and cost governance, requiring both technical depth and cross-functional collaboration.Key Responsibilities Platform Administration Deploy, configure, and manageDatabricks workspaceson AWS. Set up and maintainAWS infrastructure(VPCs, IAM roles, S3, security groups) to support Databricks operations. Manage user access, job permissions, cluster configurations, and workspace-level controls. Cost Optimization Implement and enforcecluster policiesto control resource consumption and prevent cost overruns. Promote efficient compute usage by enablingjob clusters,auto-termination, andspot instancestrategies. Monitor and analyze cost usingAWS Cost Explorer,Databricks REST APIs, and internal dashboards. Optimize storage costs throughS3 lifecycle policies,Delta Lake optimization, andtable version management. Performance Tuning Analyze and tuneSpark job performance, including partitioning, caching, and join strategies. Provide guidance on usingPhoton runtime,Delta Live Tables, andSQL optimization best practices. Collaborate with data engineers and analytics teams to improve job execution efficiency and pipeline throughput. Monitoring & Observability Set up and managelogging, monitoring, and alertingvia CloudWatch, Databricks audit logs, and external tools. Track metrics such as cluster utilization, job failures, job durations, and resource bottlenecks. Develop dashboards for real-time visibility into platform usage, performance, and cost. Security & Governance Enforce access control throughUnity Catalog,IAM roles, andcluster policies. Ensure compliance with enterprise security policies, data governance standards, and audit requirements. Prevent data duplication and misuse through strong access boundaries and usage monitoring. Automation & Documentation Automate provisioning and configuration usingTerraform,Databricks CLI, andREST APIs. Maintain detailed documentation of cluster policies, platform standards, optimization playbooks, and cost governance guidelines. Drive platform standardization and advocate for best practices across teams.Qualifications Required 3–6+ years of experience managingDatabricks on AWSor similar Spark-based platforms. Strong hands-on experience withAWS services(S3, IAM, VPC, EC2, CloudWatch). Proficiency inSpark performance tuningandDatabricks architecture. Solid understanding ofcost optimization strategiesin cloud-based data platforms. Experience withDatabricks cluster policies,job scheduling, andDelta Lake. Familiarity withPython, SQL, Terraform, andDatabricks REST APIs. Preferred Experience withUnity Catalog,Delta Live Tables, orMLflow. Knowledge ofAWS cost governance tools(Cost Explorer, Budgets, Trusted Advisor). Prior work in FinOps, DataOps, or Cloud Center of Excellence (CCoE) roles. Certifications such as: Databricks Certified Data Engineer / Admin AWS Certified Solutions Architect / DevOps Engineer
-
Platform Engineer – Python
1 week ago
New Delhi, India Syntasa Full timePlatform Engineer – Python / Databricks / Notebooks/ KubernetesJob DescriptionSyntasa is seeking a high-caliber and dedicated Platform Engineer to join its India subsidiary, Syntasa Technologies India Private Limited. This position offers an exciting opportunity to contribute to the growth of a world-class development and support center. The India...
-
Platform Engineer – Python
1 week ago
New Delhi, India Syntasa Full timePlatform Engineer – Python / Databricks / Notebooks/ KubernetesJob Description Syntasa is seeking a high-caliber and dedicatedPlatform Engineerto join its India subsidiary,Syntasa Technologies India Private Limited . This position offers an exciting opportunity to contribute to the growth of a world-class development and support center. The India...
-
Databricks Engineer
2 weeks ago
New Delhi, India Tata Consultancy Services Full timeTCS present an excellent opportunity for Databricks Engineer Job Location: Chennai (ONLY) Experience required : 6-10 yrsVirtual Interview Date: 25-Oct-25 (Saturday)Must-Have Data Engineer having , Databricks & AWS development experience Development experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of very...
-
2892- Databricks Engineer
3 weeks ago
New Delhi, India EXL Full timeAbout the RoleWe are seeking a highly skilled Databricks Engineer with 5–7 years of experience in data engineering and analytics. The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spark, and cloud platforms. This role requires a combination of strong technical...
-
Senior Databricks Engineer
19 hours ago
New Delhi, India Newscape Consulting Full timeAbout the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data...
-
Databricks Data Engineer
3 weeks ago
New Delhi, India Tata Consultancy Services Full timeAbout the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...
-
Databricks Engineer
2 weeks ago
New Delhi, India Persistent Systems Full timeAbout Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.- Role: Databricks Engineer - Location: Pune & Mumbai - Experience: 8 to 12 Years - Job Type: Full Time EmploymentWhat You'll Do:- 3+ years of experience in data engineering or analytics roles. - Strong hands-on experience with Databricks...
-
Lead Data Platform Optimization
3 weeks ago
New Delhi, India FinOpsly Full timeFinOpsly i s the AI brain behind cost decisions acrosscloud ,data , andAI— built to think, plan, and act. Purpose-built for today’s complex enterprise environments, weunifyFinOps across AWS, Azure, Snowflake, Databricks, and modern AI workloads — enabling organizations to move from cost reporting to cost action.We are building a differentiated...
-
Lead Data Platform Optimization
3 weeks ago
New Delhi, India FinOpsly Full timeFinOpsly is the AI brain behind cost decisions across cloud, data, and AI — built to think, plan, and act. Purpose-built for today’s complex enterprise environments, we unify FinOps across AWS, Azure, Snowflake, Databricks, and modern AI workloads — enabling organizations to move from cost reporting to cost action.We are building a differentiated...
-
2892- Databricks Engineer
2 weeks ago
New Delhi, India EXL Full timeAbout the Role We are seeking a highly skilledDatabricks Engineerwith 5–7 years of experience in data engineering and analytics. The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spark, and cloud platforms. This role requires a combination of strong technical...
