Databricks Platform Administrator
3 days ago
The Databricks Administrator will be responsible for providing technical expertise in deploying
administration, configuration, and optimization of the Databricks platform to enable data analytics,
machine learning, and data engineering activities within the organization. You will collaborate with
data engineers, data scientists, and other stakeholders to ensure the platform meets their
requirements while maintaining security and performance standards.
- Install, configure, and maintain Databricks clusters and workspaces.
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Perform regular software updates and patches.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts
- Coordinate with dependent infrastructures, such as AWS services, to integrate and leverage Databricks capabilities effectively.
- Understand requirements and provide technical solutions
**Minimum Qualifications**
- Bachelor Or Equivalent degree in a relevant field
- Ability to drive solutions autonomously while supporting a collaborative development team environment.
- 4 years experience with Databricks Lakehouse Platform
- Strong knowledge of Apache Spark and Databricks architecture.
- Proven experience in managing cloud-based data platforms and infrastructure.
- Experience with Linux/Unix system administration is a plus
- Experience in a healthcare-related business is a plus.
**Job Requirement**
Databricks,Apache Spark,Linux/Unix,Lakehouse Platform,clusters
-
Databricks Admin
2 weeks ago
tamil nadu, India Tata Consultancy Services Full timeDatabricks Admin Exp- 5 to 8 years Location- Chennai/ Kolkata Required Skills Databricks Administration Terraform AWS cloud services MLflow Workflows Databricks Asset Bundles AWS IAM VPC Private endpoints Firewalls S3 SQL + PySpark dbx CLI Responsibilities Implement, and maintain the Databricks platform, including workspace setup, user and group management,...
-
Databricks Admin
3 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeTCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...
-
Databricks Admin
3 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeTCS present an excellent opportunity for Databricks AdminJob Location: Chennai , KolkataExperience required : 6-12 yrsInterview date: 17th Oct (Friday)Required Technical Skill Set**Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, dbx...
-
Databricks Admin
3 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeDatabricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...
-
Databrick
1 week ago
Chennai, Tamil Nadu, India Virtusa Full timeKey Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Pyspark + Databricks
6 days ago
Chennai, Tamil Nadu, India Cognizant Full time**Skill: Pyspark + Databricks** ** Experience**: 6 to 9 Years ** Location : AIA - Gurgaon** **Job Summary** **Responsibilities** - Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. - Oversee the integration of Databricks Unity Catalog to ensure seamless data governance and...
-
Databricks Admin
3 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...
-
Databricks Admin
3 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...
-
Databricks Admin
3 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :- Databricks Platform Administration including environment...
-
Databricks Admin
2 days ago
tamil nadu, India Tata Consultancy Services Full timeDatabricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...