DataBrick

10 hours ago

Chennai India Virtusa Full time

Job Description We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance. Key Responsibilities Design develop and maintain scalable data pipelines using Apache Spark on Databricks Write efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrate data from various structured and unstructured sources into a unified platform Implement Delta Lake and manage data versioning updates and schema evolution Optimize data processing workflows for performance scalability and cost efficiency Collaborate with data scientists analysts and business stakeholders to deliver high quality datasets Implement data quality checks validation routines and logging mechanisms Monitor and debug production jobs using Databricks jobs notebooks and clusters Ensure security privacy and compliance standards are met throughout the data lifecycle Provide guidance and mentorship to junior team members Required Skills And Qualifications 5 to 7 years of experience in Big Data development Hands on experience with Databricks including Workflows Notebooks Delta Live Tables Unity Catalog Strong programming skills in PySpark and or Scala Solid understanding of Delta Lake architecture Proficient in SQL for data analysis and transformation Experience with cloud platforms such as Azure Azure Data Lake Data Factory Synapse or AWS S3 Glue Redshift Familiarity with CICD for Databricks deployments using GitHub Actions Azure DevOps Knowledge of data governance cataloguing and security best practices Experience working in an Agile Scrum environment Preferred Skills Experience with Databricks Unity Catalog and Delta Live Tables Exposure to machine learning workflows in Databricks Experience with Apache Airflow Kafka or other orchestration messaging tools Certifications Databricks Certified Data Engineer Associate Professional Azure AWS certification

  • Databrick

    1 day ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...

  • Databricks Admin

    1 week ago

    India growel softech Full time

    **Databricks Admin 4+ years Remote Max 1.5 LPM **Responsibilities**: - Install, configure, and maintain Databricks environments to support data engineering and analytics activities. - Collaborate with cross-functional teams to understand data requirements and optimize Databricks clusters accordingly. - Monitor Databricks performance, troubleshoot issues,...

  • Databricks Admin

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    TCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...

  • Databricks Admin

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    TCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...

  • Databricks Admin

    13 hours ago

    chennai, India Tata Consultancy Services Full time

    TCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...

  • Databricks admin

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired Skills- Databricks Administration- Terraform- AWS cloud services- MLflow- Workflows- Databricks Asset Bundles- AWS IAM- VPC- Private endpoints- Firewalls- S3- SQL + Py Spark- dbx CLIResponsibilities- Implement, and maintain the Databricks platform, including workspace setup, user and group...

  • Databricks Admin

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired Skills- Databricks Administration- Terraform- AWS cloud services- MLflow- Workflows- Databricks Asset Bundles- AWS IAM- VPC- Private endpoints- Firewalls- S3- SQL + PySpark- dbx CLIResponsibilities- Implement, and maintain the Databricks platform, including workspace setup, user and group...

  • Databricks admin

    1 week ago

    Chennai, India Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired Skills- Databricks Administration- Terraform- AWS cloud services- MLflow- Workflows- Databricks Asset Bundles- AWS IAM- VPC- Private endpoints- Firewalls- S3- SQL + Py Spark- dbx CLIResponsibilities- Implement, and maintain the Databricks platform, including workspace setup, user and group...

  • Databricks Admin

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    TCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :- Databricks Platform Administration including environment...

  • Databricks with Python

    2 weeks ago

    Chennai, India Teamware Solutions Full time

    Job Description Teamware Solutions is seeking a skilled Databricks with Python Developer to build, optimize, and manage our big data processing and analytics solutions. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert analysis, development,...