Databrick

17 hours ago

Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.

Key Responsibilities

Design develop and maintain scalable data pipelines using Apache Spark on Databricks

Write efficient and production ready PySpark or Scala code for data transformation and ETL processes

Integrate data from various structured and unstructured sources into a unified platform

Implement Delta Lake and manage data versioning updates and schema evolution

Optimize data processing workflows for performance scalability and cost efficiency

Collaborate with data scientists analysts and business stakeholders to deliver high quality datasets

Implement data quality checks validation routines and logging mechanisms

Monitor and debug production jobs using Databricks jobs notebooks and clusters

Ensure security privacy and compliance standards are met throughout the data lifecycle

Provide guidance and mentorship to junior team members

Required Skills and Qualifications

5 to 7 years of experience in Big Data development

Hands on experience with Databricks including Workflows Notebooks Delta Live Tables Unity Catalog

Strong programming skills in PySpark and or Scala

Solid understanding of Delta Lake architecture

Proficient in SQL for data analysis and transformation

Experience with cloud platforms such as Azure Azure Data Lake Data Factory Synapse or AWS S3 Glue Redshift

Familiarity with CICD for Databricks deployments using GitHub Actions Azure DevOps

Knowledge of data governance cataloguing and security best practices

Experience working in an Agile Scrum environment

Preferred Skills

Experience with Databricks Unity Catalog and Delta Live Tables

Exposure to machine learning workflows in Databricks

Experience with Apache Airflow Kafka or other orchestration messaging tools

Certifications Databricks Certified Data Engineer Associate Professional Azure AWS certification

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Databricks

    23 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...

  • Databricks Architect

    2 days ago

    Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...

  • Databricks Architect

    7 days ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databricks spark

    7 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Databricks+Spark

    17 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.

  • DataBricks / AWS Redshift

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...

  • Databricks AI Engineer

    2 days ago

    Chennai, Tamil Nadu, India Enoah Isolution Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    Role & responsibilitiesProgramming & Query Languages: Proficient in Python and SQL for data analysis, modeling, and database management.Machine Learning & AI Models: Experience with regression, decision trees, SVM, deep learning (CNNs, RNNs, Transformers), and advanced AI (GNNs, RL, GANs, LLMs such as GPT-4, Claude, LLaMA).Natural Language & Vision AI:...

  • databricks/pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain PySpark solutions using Databricks platform* Optimize performance through efficient data processing techniques* Collaborate with cross-functional teams on project deliveryAccessible workspace

  • Senior Databricks Engineer

    1 week ago

    Chennai, Tamil Nadu, India Tata Consultancy Servicess Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    It will C2H Hiring and Direct payroll with TCS and full time conversion within initial few months.Job Title: Technical LeadWork Location: PAN INDIANotice Period- Immediate Joiner/ 15 DaysSkill Required: Digital : Databricks, Python, SQLExperience Range: 8-10 yearsBudget 17LPAJob Summary:Must have experience as a Tech Lead.Extensive Knowledge in Databricks,...

  • Data Engineer- Databricks

    16 hours ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 15,00,000 - ₹ 22,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...