Databrick

6 days ago

Chennai Tamil Nadu, India Virtusa Full time

Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks jobs, notebooks, and clusters. Ensure security, privacy, and compliance standards are met throughout the data lifecycle. Provide guidance and mentorship to junior team members.

Required Skills & Qualifications:
4 to 6 years of experience in Big Data development. Hands-on experience with Databricks (including Workflows, Notebooks, Delta Live Tables, Unity Catalog). Strong programming skills in PySpark and/or Scala. Solid understanding of Delta Lake architecture. Proficient in SQL for data analysis and transformation. Experience with cloud platforms such as Azure (Azure Data Lake, Data Factory, Synapse) or AWS (S3, Glue, Redshift). Familiarity with CI/CD for Databricks deployments (e.g., using GitHub Actions, Azure DevOps). Knowledge of data governance, cataloguing, and security best practices. Experience working in an Agile/Scrum environment.

Preferred Skills:
Experience with Databricks Unity Catalog and Delta Live Tables. Exposure to machine learning workflows in Databricks. Experience with Apache Airflow, Kafka, or other orchestration/messaging tools. Certifications such as Databricks Certified Data Engineer Associate/Professional, Azure, or AWS certification.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Databricks

    3 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis. - Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency. - Collaborate with cross-functional teams to understand business requirements and translate them into...

  • Pyspark+databricks

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Data Bricks+Pyspark** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Python,PySpark,Azure Data Lake Store,Databricks Workflows,Databricks SQL **Responsibilities**: - Develop and optimize data solutions using Azure Data Lake Store to support business needs. - Utilize Python to create...

  • Data Architect- Databricks

    6 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs. **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full...

  • Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Architect

    5 days ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT...

  • Azure Databrick

    3 days ago

    Chennai, India LatentView Analytics Pvt. Ltd Full time

    Role : Azure Databricks Experience:5 to 9 yrs Location: Chennai Position : Full time Good to have : - 5+ years of relevant experience in azure Data brick. - Strong proficiency in Microsoft SQL Server development, including i)ability to query and investigate data and to write views, stored procedures and other objects using SQL. ii)understanding and...

  • Databricks Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time

    We are hiring a Databricks Data Engineer for a remote, full-time role. The ideal candidate should meet the following requirements:1 to 5 years of overall experience in data engineering.At least 1 year of hands-on experience with Databricks technology.Strong working knowledge of Databricks Delta Lake and PySpark.Experience on cloud platforms like AWS or...

  • Capability Leads- Databricks

    4 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Position: Capability Lead – Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of experience: 12+...

  • Urgent: Capability Leads- Databricks

    4 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Job DescriptionPosition: Capability Lead Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of...