Databrick

4 days ago

Chennai Tamil Nadu, India Virtusa Full time

Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks jobs, notebooks, and clusters. Ensure security, privacy, and compliance standards are met throughout the data lifecycle. Provide guidance and mentorship to junior team members.

Required Skills & Qualifications:
4 to 6 years of experience in Big Data development. Hands-on experience with Databricks (including Workflows, Notebooks, Delta Live Tables, Unity Catalog). Strong programming skills in PySpark and/or Scala. Solid understanding of Delta Lake architecture. Proficient in SQL for data analysis and transformation. Experience with cloud platforms such as Azure (Azure Data Lake, Data Factory, Synapse) or AWS (S3, Glue, Redshift). Familiarity with CI/CD for Databricks deployments (e.g., using GitHub Actions, Azure DevOps). Knowledge of data governance, cataloguing, and security best practices. Experience working in an Agile/Scrum environment.

Preferred Skills:
Experience with Databricks Unity Catalog and Delta Live Tables. Exposure to machine learning workflows in Databricks. Experience with Apache Airflow, Kafka, or other orchestration/messaging tools. Certifications such as Databricks Certified Data Engineer Associate/Professional, Azure, or AWS certification.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Pyspark + Databricks

    23 hours ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill: Pyspark + Databricks** ** Experience**: 6 to 9 Years ** Location : AIA - Gurgaon** **Job Summary** **Responsibilities** - Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. - Oversee the integration of Databricks Unity Catalog to ensure seamless data governance and...

  • Azure Databricks

    23 hours ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill: Azure Databricks** **Experience**: 9 to 12 years **Location: AIA-Gurgaon** **Job Summary** As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing...

  • Databricks With Data Analyst

    3 weeks ago

    Chennai, Tamil Nadu, India virtusa Full time

    Role Summary We are seeking skilled Data Analysts to support Informatica MDM production operations including data ingestion from Databricks stewardship console support and downstream data consumption The role involves monitoring troubleshooting and collaborating with business and engineering teams to ensure data quality and operational continuity Key...

  • Databricks Engineer

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Databricks EngineerJob Location: Chennai (ONLY)Experience required : 6-10 yrsVirtual Interview Date: 25-Oct-25 (Saturday)Must-HaveData Engineer having , Databricks & AWS development experienceDevelopment experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of very...

  • Databrick

    16 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...

  • Principal Architect

    1 week ago

    tamil nadu, India Tiger Analytics Full time

    Title : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we are Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...

  • Data Engineer

    2 hours ago

    tamil nadu, India OneData Software Solutions Full time

    Company Description OneData Software Solutions is a leading software development company specializing in big data analytics and solutions. Headquartered in the US with a regional office in Coimbatore, we have empowered businesses since 2009 with innovative strategies and cutting-edge technologies. Our mission is to deliver timely, transformative solutions...

  • Databricks with Aws(Datadog)

    6 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description: Were looking for an Engineer to support AWACs SRE tool migration initiative. Youll help configure and maintain new monitoring tools, replacing Datadog and LogicMonitor, and ensure visibility across AWS, Azure, and Databricks environments. Ideal for someone with hands on experience in observability and a passion for modern tooling. Key...

  • DataBrick

    3 weeks ago

    Chennai, India Virtusa Full time

    Job Description We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data...

  • Databricks

    22 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...