Databricks

3 weeks ago

Chennai, India Cognizant Technology Solutions Full time

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly impact our companys success and societal advancements.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark in Scala to enhance data efficiency and performance.
  • Collaborate with cross-functional teams to design and optimize data workflows using Databricks Workflows and Databricks SQL.
  • Administer and manage Databricks Unity Catalog to ensure data governance and security across the organization.
  • Utilize Databricks CLI to automate data pipeline deployments and streamline operational processes.
  • Integrate and manage data storage solutions using Amazon S3 and Amazon Redshift to support data analytics initiatives.
  • Write and maintain high-quality Python and PySpark code to process and analyze large datasets effectively.
  • Implement Databricks Delta Lake for reliable and efficient data storage and retrieval.
  • Monitor and troubleshoot data workflows to ensure seamless data operations and minimize downtime.
  • Provide technical expertise and support to team members fostering a collaborative and innovative work environment.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Contribute to the development of best practices and standards for data engineering processes.
  • Ensure data quality and integrity through rigorous testing and validation procedures.
  • Document and communicate technical solutions and processes to stakeholders for transparency and alignment.

Qualifications

  • Possess strong experience in Spark in Scala and Databricks technologies demonstrating proficiency in data engineering.
  • Have hands-on experience with Amazon S3 and Amazon Redshift for data storage and management.
  • Demonstrate expertise in Python and PySpark for data processing and analysis.
  • Experience with Databricks SQL and Delta Lake is essential for efficient data operations.
  • Familiarity with Databricks CLI and Unity Catalog Admin is highly desirable.
  • Strong problem-solving skills and ability to work in a hybrid work model.

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks Admin

    32 minutes ago

    Chennai, India Tata Consultancy Services Full time

    Databricks Admin Exp- 5 to 8 years Location- Chennai/ Kolkata Required Skills - Databricks Administration - Terraform - AWS cloud services - MLflow - Workflows - Databricks Asset Bundles - AWS IAM - VPC - Private endpoints - Firewalls - S3 - SQL + PySpark - dbx CLI Responsibilities - Implement, and maintain the Databricks platform, including workspace setup,...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis. - Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency. - Collaborate with cross-functional teams to understand business requirements and translate them into...

  • Databricks Developer

    3 weeks ago

    Chennai, India Tekskills Full time

    Job Description:• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer• Data Modeling: Design and optimize...

  • Databricks Architect

    6 days ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databrick Pyspark

    3 weeks ago

    Chennai, India Virtusa Full time

    Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Databricks spark

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Databricks Developers

    3 weeks ago

    Chennai, India Cynosure Corporate Solutions Full time

    Key Responsibilities: Develop and optimize data pipelines in Databricks for transforming and processing data from various sources. Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.). Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures. Perform data analysis to identify...

  • Azure DataBricks

    3 weeks ago

    Chennai, India Hexaware Technologies Full time

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure. Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python) Date: Saturday, 13/09/2025 Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai , Bring your expertise in: Datawarehousing & ETL (10+ yrs) Azure, ADF,...

  • Azure Databrick

    2 weeks ago

    Chennai, India LatentView Analytics Pvt. Ltd Full time

    Role : Azure Databricks Experience:5 to 9 yrs Location: Chennai Position : Full time Good to have : - 5+ years of relevant experience in azure Data brick. - Strong proficiency in Microsoft SQL Server development, including i)ability to query and investigate data and to write views, stored procedures and other objects using SQL. ii)understanding and...