Databricks

2 weeks ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly impact our companys success and societal advancements.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark in Scala to enhance data efficiency and performance.
  • Collaborate with cross-functional teams to design and optimize data workflows using Databricks Workflows and Databricks SQL.
  • Administer and manage Databricks Unity Catalog to ensure data governance and security across the organization.
  • Utilize Databricks CLI to automate data pipeline deployments and streamline operational processes.
  • Integrate and manage data storage solutions using Amazon S3 and Amazon Redshift to support data analytics initiatives.
  • Write and maintain high-quality Python and PySpark code to process and analyze large datasets effectively.
  • Implement Databricks Delta Lake for reliable and efficient data storage and retrieval.
  • Monitor and troubleshoot data workflows to ensure seamless data operations and minimize downtime.
  • Provide technical expertise and support to team members fostering a collaborative and innovative work environment.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Contribute to the development of best practices and standards for data engineering processes.
  • Ensure data quality and integrity through rigorous testing and validation procedures.
  • Document and communicate technical solutions and processes to stakeholders for transparency and alignment.

Qualifications

  • Possess strong experience in Spark in Scala and Databricks technologies demonstrating proficiency in data engineering.
  • Have hands-on experience with Amazon S3 and Amazon Redshift for data storage and management.
  • Demonstrate expertise in Python and PySpark for data processing and analysis.
  • Experience with Databricks SQL and Delta Lake is essential for efficient data operations.
  • Familiarity with Databricks CLI and Unity Catalog Admin is highly desirable.
  • Strong problem-solving skills and ability to work in a hybrid work model.

  • Databricks Architect

    6 days ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databricks Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Tekskills Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description:• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer• Data Modeling: Design and optimize...

  • Databricks spark

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Databricks Developers

    2 weeks ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.Perform data analysis to identify...

  • Azure DataBricks

    2 weeks ago

    Chennai, Tamil Nadu, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure.Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python)Date: Saturday, 13/09/2025Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai ,Bring your expertise in:Datawarehousing & ETL (10+ yrs)Azure, ADF, Synapse,...

  • Databricks Developer

    2 weeks ago

    Chennai, Tamil Nadu, India VySystems Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Databricks DeveloperNotice Period: Immediate to 15 DaysLocation: Pan India (Remote)Experiences: 5 to 9 YearsJob SummaryWe are seeking a highly skilledDatabricks Developerwith expertise inPython, PySpark, API Design, Azure, Airflow, and SQL. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring high...

  • DataBricks / AWS Redshift

    5 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...

  • databricks/pyspark

    1 week ago

    Chennai, Tamil Nadu, India NRM Analytix Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain PySpark solutions using Databricks platform* Optimize performance through efficient data processing techniques* Collaborate with cross-functional teams on project deliveryAccessible workspace

  • Data Engineer- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Azure Databricks Administrator

    2 weeks ago

    Chennai, Tamil Nadu, India Randomtrees Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Roles and ResponsibilitiesDesign, implement, and maintain Azure Databricks clusters for data engineering workloads.Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts.Migrate on-premises databases to Azure platforms using Data Bricks migration tools.Troubleshoot issues related to Azure Databricks cluster performance,...