Databricks

7 hours ago

Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly impact our companys success and societal advancements.

**Responsibilities**
- Develop and implement scalable data processing solutions using Spark in Scala to enhance data efficiency and performance.
- Collaborate with cross-functional teams to design and optimize data workflows using Databricks Workflows and Databricks SQL.
- Administer and manage Databricks Unity Catalog to ensure data governance and security across the organization.
- Utilize Databricks CLI to automate data pipeline deployments and streamline operational processes.
- Integrate and manage data storage solutions using Amazon S3 and Amazon Redshift to support data analytics initiatives.
- Write and maintain high-quality Python and PySpark code to process and analyze large datasets effectively.
- Implement Databricks Delta Lake for reliable and efficient data storage and retrieval.
- Monitor and troubleshoot data workflows to ensure seamless data operations and minimize downtime.
- Provide technical expertise and support to team members fostering a collaborative and innovative work environment.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Contribute to the development of best practices and standards for data engineering processes.
- Ensure data quality and integrity through rigorous testing and validation procedures.
- Document and communicate technical solutions and processes to stakeholders for transparency and alignment.

**Qualifications**
- Possess strong experience in Spark in Scala and Databricks technologies demonstrating proficiency in data engineering.
- Have hands-on experience with Amazon S3 and Amazon Redshift for data storage and management.
- Demonstrate expertise in Python and PySpark for data processing and analysis.
- Experience with Databricks SQL and Delta Lake is essential for efficient data operations.
- Familiarity with Databricks CLI and Unity Catalog Admin is highly desirable.
- Strong problem-solving skills and ability to work in a hybrid work model.

  • Databricks

    7 hours ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Spark in Scala and PySpark - Oversee the administration of Databricks Unity Catalog and manage data governance - Provide expertise in Delta Sharing and ensure secure data sharing practices - Develop and maintain Databricks CLI scripts for automation...

  • Databricks

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis. - Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency. - Collaborate with cross-functional teams to understand business requirements and translate them into...

  • Databrick

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Pyspark+databricks

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Data Bricks+Pyspark** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Python,PySpark,Azure Data Lake Store,Databricks Workflows,Databricks SQL **Responsibilities**: - Develop and optimize data solutions using Azure Data Lake Store to support business needs. - Utilize Python to create...

  • Databricks Platform Administrator

    3 days ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    The Databricks Administrator will be responsible for providing technical expertise in deploying administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization. You will collaborate with data engineers, data scientists, and other stakeholders to...

  • Azure Databricks Trainer

    7 hours ago

    Chennai, Tamil Nadu, India Ednue Technologies Private Limited Full time

    We are seeking a knowledgeable and experienced **Azure Databricks Trainer** to design and deliver comprehensive training sessions for professionals and aspiring data engineers. The trainer will be responsible for conducting hands-on workshops, developing course content, and mentoring participants on real-world Azure Databricks projects. **Key...

  • Data Architect- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs. **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full...

  • Data Architect- Databricks

    3 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs. **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full...

  • Databricks

    16 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Data Architect- Databricks

    7 hours ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full time Employment **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with...