Databricks

1 week ago

Hyderabad Telangana, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing and transformation.
- Implement and manage Delta Sharing to facilitate secure and efficient data sharing across various platforms.
- Administer Databricks Unity Catalog to ensure proper data governance and access control.
- Utilize Databricks CLI for seamless integration and automation of Databricks workflows.
- Design and implement Delta Live Pipelines to automate data processing and ensure data quality.
- Leverage Structured Streaming to handle real-time data processing and analytics.
- Integrate and manage Apache Airflow for orchestrating complex data workflows.
- Utilize Amazon S3 for scalable and secure data storage solutions.
- Implement data warehousing solutions using Amazon Redshift for efficient data querying and reporting.
- Develop and maintain Python scripts for data processing and automation tasks.
- Utilize Databricks SQL for querying and analyzing large datasets.
- Implement Databricks Delta Lake to ensure data reliability and performance.
- Manage Databricks Workflows to streamline data processing and analytics tasks.
- Collaborate with cross-functional teams to ensure seamless data integration and delivery.
- Provide technical expertise and support to team members and stakeholders.
- Ensure all data solutions align with company goals and industry best practices.
- Continuously monitor and optimize data workflows for performance and efficiency.
- Stay updated with the latest industry trends and technologies to ensure the company remains competitive.
- Contribute to the companys mission by delivering high-quality data solutions that drive business success.

**Qualifications**
- Must have extensive experience with Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark.
- Strong problem-solving skills and the ability to work independently.
- Excellent communication and collaboration skills.
- Proven track record of delivering high-quality data solutions.
- Ability to work in a hybrid work model.
- Strong understanding of data governance and security best practices.
- Experience with real-time data processing and analytics.
- Knowledge of data warehousing and ETL processes.
- Familiarity with cloud-based data storage and processing solutions.
- Ability to manage and optimize complex data workflows.
- Strong attention to detail and commitment to data quality.
- Ability to stay updated with the latest industry trends and technologies.

  • Databricks

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain scalable data processing solutions using Spark in Scala to enhance data analytics capabilities. - Implement and manage Delta Sharing to ensure seamless data exchange across platforms. - Administer Databricks Unity Catalog to maintain data governance and security. - Utilize Databricks CLI for...

  • Databricks

    2 weeks ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks

    1 day ago

    Hyderabad, India Cognizant Technology Solutions Full time

    Job Summary We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Azure Databricks- Hyderabad

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Azure Databricks **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.** - **In-depth knowledge of relational database design,...

  • Azure Databricks Sme

    4 days ago

    Hyderabad, Telangana, India PepsiCo Full time

    Overview PepsiCo Data BI Integration Platforms is seeking an experienced Cloud Platform Databricks SME responsible for overseeing the Platform administration Security new NPI tools integration migrations platform maintenance and other platform administration activities on Azure AWS The ideal candidate will have hands-on experience with Azure AWS...

  • Senior Databricks Specialist

    5 days ago

    Kolkata, Hyderabad / Secunderabad, Telangana, India beBeeDatabricks Full time ₹ 1,20,000 - ₹ 1,80,000

    Highly Skilled Databricks Administrator RequiredThe role of a Databricks Administrator is pivotal to our organization. We seek an individual with expertise in Databricks administration, coupled with a solid understanding of AWS infrastructure and data warehousing concepts. The ideal candidate will be responsible for managing Databricks clusters, ensuring...

  • Databricks Architect

    2 weeks ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks Developer

    2 weeks ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks Developer

    1 day ago

    Hyderabad, India Zetamicron Full time

    Job Title:Databricks Developer Location:Bangalore, Chennai, Hyderabad, Pune Experience:5–7 Years About the Role We are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks Administrator

    2 weeks ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...