Databricks+spark

3 days ago


Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Summary

We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to drive business insights and efficiency.

Responsibilities

  • Develop and maintain scalable data pipelines using Databricks SQL and PySpark to support business analytics needs.
  • Optimize data workflows and processes within Databricks Delta Lake to ensure data integrity and performance.
  • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
  • Implement best practices for data management and governance to ensure compliance and security.
  • Provide technical expertise in Databricks Workflows to automate and streamline data processing tasks.
  • Analyze complex data sets to identify trends and insights that drive business decisions.
  • Troubleshoot and resolve data-related issues to maintain system reliability and performance.
  • Document data processes and workflows to facilitate knowledge sharing and team collaboration.
  • Stay updated with the latest advancements in Databricks and related technologies to enhance data solutions.
  • Contribute to the continuous improvement of data architecture and infrastructure.
  • Mentor junior developers and provide guidance on best practices in data engineering.
  • Engage with stakeholders to gather feedback and refine data solutions to meet evolving business needs.
  • Ensure data solutions align with company objectives and contribute to overall business success.

Qualifications

  • Demonstrated expertise in Databricks SQL Databricks Delta Lake and Databricks Workflows.
  • Proficiency in PySpark for data processing and analytics.
  • Experience in Sales & Marketing domains is a plus.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.
  • Ability to work in a hybrid work model effectively.

Certifications Required

Databricks Certified Data Engineer Associate


  • Databricks

    1 week ago


    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...


  • Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...


  • Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • Databricks Developer

    2 weeks ago


    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks Engineer

    2 weeks ago


    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...


  • Hyderabad, Telangana, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Role: Azure Databricks EngineerJob Location: Pune, MH / Chennai, TN / Hyderabad. TG / Indore, MP / Kolkata, WB / Bangalore, TNWork Mode: (WFO)Skills Required: Digital: DatabricksExperience: 6-8 Years(5+ yrs)Job Description:Should build Databricks Notebook developed in spark sql/pysparkShould be able to create unity catalog tablesShould have good hands on...

  • Databricks Architect

    2 weeks ago


    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks Engineer

    1 week ago


    Hyderabad, Telangana, India ValueMomentum Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionValueMomentum is a leading solutions provider for the global property and casualty insurance industry, backed by deep domain and technology capabilities. Our mission is to help insurers achieve sustained growth and high performance by enhancing stakeholder value and building resilient societies. Trusted by over 100 insurers globally, we...

  • Digital: Databricks

    2 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 3-9yearsLocation: HyderabadRequired Technical Skill Set:Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed, mapped, transformed, and...


  • Hyderabad, Telangana, India Innova ESI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: Azure Databricks Data EngineerExperience: 5+ YearsLocation: Hyderabad | BangaloreNotice Period: Immediate Joiners OnlyJob Description:Minimum of 4 yrs of experience on Azure cloud environment.Experience on ADLS, Azure Databricks, Azure SQL DB, Cosmos DB, Azure Data Factory and Datawarehouse.Strong working experience in Implementation of Azure cloud...