Current jobs related to Azure Databricks Lead/Specialist - Pune, Maharashtra - Hoonar Tekwurks Private Limited

  • SwiftIn-Azure Databricks Lead

    4 weeks ago

    Pune, Maharashtra, India Nexthire Full time

    Role: Azure Databrick Lead Exp-10+ years Location- Pune/Bangalore We are seeking an experienced Azure Databricks Lead to drive the design, development, and implementation of data solutions using Azure Databricks. The ideal candidate will have a deep understanding of cloud-based data platforms, strong leadership skills, and a...

  • Azure Databricks

    4 weeks ago

    Pune, Maharashtra, India Exusia Full time

    Sr Data Engineers & Tech Leads – Python/Pyspark/Databricks Department:                          Sales and Delivery Team - EmpowerIndustry:                                 Information Technology & Services, Computer Software, Management...

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India Wipro Full time

    Job DescriptionWelcome to the role of a Data Engineer at Wipro, where you will be working on designing and developing large-scale data processing systems using Azure Databricks.You will be responsible for architecting, implementing, and maintaining these systems to ensure efficient data processing, storage, and analytics.The ideal candidate should have...

  • Databricks Technical Lead

    4 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Job Summary:We are seeking an experienced Data Architect/Technical Lead to join our team at Tredence Inc. as a Databricks architect. The ideal candidate will have 6+ years of IT experience, with 3+ years in data warehousing and ETL projects.About the Role:The successful candidate will be responsible for developing modern data warehouse solutions using...

  • Databricks Engineering Lead

    6 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    About the RoleTredence Inc. is seeking a seasoned Databricks Engineer to lead the development of cutting-edge data engineering and analytics solutions using AWS, Azure Stack, and Databricks. As a key member of our team, you will be responsible for designing and implementing scalable data pipelines, collaborating with cross-functional teams, and driving...

  • Sr. Data Engineer Azure Databricks

    2 weeks ago

    Pune, Maharashtra, India Fusemachines Full time

    About FusemachinesFusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400 full-time...

  • Azure Databricks Engineer

    4 weeks ago

    Pune, Maharashtra, India STEFANINI INDIA PRIVATE LIMITED Full time

    Job Description :Responsibilities :- Design, develop, and optimize data pipelines and ETL workflows using Databricks.- Implement scalable data integration solutions for large datasets across diverse data sources.- Build and maintain data architectures for real-time and batch processing.- Collaborate with data scientists, analysts, and stakeholders to ensure...

  • Data Architect Databricks Specialist

    4 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Job Description:We are looking for a highly skilled Databricks architect to join our team at Tredence Inc. As a key member of our data engineering team, you will be responsible for designing and implementing modern data warehouses using Databricks and AWS/Azure Stack. You will work closely with our DW/BI leads to understand new ETL pipeline development...

  • Senior Data Scientist

    3 days ago

    Pune, Maharashtra, India NCSI Technologies Private Limited Full time

    About the Role:We are looking for a seasoned Data Scientist - Azure Databricks to lead our data science team. The successful candidate will have extensive experience in designing and developing scalable and reusable frameworks for ingesting data sets and integrating end-to-end data pipelines to ensure high-quality and consistent data delivery.Key...

  • Cloud Architect

    6 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    We are seeking a highly skilled Cloud Architect - Databricks to lead our team in developing modern data warehouse solutions using Databricks and AWS/Azure Stack. The ideal candidate will have a strong background in cloud architecture, data engineering, and analytics, with expertise in Databricks and AWS/Azure Stack.Key ResponsibilitiesDeveloping modern data...

  • Cloud Databricks Specialist

    6 days ago

    Pune, Maharashtra, India NCSI Technologies Private Limited Full time

    NCSI Technologies Private Limited is seeking an experienced Senior Data Engineer to lead the development of big data solutions using Azure Databricks. In this role, you will be responsible for designing and implementing data ingestion pipelines from multiple sources, developing scalable and re-usable frameworks for ingesting data sets, and ensuring data...

  • Databricks Architect

    1 week ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Role: Databricks Technical Lead/ Data Architect This position is responsible for developing and implementing data engineering and analytics solutions using Databricks, AWS, and Azure Stack. The ideal candidate will have a strong understanding of modern data warehousing concepts, dimensional modeling, and data management principles. Suitable candidates...

  • Databricks Lead

    4 weeks ago

    Pune, Maharashtra, India Hexaware Technologies Full time

    Description : Primary Skills: Databricks with Pyspark, Python Secondaryskills; ADF 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools. 4+ years of work experience in Databricks, Pyspark and Python project development work Expertise in Bigdata Eco systems like HDFS and...

  • Databricks Solutions Architect

    4 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Company Overview:Tredence Inc. is a leading provider of data engineering and analytics solutions. Our team of experts helps organizations unlock the full potential of their data by designing and implementing modern data warehouses using Databricks and AWS/Azure Stack. We are committed to creating an inclusive environment for all employees and offer a range...

  • Azure Data Platform Specialist

    3 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Key ResponsibilitiesDesign and implement ETL/data pipelines and data lakes/data warehouses on AzureBuild infrastructure required for optimal extraction, transformation, and loading of data from various sources using SQL and Azure data analytics servicesLead the implementation of cloud data warehouse technologies on Azure data platform, including ADF, ADLS,...

  • Databricks Architect

    3 weeks ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Role: Databricks Technical Lead/ Data ArchitectExperience: 8-13 yearsLocation: Chennai, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and...

  • Databricks architect

    4 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Role: Databricks Technical Lead/ Data ArchitectExperience: 8-13 yearsLocation: Chennai, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and...

  • Lead Data Engineer –Azure

    4 weeks ago

    Pune, Maharashtra, India Admin Looks Full time

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Databricks Solutions Architect

    7 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    About the RoleWe are seeking a highly skilled Databricks Solutions Architect to lead our data engineering and analytics efforts using Databricks, AWS, and Azure Stack.In this role, you will be responsible for developing and implementing data engineering solutions that meet the needs of our clients. The ideal candidate will have a deep understanding of modern...

  • Databricks Architect

    3 weeks ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Role: Databricks Technical Lead/ Data Architect Experience: 8-13 years Location: Chennai, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us...

Azure Databricks Lead/Specialist

4 weeks ago

Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

Job Title : Azure Databricks Lead

Job Overview :

As an Azure Databricks Lead/Specialist, you will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will contribute to building robust data pipelines, ensuring data quality, and enhancing overall performance. You'll collaborate with cross-functional teams to deliver high-quality solutions aligned with business requirements.

Responsibilities :

1. Design and Develop Data Pipelines:

- Create scalable data processing pipelines using Azure Databricks and PySpark.

- Implement ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources.

- Collaborate with data engineers and architects to ensure efficient data movement and transformation.

2. Data Quality Implementation :

- Establish data quality checks and validation rules within Azure Databricks.

- Monitor data quality metrics and address anomalies promptly.

- Work closely with data governance teams to maintain data accuracy and consistency.

3. Unity Catalog Integration :

- Leverage Azure Databricks Unity Catalog to manage metadata, tables, and views.

- Integrate Databricks assets seamlessly with other Azure services.

- Ensure proper documentation and organization of data assets.

4. Delta Lake Expertise :

- Understand and utilize Delta Lake, which provides ACID transactions and time travel capabilities on top of data lakes.

- Implement Delta Lake tables for reliable data storage and versioning.

- Optimize performance by leveraging Delta Lake features.

5. Performance Tuning and Query Optimization:

- Profile and analyze query performance.

- Optimize SQL queries, Spark jobs, and transformations for efficiency.

- Tune resource allocation to achieve optimal execution times.

6. Resource Optimization :

- Manage compute resources effectively within Azure Databricks clusters.

- Scale clusters dynamically based on workload requirements.

- Monitor resource utilization and cost efficiency.

7. Source System Integration :

- Integrate Azure Databricks with various source systems (e.g., databases, data lakes, APIs).

- Ensure seamless data ingestion and synchronization.

- Handle schema evolution and changes in source data.

8 Stored Procedure Conversion in Databricks:

- Convert existing stored procedures (e.g., from SQL Server) into Databricks-compatible code.

- Optimize and enhance stored procedures for better performance within Databricks

- SSRS conversion experience

Qualifications and Skills:

- Education: Bachelor's degree in computer science, Information Technology, or a related field.

- Experience:

- Minimum 5 years of experience architecting and building data platforms on Azure.

- Proficiency in Azure Databricks, PySpark, and SQL.

- Familiarity with Delta Lake concepts.

Certifications (preferred) :

- Microsoft Certified: Azure Data Engineer Associate or similar.

- Databricks Certified Associate Developer for Apache Spark.

(ref:hirist.tech)