Databricks Architect

5 months ago


Pune, India Eton Technologies Full time

We are looking for DataBricks Expert/Architect to assist in the development of the ETL process and Notebook cleanup. The project involves resolving several inconsistencies in the notebooks and report design. Therefore, we need solid experience with big data and DataBricks and the ability to review and clean notebook design and coding.

7+ Yrs. Experience preferred. This is work from home opportunity. We are looking for both full-time and part-time roles.

**Responsibilities**:

- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks
- Delivering and presenting proofs of concept of key technology components to project stakeholders.
- Developing scalable and re-usable frameworks for ingesting assorted data sets
- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data are always maintained
- Working with event-based / streaming technologies to ingest and process data
- Working with other members of the project team to support the delivery of additional project components (API interfaces, Search)
- Working with Azure CI/CD pipelines
- Working with Azure Dev Ops to support and maintain source control
- Evaluating the performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

**Knowledge**:

- Strong knowledge of Data Management principles
- Experience in building ETL / data warehouse transformation processes
- Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
- Experience using geospatial frameworks on Apache Spark and associated design and development patterns
- Microsoft Azure Big Data Architecture certification.
- Hands-on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics

**Job Types**: Full-time, Part-time

Schedule:

- Monday to Friday

**Experience**:

- total work: 7 years (preferred)

**Speak with the employer**
+91 9356061524


  • Databricks Architect

    5 months ago


    Pune, India Jade Global Full time

    ID: 6619 | 10-15 yrs | Pune | careers Databricks Architect Overall Experience : 10+ years of experience in Databricks Product suite Experience of 10+ years in data preparation. BI projects to understand business requirements in BI context and understand data model to transform raw data into meaningful insights Designing and creating data models that...


  • Pune, Maharashtra, India HoonarTek Full time

    Pune*** **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization. - Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner. - Using centuries of cumulative experience, research and...


  • Pune, Maharashtra, India Exusia Full time

    About ExusiaExusia is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business objectives and providing strategy and solutions in data management and analytics.The company has established its leadership position by solving some of the world's largest and most complex data problems in the financial,...


  • Pune, Maharashtra, India Exusia Full time

    About the RoleExusia, a cutting-edge digital transformation consultancy, seeks a skilled Azure Data Engineer/Databricks Architect to join our global delivery team's Data Engineering practice in India.Key Responsibilities:Work on client projects to deliver Microsoft Azure-based Data engineering & Analytics solutionsProvide hands-on technical leadership for...


  • Bangalore/Hyderabad/Pune, India Huquo Full time

    Job DescriptionAt Huquo, we are seeking a highly skilled Databricks Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on Databricks.Key ResponsibilitiesCreate efficient data pipelines using Pyspark and SQLDevelop and manage cluster pools and...


  • Pune, Maharashtra, India Exusia Full time

    About ExusiaExusia is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business objectives and providing strategy and solutions in data management and analytics.The company has established its leadership position by solving some of the world's largest and most complex data problems in the financial,...


  • Pune, India Exusia Full time

    About The Position Department: Sales and Delivery Team - Empower Industry: Information Technology & Services, Computer Software, Management Consulting Location: Hyderabad, Pune Experience Range : 5+ years Basic Qualification: Master/Bachelor of Engineering or Equivalent Travel Requirements: Not required Website : Exusia, a...


  • Delhi NCR/Pune/Bangalore/Kolkata/Chennai, India ESTEEM CONSULTANCY Full time

    Job Title: Senior Databricks Data ArchitectAbout the Role:We are seeking a highly skilled Senior Databricks Data Architect to join our team at ESTEEM CONSULTANCY. As a key member of our data engineering team, you will be responsible for designing and implementing modern data warehouse solutions using Databricks and AWS/Azure Stack.Key...

  • Data Architect

    3 weeks ago


    Pune, Maharashtra, India RS Consultants Full time

    Job Title : Data Architect Location : Pune Experience Level : 6+ Years Company Type : AI/ML startup.Please apply only if you are comfortable working with Early stage startup. Job Description : We are seeking a Data Architect to design and oversee the development of scalable, high-performance data systems. In this role, you will leverage your expertise in the...


  • Pune, Maharashtra, India Erobern Consulting Full time

    Job Title: Azure Databricks LeadAs a key member of our team at Erobern Consulting, you will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will contribute to building robust data pipelines, ensuring data quality, and enhancing overall performance.Responsibilities:Design and Develop Data...


  • Pune, India N-Systems Technologies Pvt Ltd Full time

    Job Title: Azure Databricks EngineerWe are seeking an experienced Azure Databricks Engineer to join our team at N-Systems Technologies Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.Key Responsibilities:Design, develop, and optimize data...


  • Pune, India N-Systems Technologies Pvt Ltd Full time

    Job Title: Azure Databricks EngineerWe are seeking an experienced Azure Databricks Engineer to join our team at N-Systems Technologies Pvt Ltd. The ideal candidate will have a strong background in data engineering and experience working with Azure Databricks.Key Responsibilities:Design, develop, and optimize data pipelines using Azure DatabricksManage and...


  • Pune, Maharashtra, India Exusia Full time

    About the RoleThe Exusia team is seeking a skilled Azure Data Engineer to join our global delivery team's Data Engineering practice in India. As a key member of our team, you will be responsible for designing and implementing scalable analytics solutions on Azure, working on client projects to deliver Microsoft Azure based Data engineering & Analytics...


  • Delhi NCR/Pune/Bangalore/Kolkata/Chennai, India ESTEEM CONSULTANCY Full time

    {"Role": "Senior Databricks Engineer/Technical Lead/Architect", "Responsibilities": "Developing Modern Data Warehouse solutions using Databricks and AWS/Azure Stack, Providing forward-thinking solutions in data engineering and analytics space, Collaborating with DW/BI leads to understand new ETL pipeline development requirements, Triage issues to find gaps...

  • Lead Consultant

    5 days ago


    Pune, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Bangalore/Hyderabad/Pune, India Huquo Full time

    Data Engineering ExpertiseWe are seeking a highly skilled Data Engineering professional to join our team at Huquo. The ideal candidate will have 7+ years of experience in data engineering, with a strong focus on Databricks (DB) and a proven track record of delivering high-quality solutions.Key ResponsibilitiesCreation of jobs using Pyspark and SQLCluster...


  • Delhi NCR/Pune/Bangalore/Kolkata/Chennai, India ESTEEM CONSULTANCY Full time

    Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 3-15 yearsLocation : Bangalore, Chennai, Delhi, Pune, KolkataPrimary Roles and Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics...


  • Pune, India Quess Full time

    Project Overview : CFT Cloud Data Platform team is an Enterprise Project team which manages Cloud data platform (Azure Data Bricks and Snowflake) and build system automation, IAM Role Access Management, System and Network Security, Platform Infrastructure, Feature release management and self service module tasks around the platform.Job description : As a...

  • Lead Consultant

    2 weeks ago


    Pune, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Data Architect

    3 weeks ago


    Pune, India RS Consultants Full time

    Job Title: Data ArchitectJob Summary:We are seeking a Data Architect to design and oversee the development of scalable, high-performance data systems. The ideal candidate will have extensive hands-on experience with Snowflake, Databricks, and Apache Spark, as well as proficiency in SQL, Python, and Java.Key Responsibilities:Architect and implement...