Databricks Architect

2 weeks ago

Pune, India Eton Technologies Full time

We are looking for DataBricks Expert/Architect to assist in the development of the ETL process and Notebook cleanup. The project involves resolving several inconsistencies in the notebooks and report design. Therefore, we need solid experience with big data and DataBricks and the ability to review and clean notebook design and coding.

7+ Yrs. Experience preferred. This is work from home opportunity. We are looking for both full-time and part-time roles.

**Responsibilities**:

- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks
- Delivering and presenting proofs of concept of key technology components to project stakeholders.
- Developing scalable and re-usable frameworks for ingesting assorted data sets
- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data are always maintained
- Working with event-based / streaming technologies to ingest and process data
- Working with other members of the project team to support the delivery of additional project components (API interfaces, Search)
- Working with Azure CI/CD pipelines
- Working with Azure Dev Ops to support and maintain source control
- Evaluating the performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

**Knowledge**:

- Strong knowledge of Data Management principles
- Experience in building ETL / data warehouse transformation processes
- Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
- Experience using geospatial frameworks on Apache Spark and associated design and development patterns
- Microsoft Azure Big Data Architecture certification.
- Hands-on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics

**Job Types**: Full-time, Part-time

Schedule:

- Monday to Friday

**Experience**:

- total work: 7 years (preferred)

  • Databricks Architect

    2 weeks ago

    Pune, Maharashtra, India Bitwise Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    Bitwise Looking for Databricks Architect at Pune , Relevant Candidate please share resume on email ID - Experience: 10 to 15 yearsEmployment Type: Full-timeIndustry: IT Services and ConsultingStrong expertise in Databricks (Spark, Delta Lake, MLFlow, Workflows, Unity Catalog)Experience with cloud platforms: Azure, AWS, or GCPExpertise in Spark...

  • Databricks Architect

    1 day ago

    Pune, India Bitwise Solutions Full time

    Bitwise Looking for Databricks Architect at Pune , Relevant Candidate please share resume on email ID - Experience: 10 to 15 years Employment Type: Full-time Industry: IT Services and Consulting Strong expertise in Databricks (Spark, Delta Lake, MLFlow, Workflows, Unity Catalog) Experience with cloud platforms: Azure, AWS, or GCP Expertise in Spark...

  • Databricks Solution Architect

    2 weeks ago

    Pune, Maharashtra, India Tudip Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled Databricks Solution Architect to join our team. The ideal candidate will have deep expertise in cloud-based data platforms, advanced analytics, and modern data engineering practices. You will be responsible for designing, implementing, and optimizing scalable data solutions using Databricks and related cloud technologies. This...

  • Databricks Architect

    3 days ago

    Delhi, Bengaluru, Pune, India Impetus Technologies Full time

    Job Description - Overall 10-18 yrs. of Data Engineering experience with Minimum 4+ years of hands on experience in Databricks. Ready to travel Onsite and work at client location. - Proven hands-on experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities. - Analyze business requirements...

  • Databricks Architect

    2 weeks ago

    Pune, Maharashtra, India Vedant Consultancy Services Full time US$ 1,50,000 - US$ 2,00,000 per year

    Position Azure Databricks Architect with Banking Domain ExpLocation Mount Laurel NJNeed 15+ Years of Exp.AzureDatabricksAMLTransactionsKYCFraud ManagementRisk ManagementCreditSQLThanksRajat Kumar -Provident fund

  • Databricks Solution Architect

    6 days ago

    Pune, Maharashtra, India InspireXT Full time ₹ 7,00,000 - ₹ 12,00,000 per year

    About InspireXTInspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance and building...

  • Databricks Solution Architect

    1 day ago

    Pune, India InspireXT Full time

    About InspireXT InspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail. We are investing significantly in our Databricks alliance and...

  • Databricks Architect

    17 hours ago

    Pune, India Eton Technologies Full time

    We are looking for DataBricks Expert/Architect to assist in the development of the ETL process and Notebook cleanup. The project involves resolving several inconsistencies in the notebooks and report design. Therefore, we need solid experience with big data and DataBricks and the ability to review and clean notebook design and coding. 7+ Yrs. Experience...

  • Databricks Solution Architect

    6 days ago

    Pune, Maharashtra, India InspireXT Full time

    **About InspireXT** InspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail. We are investing significantly in our Databricks alliance and...

  • Databricks Architect

    3 days ago

    Pune, Maharashtra, India HoonarTek Full time

    Pune*** **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization. - Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner. - Using centuries of cumulative experience, research and...