
Data Bricks Architect, Data Modeler, Python, Azure
2 weeks ago
DigitalX our new information technology function is spearheading this value driven transformation across Astellas. We are looking for people who excel in embracing change, manage technical challenges and have exceptional communication skills.
We are seeking committed and talented Business Intelligence (BI) Architect to join our new FoundationX team
This position is based in Bengaluru and will require some on-site work.
**Essential Job Responsibilities**:
Your responsibilities will include executing complex data projects, ensuring smooth data flows between systems, and maintaining the efficiency and reliability of databases. This is a fantastic global opportunity to use your proven agile delivery skills across a diverse range of initiatives, utilize your development skills, and contribute to the continuous improvement/delivery of critical IT (Information Technology) solutions. You will also be contributing to the following areas:
End-to-End Data Solutions:
Design end-to-end scalable data streams, storage, data serving systems, and analytical workflows using Databricks.
Define overall architecture, capabilities, platforms, tools, and governing processes.
Data Pipeline Development:
Build data pipelines to extract, transform, and load data from various sources.
Set up metadata and master data structures to support transformation pipelines in Databricks.
Data Warehousing and Data Lakes:
Create data warehouses and data lakes for efficient data storage and management.
Develop and deploy data processing and analytics tools.
Collaboration with DataX and other key stakeholder value teams:
Collaborate with data modelers to create advanced data structures and models within the Databricks environment.
Develop and maintain Python scripts for data processing, transformation, and analysis.
Utilize Azure and AWS cloud services (e.g., Azure Data Lake, AWS S3, Redshift) for data storage and processing.
Work closely with data scientists to develop and deploy data-driven solutions.
Provide technical direction to Data Engineers and perform code reviews.
Continuous Learning:
Stay up to date on the latest data technologies, trends, and best practices.
Participate in smaller focused mission teams to deliver value driven solutions aligned to our global and bold move priority initiatives and beyond.
Collaborate with cross functional teams and practices across the organization including Commercial, Manufacturing, Medical, DataX, GrowthX and support other X (transformation) Hubs and Practices as appropriate, to understand user needs and translate them into technical solutions.
Provide Level 3 and 4 Technical Support to internal users troubleshooting complex issues and ensuring system uptime as soon as possible.
Champion continuous improvement initiatives identifying opportunities to optimize performance security and maintainability of existing data and platform architecture and other technology investments.
Participate in the continuous delivery pipeline Adhering to DevOps best practices for version control automation and deployment. Ensuring effective management of the FoundationX backlog.
Leverage your knowledge of Machine Learning (ML) and data engineering principles to integrate with existing data pipelines and explore new possibilities for data utilization.
Stay up to date on the latest trends and technologies in full-stack-development, data engineering and cloud platforms.
**Required Qualifications**:
Bachelor's or Master's degree in Computer Science, Engineering, or related field.
3 years+ of experience as a Data Engineer or DataBricks Developer.
Proficiency in Python for data manipulation, scripting, and analytics.
Strong understanding of data modeling concepts and practices.
Any relevant cloud-based DataBricks, AWS or Azure certifications for example:
Databricks Data Engineer
AWS Certified Data Analytics Specialty - Professional / Associate (will be considered with relevant experience)
Microsoft Certified Azure Data Engineer Associate
Microsoft Certified Azure Database Administrator
Microsoft Certified Azure Developer
Experience using ETL tools like Talend / Talend Cloud and DataStage (Essential)
Knowledge and experience using Azure DevOps (Essential)
Knowledge and experience of working with SalesForce / SAP (Desirable)
Experience in working with MPP Databases like AWS Redshift
Experience of delivering architectural solutions effectively within Lifesciences or Pharma Domains.
Architectural knowledge of deployment modes of various SAP Analytics solutions (Cloud, On-Premises, Hybrid)
Working Knowledge of connectors like SDA/SDI, Exposing models or queries as Odata for external consumption and Consuming external APIs into BW models.
Good knowledge of latest trends in Analytics space including platforms and solutions from other vendors
Proven work experience on mixed modelling with BW/4HANA and HANA native modelling.
Hands-on experience in S/4HANA Analytics like building and extending CDS Vi
-
Data Bricks, Azure
3 days ago
Bengaluru, India Blue Ocean Ventures Full timeRole - Data Bricks, Azure Experience - 4+ yrs Salary - exp x2 or exp x2.5 LPA **Project : Sony : Bangalore (Work from Office : Hybrid Model)** - **Data Bricks, Azure : 4 plus years** Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure/AWS Databricks - Mandatory 6-8 years of...
-
Data Modelling Architect
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time**Req ID**: 312265 We are currently seeking a Data Modelling Architect (CoE) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). **Title: Data Modelling Architect (CoE)** **Position Overview**: **Key Responsibilities** - Develop conceptual, logical, and physical data models to support data analytics, streaming and data products...
-
Azure Data Architect with Azure Streaming
7 days ago
Bengaluru, India Triangle Global Full timeAzure Data Architect with streaming experience Total experience in data management area for 10 + years with Azure cloud data platform experience • Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & mandatory expertise on Azure streaming Analytics ,Data Bricks,...
-
Azure Ml Architect
1 week ago
Bengaluru, Karnataka, India growel softech Full time**Azure ML Architect **JD Requirements : Azure ML Architect which Experience on Data Bricks Development platform.** **Location : Bangalore** **Prior Experience** - 5+ years’ Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. - Expert level in Designing and Architect solutions in Azure Data...
-
Azure Data Architect
14 hours ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Azure - Architect Job...
-
Azure Data Bricks
1 week ago
Bengaluru, Kolkata, Pune, India Savi Technologies Full time US$ 90,000 - US$ 1,20,000 per yearJob Title: Azure Data bricks DeveloperWork Location: Pune -MH, Kolkata -WB , Bangaluru , KASkill Required: ORACLE ,SQL, DatabricksExperience Range : 6-8 YearsJob Description:Financial Crime experience, SQL, Data Modeling, System Analysis, Databricks engineering and architecture, Database admiration, project and resource planning and management
-
Bengaluru, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore** *** Postal Code **560001** *** Country **India** - **Azure Data Architect with Azure Streaming Analytics (10-15 Yrs)** Azure Data Architect with streaming experience Total experience in data management area for 10 + years with Azure cloud data platform...
-
Azure Data Bricks QA
7 days ago
Bengaluru, Pune, India Compunnel Full time ₹ 1,20,000 - ₹ 28,00,000 per yearAzure Data Bricks QAWork Location: Pune BangaloreYears of experience-5+Salary 12 LPAAzure Data QA:• Must Have Azure Data Bricks, Azure Data Factory, Spark SQL knowledge• Years 4-5 years of testing experience in Azure Data Bricks• Strong experience in SQL along with performing Azure Data bricks Quality Assurance.• Understand complex data system by...
-
Azure Data Architect
3 days ago
Bengaluru, India Skillety Technologies Full time**Job Openings** **Azure Data Architect****: **Job Description**: Role: Azure Data Architect with streaming experience Job description Total experience in data management area for 10 + years with Azure cloud data platform experience Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure...
-
Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per yearPlease find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...