Senior Azure Databricks Engineer
3 weeks ago
Company Description
MLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.
Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL)
Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial Transactions
Role Description
This is a full-time on-site role for a Senior Databricks Engineer located in Mumbai.
As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations. Note: This is a data engineer from the application side. Must be able to analyze data and develop strategies for populating data lakes. This is not an infrastructure position. This person may be called upon to do complex coding using U-SQL, Scala or Python and T-SQL.
Skills/Qualifications
• Expertise in Any ETL tool i.e. (SSIS, Informatica, Data Stage)
• Expertise to Implementing Data warehousing Solutions
• experience as Data Engineer in Azure Big Data Environment
• Programming experience in Scala or Python, SQL
• Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks) -- Mandatory
• Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
• Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale
• Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
• Good Understanding of Modern Data Warehouse/Lambda Architecture, Data warehousing concepts
• Proficient in a source code control system such as GIT
• Knowledge of C#
• Ability to code
• Ability to use word to create required technical documentation
• Soft Skills
• Excellent written and verbal skills (English)
• Flexible
• Self-Starter
• Team Player or individual contributor
-
Senior Azure Databricks Engineer
1 week ago
Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...
-
Azure Data Engineer – Databricks
2 weeks ago
Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeRole: Azure Data Engineer – DatabricksLocation: PAN INDIAExperience: 6 to 8 YearsRequired Technical Skill Set**Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, SynapseMust-Have**Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and...
-
Senior Databricks Architect
2 weeks ago
Mumbai, Maharashtra, India, Maharashtra Jio Platforms Limited Full timeWork Locations: Mumbai OR Hyderabad OR GurgaonAbout the Role:We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to...
-
Databricks Engineer
2 weeks ago
Mumbai, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeGreetings from TCS!!Job Title: Databricks EngineerJob location: Hyderabad, Noida, Chennai, MumbaiExperience range: 5-10 yearsJob Description: Experience working on Azure Databricks using Scala, PySpark Experience on Azure Cloud platform Experience of full Software Development Life Cycle experience Knowledge about Azure DevOps and Terraform Experience with...
-
Data Engineer(Azure Databricks)
2 weeks ago
Navi Mumbai, Maharashtra, India Persistent Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAbout Position:As a Data Engineer, you will design and manage robust data pipelines using Azure Databricks, Spark, and Kafka. You'll process large-scale datasets and implement CDC pipelines to power analytics platforms. Your role includes modeling data using the Medallion Architecture and ensuring data quality and governance. Collaboration with analytics...
-
Azure Data Engineer(Databricks, Datafactory)
3 weeks ago
Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeAzure Data EngineerPrimary Skills: SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,DatabricksSecondary Skills: Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BIProficiency in SQL and Python. SQL being far more important.Experience with Apache Spark for data processing (Python...
-
Azure Platform Engineer
3 weeks ago
Navi Mumbai, Maharashtra, India, Maharashtra HDFC Bank Full timeShould have good knowledge on data warehouse and lakehouse conceptsWorking knowledge on Data technologies tools such as Azure Databricks, Azure ML, Azure Datafactory, Azure Datalake storageService provisioning through terraform across the environmentDeployment of application on AKS and REDHAT open shift clusters, managing the dockers and monitor the...
-
Databricks Engineer
4 days ago
Mumbai, Maharashtra, India AVE-Promagne Business Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per yearResponsibilities : - Design, develop, and implement data pipelines using Apache Spark and Databricks notebooks to process and transform large datasets. - Optimize data pipelines for performance, scalability, and cost-effectiveness. - Automate data pipelines and integrate them with our existing data infrastructure. - Develop and maintain unit...
-
Senior Data Engineer
1 day ago
Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...
-
Senior Data Engineer- Databricks
19 hours ago
Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...