Quantiphi - Senior Data Engineer - ETL/Azure Databricks

2 weeks ago

Mumbai, India Quantiphi Analytics Full time

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests youyou would enjoy your career with Quantiphi.Role : Senior Data Engineer (Databricks).Experience Level : 3 to 6 Years.Work location : Mumbai, Bengaluru, Trivandrum.Role & Responsibilities :- Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.- Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc).- Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc.- Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc.- Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.- Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries.Must Have Skills :- 3+ years experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases.- Strong software development skills in at least one of : Python, Pyspark or Scala.- Develop and maintain scalable & modular data pipelines using databricks & Apache Spark.- Experience building and supporting large-scale systems in a production environment.- Experience working on either of the cloud storages AWS S3, Azure data lake, GCS buckets.- Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow.- Integrate Databricks with other cloud services like AWS, Azure or Google Cloud.- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.- Managing and configuring databricks environments, including clusters and notebooks.- Experience working with different file formats parquet, databricks delta lake.- Experience working with data governance on databricks, implementing unity catalog, delta share. (ref:hirist.tech)

  • Natobotics - Senior Data Engineer - Azure Databricks

    3 weeks ago

    Mumbai, India Natobotics Technologies Pvt Limited Full time

    Description : Senior Data Engineer - Azure ETL/ELT & : Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, : 6-8 YearsAbout the Role :We are seeking an experienced Senior Data Engineer with 6-8 years in data engineering to join our team across multiple locations. This role is focused on designing, developing, and maintaining scalable and...

  • Quantiphi - Account Manager - Telecommunications Sector

    3 weeks ago

    Mumbai, India Quantiphi Full time

    Level: 12+ years of experience.Work Location: Mumbai/Singapore.What youll do:As an Account Manager at Quantiphi, you will be responsible for driving growth and expanding our footprint within key accounts in the telecommunications industry.This role requires a deep understanding of the telecom sector, its challenges, and the ability to offer AI, data, cloud,...

  • Senior azure databricks engineer

    4 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) , Singapore (PTE), Malaysia , India and Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Azure Databricks

    2 weeks ago

    Mumbai, India Teamware Solutions Full time

    Job Description Key Responsibilities: - Data Pipeline Development: Design, build, and maintain scalable ETL (Extract, Transform, Load) data pipelines using Azure Databricks, Apache Spark, and Python. - Spark Optimization: Develop and optimize Spark jobs for large-scale data processing on Databricks. Ensure that the jobs run efficiently, leveraging the...

  • Senior Azure Databricks Engineer

    4 weeks ago

    Mumbai, Maharashtra, India, Maharashtra MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Senior azure engineer

    3 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    MLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions. FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial Transactions This is a full-time on-site role for a Senior Databricks Engineer located in Mumbai. As a Data Engineer, you will work...

  • Senior Data Engineer- Databricks

    1 week ago

    Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...

  • Azure Data Engineer

    5 days ago

    Ahmedabad, Mumbai, Pune, India Technomech Placements Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title:Senior Data Engineer Azure Synapse + Databricks (Immediate Joiners Preferred)Company:A Leading German MNC (via Agile Tech Solutions)Location:Pune (Hybrid)Experience Required:7 to 10 yearsNotice Period:Immediate to 30 Days PreferredJob Description:We are hiring a Senior Data Engineer for a prestigious German multinational client in the automotive...

  • Infocus Technologies

    3 weeks ago

    Mumbai, India INFOCUS TECHNOLOGIES PRIVATE LIMITED Full time

    Role Overview :We are seeking a skilled Azure Databricks Engineer to join our growing cloud data engineering team. The ideal candidate will be responsible for designing, developing, and implementing scalable data processing solutions on Azure Cloud using Databricks, Azure Data Factory, and PySpark. This role requires hands-on experience with end-to-end data...

  • Databricks Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position Overview:The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.Key...