Quantiphi - Senior Data Engineer - ETL/Azure Databricks

1 week ago

Bengaluru, Karnataka, India Quantiphi Analytics Full time

While technology is the heart of our business, a global and diverse culture is the heart of our success.

We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests youyou would enjoy your career with Quantiphi.

Role : Senior Data Engineer (Databricks).

Experience Level : 3 to 6 Years.

Work location : Mumbai, Bengaluru, Trivandrum.

Role & Responsibilities :

- Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.

- Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc).

- Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc.

- Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc.

- Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.

- Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries.

Must Have Skills :

- 3+ years experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases.

- Strong software development skills in at least one of : Python, Pyspark or Scala.

- Develop and maintain scalable & modular data pipelines using databricks & Apache Spark.

- Experience building and supporting large-scale systems in a production environment.

- Experience working on either of the cloud storages AWS S3, Azure data lake, GCS buckets.

- Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow.

- Integrate Databricks with other cloud services like AWS, Azure or Google Cloud.

- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.

- Managing and configuring databricks environments, including clusters and notebooks.

- Experience working with different file formats parquet, databricks delta lake.

- Experience working with data governance on databricks, implementing unity catalog, delta share.

(ref:hirist.tech)

  • Quantiphi - Associate Architect - Data Engineering

    1 week ago

    Bengaluru, Karnataka, India Quantiphi Analytics Full time

    Job Title : Associate Architect Data Engineering.Experience : 6 to 9 Years.Location : Bangalore / Mumbai (any) (Hybrid WFO).About the Role :We are looking for a skilled Data Engineers with hands-on experience in the Microsoft Azure data ecosystem. The ideal candidate will play a critical role in designing, developing, and managing data pipelines and...

  • Azure Databricks Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India Apex One Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Power Bi and AAS expert (Strong SC or Specialist Senior)Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis ServiceShould be able to write and test Dex queries.Should be able generate Paginated Reports in Power BIShould have minimum 3 Years working experience in delivering projects in Power BiMust Have:-3 to 8...

  • Architect - Azure

    2 weeks ago

    Bengaluru, Karnataka, India Quantiphi Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • - Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Skan ai Full time

    Job Summary :We are seeking a skilled Data Engineer with 3 to 5 years of experience in building scalable data pipelines and solutions, with strong hands-on expertise in Databricks. The ideal candidate should be proficient in working with large-scale data processing frameworks and have a solid understanding of Delta Lake, PySpark, and cloud-based data...

  • Azure Data Engineer(5-9 years)

    2 weeks ago

    Bengaluru, Karnataka, India Quantiphi Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job Title: Data Engineer – Azure PlatformExperience: 5–7 YearsLocation: Bangalore - HybridAbout the Role:We are looking for askilled Data Engineerwith hands-on experience in theMicrosoft Azure data ecosystem. The ideal candidate will play a critical role in designing, developing, and managing data pipelines and transformation frameworks that enable...

  • Azure Data Engineer(5-9 years)

    2 weeks ago

    Bengaluru, Karnataka, India Quantiphi Full time

    Job Title: Data Engineer – Azure Platform Experience: 5–7 Years Location: Bangalore - Hybrid About the Role: We are looking for a skilled Data Engineer with hands-on experience in the Microsoft Azure data ecosystem. The ideal candidate will play a critical role in designing, developing, and managing data pipelines and transformation frameworks that...

  • Azure Data Engineer(5-9 years)

    2 weeks ago

    Bengaluru, Karnataka, India Quantiphi Full time

    Job Title: Data Engineer – Azure Platform Experience: 5–7 Years Location: Bangalore - Hybrid About the Role: We are looking for a skilled Data Engineer with hands-on experience in the Microsoft Azure data ecosystem . The ideal candidate will play a critical role in designing, developing, and managing data pipelines and transformation...