Senior Data Engineer

2 weeks ago

Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 1,40,000 - ₹ 28,00,000 per year

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi

Role:  Senior Data Engineer (Databricks)

Experience Level: 3 to 6 Years

Work location:   Trivandrum

Role & Responsibilities:

  • Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.

  • Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc)

  • Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc

  • Implement solutions  with features like Snowpipe, tasks, streams,dynamic tables etc

  • Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.

  • Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries

Must have skills:

  • 3+ years' experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases 

  • Strong software development skills in at least one of:  Python, Pyspark or Scala.

  • Develop and maintain scalable & modular data pipelines using databricks & Apache Spark

  • Experience building and supporting large-scale systems in a production environment    

  • Experience working  on either of the cloud storages - AWS S3, Azure data lake, GCS buckets

  • Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow

  • Integrate Databricks with other cloud services like AWS, Azure or Google Cloud

  • Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks

  • Managing and configuring databricks environments, including clusters and notebooks

  • Experience working with different file formats - parquet, databricks delta lake

  • Experience working with data governance on databricks, implementing unity catalog, delta share

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us

  • Transformative Senior Data Engineer Lead

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 35,00,000

    **Job Title:** Data Engineering LeadOverview:Our organization is seeking an experienced Senior Data Engineer Lead to lead our data engineering team in the design, development, and implementation of scalable data infrastructure.Key Responsibilities:Lead a team of senior data engineers to design, develop, and implement data architecture, including data...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Transformative Career Opportunity in Data EngineeringTalent500 presents an exceptional opportunity for a skilled Senior Engineer to join its esteemed client's team.Snowflake Data Engineering: Develop and optimize data warehouse solutions in Snowflake, ensuring performance and scalability for finance and accounting workloads.dbt Development: Build and...

  • Senior Cloud Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Cloud Data EngineerJob DescriptionWe are seeking an experienced Senior Cloud Data Engineer to join our team. The ideal candidate will have a strong background in cloud computing, data engineering, and big data technologies.Assess Technology Landscape: Evaluate the current technology landscape and assess the impact of new requirements on...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Betterbeans Consultants Pvt Ltd Full time

    Role : Senior Data EngineerExperience : 8-10 years' experienceSkill Set Required : Azure Data FactoryAzure DatabricksPythonSQL, PL/SQLSSISJob Role/Job Description : Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Collaborate with...

  • Senior Data Engineering Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Chief Data Engineering ProfessionalWe seek an accomplished Chief Data Engineering Professional to contribute to our dynamic Data Warehouse team.The ideal candidate will possess extensive experience in data engineering, with a proven track record of leading high-performing teams.You will play a pivotal role in shaping the architecture, mentoring senior...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Quantiphi Analytics Solutions Private Limited Full time

    Job DescriptionWhile technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but...

  • Cloud Data Engineering Leader

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly experienced Senior Data Engineer with a strong focus on Databricks and cloud-based data engineering to lead our data engineering team.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data...

  • Senior Data Engineer with Cloud Computing Expertise

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer Position Greetings, we are seeking a Senior Data Engineer to join our team. This role is designed for experienced professionals with a strong background in data engineering and cloud computing. This position offers a unique opportunity to work with cutting-edge technology, build scalable data pipelines, and drive business growth through...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Data Engineering Lead

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionJob Summary:The Senior Data Engineer will design, build, and maintain large-scale data systems to support business growth. This role requires a strong understanding of data modeling, SQL, ETL, and data warehousing.Key Responsibilities:Develop and implement data lakes using Azure Data Factory, Spark, and Azure...