Senior Data Engineer

7 days ago

Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 20,00,000 - ₹ 25,00,000 per year

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi

Role: Senior Data Engineer (Databricks)
Experience Level: 3 to 6 Years
Work location: Trivandrum
Role & Responsibilities

  • Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
  • Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc)
  • Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc
  • Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc
  • Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
  • Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries

Must Have Skills

  • 3+ years' experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases
  • Strong software development skills in at least one of: Python, Pyspark or Scala.
  • Develop and maintain scalable & modular data pipelines using databricks & Apache Spark
  • Experience building and supporting large-scale systems in a production environment
  • Experience working on either of the cloud storages - AWS S3, Azure data lake, GCS buckets
  • Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow
  • Integrate Databricks with other cloud services like AWS, Azure or Google Cloud
  • Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
  • Managing and configuring databricks environments, including clusters and notebooks
  • Experience working with different file formats - parquet, databricks delta lake
  • Experience working with data governance on databricks, implementing unity catalog, delta share

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us

  • Senior Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Analytics Solution Pvt Ltd Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Data Engineer - Databricks While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in...

  • Senior Data Engineer

    3 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Senior Data Scientist – ML, Data Insights

    1 week ago

    Thiruvananthapuram, Kerala, India techvantage Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role Overview:We are looking for a Senior Data Scientist with a strong foundation in machine learning, data analysis, and a growing expertise in LLMs and Gen AI. The ideal candidate will be passionate about uncovering insights from data, proposing impactful use cases, and building intelligent solutions that drive business value.Key Responsibilities:Analyze...

  • Senior Data Analyst

    5 days ago

    Thiruvananthapuram, Kerala, India Chalo Mobility Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a highly skilled Senior Data Analyst who can bridge data analysis with data engineering. The ideal candidate will have strong expertise in building data pipelines, driving reporting excellence, and mentoring junior analysts.Youll work closely with our product and development teams to deliver actionable insights, maintain data integrity,...

  • Senior Data Scientist

    2 weeks ago

    Thiruvananthapuram, Kerala, India Wider World Immigration Full time ₹ 36,00,000 - ₹ 48,00,000 per year

    Min Experience:4 YearsJob Location:Australia, Germany, Singapore, and CanadaSalary Range:70 to 80 LPA with other BenefitsRole DescriptionThis is a full-time on-site role for a Senior Data Scientist inAustralia, Germany, Singapore, and Canada. The Senior Data Scientist will be responsible for performing data analysis, creating data visualizations, and...

  • Lead- Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India UST Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    7 - 12 Years1 OpeningTrivandrumRole descriptionLead II - Software Engineering Who we are:At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 25 countries, we build for...

  • Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India Tothr Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking dynamic candidate for the role of Data Engineer,who is proficient in Data Engineering,Fraud & Financial Crime Risk Management, Real-time Data Pipelines, Fraud Tools ,Python, SQL, Data Processing Frameworks and Machine Learning

  • Senior Machine Learning Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Quantiphi Analytics Solution Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Machine Learning Engineer While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in...

  • Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Trenser Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    OverviewThis position is for a Data Engineer for a team that works on a long-term software projectfor a US client. The job location is Trivandrum, India. He/ she will be communicating withthe client representatives in the USA, both for technical and management aspects.Communication will be through various modes of collaboration including webconferences,...