Quantiphi | Senior Data Engineer

4 days ago

thiruvananthapuram, India Quantiphi Full time

Company Profile

Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.


Some company highlights:

  • Delivered 2.5x growth YoY since its inception in 2013.
  • Headquartered in Boston with 4000+ Quantiphi professionals across the globe.
  • Winner of the “Data Analytics” and “Public Sector” Partner of the Year from Google for 2020.
  • Winner of the “America's Service Delivery Partner of the Year” award from NVIDIA for 2021.
  • Recognized by top global analyst firms like Gartner, Frost & Sullivan, IDC, Fast Company, ISG & Everest group as an industry leader in the AI-led digital transformation across categories.
  • Recognized by Everest Group as “Specialist Leader” and “Start Performer” in Analytics and AI Services.
  • Winner of “Industry Partner of the Year” and “AI/ML partner of the Year” from AWS regional and global team for 2022.
  • Recognized by Gartner as a leading Vendor for US Healthcare Payers 2022 and for Healthcare Data, Analytics and AI 2022, in the AI strategy category.
  • Recognized under India's 40 Best Workplaces in Health and Wellness 2022.
  • Certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.


For more details, visit: our Website or our LinkedIn Page


Job Description :

Role: Senior Data Engineer - Big Data

Experience Level: 3 to 6 Years

Work location: Trivandrum


What you’ll do:

You will be working as a Data Engineer within the Healthcare & Lifesciences domain, designing and delivering data pipelines for structured and unstructured data that are running across multiple geographies, helping healthcare organizations achieve their business goals with use of data ingestion technologies & BI solutions. You will be working with Architects from other specialties such as Cloud engineering, Software engineering, ML engineering to create solutions and applications that cater to latest trends in the healthcare industry such as digital diagnosis, software as a medical product, AI marketplace, amongst others.


Role & Responsibilities:

  • Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
  • Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc)
  • Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc
  • Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc
  • Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
  • Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries


Skills expectation:

Must have:

  • 3+ years’ experience of Hands-on in data structures, distributed systems, Hadoop and Spark, SQL and NoSQL Databases
  • Experience of working on Datawarehouse/DataLake projects using Snowflake (must) and either of Redshift/Big Query/Synapse/Databricks/Iceberg.
  • Designing and development of ETL pipeline (AWS/Azure/GCP)
  • Strong skills in writing SQL queries, stored procedures and functions in any of the SQL supported databases
  • Strong software development skills in at least one of: Python,Pyspark or Scala.
  • Any of Airflow, Oozie, Apache NiFi, Google DataFlow Message/Event Solutions or other job orchestration services.
  • Experience in developing Big Data solutions (migration, storage, processing)
  • Experience in building and supporting large-scale systems in a production environment
  • Cloud Platforms – AWS/GCP/Azure Big Data Distributions
  • Any of Apache Hadoop/CDH/HDP/AWS EMR/Google DataProc/Databricks/HD-Insights Distributed processing Frameworks.



Leadership qualities

  • Ability to lead technology teams and provide them mentorship / support to accelerate performance.
  • Experience in leading multiple large projects as well as a deep understanding of Agile developments
  • Effective communication with all the stakeholders involved.
  • Communicate clearly about complex subjects and technical plans with technical and non technical audiences.
  • Good to have:
  • Experience of working on Datawarehouse/DataLake projects using either of Redshift/Big Query/Synapse/Snowflake/Databricks/Iceberg
  • Tableau, Looker, Power BI
  • Any of Kafka, Kinesis, Cloud pub-sub Container Orchestration (Good to have)
  • Requirement gathering and understanding of the problem statement
  • End-to-end ownership of the entire delivery of the project
  • Designing and documentation of the solution
  • Team management and mentoring


Behavioural skills:

  • Effective communication with all the stakeholders involved
  • Need to communicate clearly about complex subjects and technical plans
  • Ability to mentor and groom junior members of the team and provide them with guidance and roadmap.
  • Must also have the ability to interact with other members of the team (Juniors, Seniors, ATA, TA, BA, etc) to get their designs from concept to development
  • Keeping various audiences in mind, engineers must write their reports in clear language accessible to all.

  • Quantiphi | Senior Data Engineer

    3 days ago

    thiruvananthapuram, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...

  • Senior data engineer

    3 days ago

    Thiruvananthapuram, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...

  • Quantiphi | Senior Software Developer

    3 days ago

    thiruvananthapuram, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients toughest and most complex business problems by combining deep industry...

  • Data Engineer Leader for Healthcare Solutions

    4 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Quantiphi, a pioneering AI-first digital transformation engineering company, seeks an experienced Senior Data Engineer to spearhead the design and delivery of data pipelines for structured and unstructured data across multiple geographies. This role offers a unique opportunity to leverage expertise in data ingestion technologies and BI solutions to drive...

  • Quantiphi - Senior Data Engineer - Quicksight

    1 month ago

    Mumbai/Bangalore/Trivandrum/Thiruvananthapuram, India Quantiphi Analytics Full time

    Role : Senior Data EngineerExperience Range : 3-7 Years Work Location : Mumbai/ Bangalore/ Trivandrum (Hybrid)Responsibilities : - Design and Implement Data Pipelines : Develop and maintain scalable data pipelines to extract, transform, and load data from various sources into data warehouses or lakes, ensuring high data quality and integrity.- Amazon...

  • Technical Lead Software Developer

    4 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Company OverviewQuantiphi, an award-winning AI-first digital transformation engineering company, drives innovation at the heart of business. With a passion for customers and problem-solving, we deliver transformational solutions across industries.We have achieved 2.5x growth since inception in 2013 and are headquartered in Boston with over 4000 professionals...

  • Aem

    7 months ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior data engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    1 month ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Databricks Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India Luxoft Full time

    Project descriptionWe are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of...

  • Architect - Platform

    2 months ago

    thiruvananthapuram, India Quantiphi Full time

    Role : Technical Architect - Platform (Managed Services)Location : Mumbai/Bangalore/TrivandrumExperience : 7+ yearsRoles and Responsibilities: ● Hands on experience managing Incident Requests, Service Requests and Change Requests.● Experience in large scale releases/deployment and change management.● Experience with ITSM tools (like Jira, ServiceNow,...