Senior data engineer

3 days ago

Thiruvananthapuram, India Quantiphi Full time
Company Profile
Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.
Some company highlights:
Delivered 2.5x growth Yo Y since its inception in 2013.
Headquartered in Boston with 4000+ Quantiphi professionals across the globe.
Winner of the “Data Analytics” and “Public Sector” Partner of the Year from Google for 2020.
Winner of the “America's Service Delivery Partner of the Year” award from NVIDIA for 2021.
Recognized by top global analyst firms like Gartner, Frost & Sullivan, IDC, Fast Company, ISG & Everest group as an industry leader in the AI-led digital transformation across categories.
Recognized by Everest Group as “Specialist Leader” and “Start Performer” in Analytics and AI Services.
Winner of “Industry Partner of the Year” and “AI/ML partner of the Year” from AWS regional and global team for 2022.
Recognized by Gartner as a leading Vendor for US Healthcare Payers 2022 and for Healthcare Data, Analytics and AI 2022, in the AI strategy category.
Recognized under India's 40 Best Workplaces in Health and Wellness 2022.
Certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.
For more details, visit: our Website or our Linked In Page
Job Description :
Role: Senior Data Engineer - Big Data
Experience Level: 3 to 6 Years
Work location: Trivandrum
What you’ll do:
You will be working as a Data Engineer within the Healthcare & Lifesciences domain, designing and delivering data pipelines for structured and unstructured data that are running across multiple geographies, helping healthcare organizations achieve their business goals with use of data ingestion technologies & BI solutions. You will be working with Architects from other specialties such as Cloud engineering, Software engineering, ML engineering to create solutions and applications that cater to latest trends in the healthcare industry such as digital diagnosis, software as a medical product, AI marketplace, amongst others.
Role & Responsibilities:
Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc)
Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc
Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc
Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries
Skills expectation:
Must have:
3+ years’ experience of Hands-on in data structures, distributed systems, Hadoop and Spark, SQL and No SQL Databases
Experience of working on Datawarehouse/Data Lake projects using Snowflake (must) and either of Redshift/Big Query/Synapse/Databricks/Iceberg.
Designing and development of ETL pipeline (AWS/Azure/GCP)
Strong skills in writing SQL queries, stored procedures and functions in any of the SQL supported databases
Strong software development skills in at least one of: Python, Pyspark or Scala.
Any of Airflow, Oozie, Apache Ni Fi, Google Data Flow Message/Event Solutions or other job orchestration services.
Experience in developing Big Data solutions (migration, storage, processing)
Experience in building and supporting large-scale systems in a production environment
Cloud Platforms – AWS/GCP/Azure Big Data Distributions
Any of Apache Hadoop/CDH/HDP/AWS EMR/Google Data Proc/Databricks/HD-Insights Distributed processing Frameworks.
Leadership qualities
Ability to lead technology teams and provide them mentorship / support to accelerate performance.
Experience in leading multiple large projects as well as a deep understanding of Agile developments
Effective communication with all the stakeholders involved.
Communicate clearly about complex subjects and technical plans with technical and non technical audiences.
Good to have:
Experience of working on Datawarehouse/Data Lake projects using either of Redshift/Big Query/Synapse/Snowflake/Databricks/Iceberg
Tableau, Looker, Power BI
Any of Kafka, Kinesis, Cloud pub-sub Container Orchestration (Good to have)
Requirement gathering and understanding of the problem statement
End-to-end ownership of the entire delivery of the project
Designing and documentation of the solution
Team management and mentoring
Behavioural skills:
Effective communication with all the stakeholders involved
Need to communicate clearly about complex subjects and technical plans
Ability to mentor and groom junior members of the team and provide them with guidance and roadmap.
Must also have the ability to interact with other members of the team (Juniors, Seniors, ATA, TA, BA, etc) to get their designs from concept to development
Keeping various audiences in mind, engineers must write their reports in clear language accessible to all.

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior data engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    1 month ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Databricks Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India Luxoft Full time

    Project descriptionWe are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of...

  • Senior Data Scientist

    3 days ago

    Thiruvananthapuram, Kerala, India Ellow Full time

    About the Role:Eallow is seeking a highly experienced Senior Machine Learning Engineer with more than 7 years of experience in AI/ML and strong expertise in Google Cloud Platform (GCP) services.As a core member of our team, you will design and implement scalable machine learning solutions in the Health Care Sector while working closely with stakeholders to...

  • Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Zeno Health Full time

    Job Description:We are seeking a highly skilled Lead Data Engineer with a strong background in Python, SQL, and modern big data technologies. The ideal candidate will have a proven track record in designing and implementing scalable data pipelines, managing ETL processes, and leveraging diverse data storage and processing frameworks, including relational and...

  • Quantiphi | Senior Data Engineer

    3 days ago

    thiruvananthapuram, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...

  • Alp Consulting Ltd. | Data Engineer | thiruvananthapuram

    3 weeks ago

    thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Data Analyst

    2 weeks ago

    Thiruvananthapuram, Kerala, India SASoftTechnologies Pvt LTD Full time

    SASoftTechnologies Pvt LTD is seeking a skilled Senior Data Analyst to join our team.We offer a competitive salary of $120,000 per year.Job Description:As a Senior Data Analyst at SASoftTechnologies Pvt LTD, you will collaborate on data-driven solutions for projects, analyze and interpret large datasets, develop and implement machine learning models, conduct...

  • Alp Consulting Ltd. | Data Engineer | thiruvananthapuram

    3 weeks ago

    thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Software Engineer

    4 months ago

    Thiruvananthapuram, India Waybeo Software Solutions Pvt Ltd Full time

    We are looking to hire a dynamic Senior Software Engineer in PHP to manage our back-end services and ensure a seamless interchange of data between the server and our users. As a Senior Software Engineer, you will be responsible for developing and coding all server-side logic. You will also be required to maintain the central database and respond to requests...

  • Quantiphi | Senior Data Engineer

    4 days ago

    thiruvananthapuram, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep...