Quantiphi | Senior Data Engineer

4 weeks ago

bangalore, India Quantiphi Full time

Job Role: Senior Data Engineer

Experience: 4-8 years

Location: Mumbai/Pune/Bangalore/Trivandrum/Remote


As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in

creating transformational solutions involving cloud migration and advanced data engineering

workloads.


Required Skills:

● Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

● In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.

● Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.

● Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.

● Ability to design and implement complex data processing pipelines in PySpark.

● Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.

● Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.

● Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

● Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

● Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

● Experience building and supporting large-scale systems in a production environment.

● Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.


Good to have skills:

● Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.

● Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.

● Prior experience of working on AWS Migration Acceleration Programs for customers.

● Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.

● Experience using Github/codecommit for developmental activities

● Experience in leading enterprise grade ML model migration workloads from on-premise/GCP to AWS.

● Experience in designing relational, multidimensional , and Master data management

systems.

● Prior experience of planning migration roadmaps for production workloads deployed on-prem or on IAAS provider infrastructure to AWS.

● Ability to collaborate with cross-functional teams such as Developers, QA, Project

Managers, and other stakeholders to understand their requirements and implement solutions.

● Ability to clearly communicate technical roadmap, challenges and mitigation.

● Established data governance policies, procedures, and standards.

  • Quantiphi | Senior Research Engineer

    7 days ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...

  • Quantiphi | Data Scientist

    4 weeks ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve...

  • Quantiphi | Senior Data Engineer

    4 weeks ago

    bangalore, India Quantiphi Full time

    Job Role: Senior Data EngineerExperience: 4-8 yearsLocation: Mumbai/Pune/Bangalore/Trivandrum/RemoteAs a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams increating transformational solutions involving cloud migration and advanced data engineeringworkloads.Required Skills:● Experience: 4+ years of relevant experience in...

  • Quantiphi | Senior Data Engineer

    1 month ago

    bangalore, India Quantiphi Full time

    Job Role: Senior Data EngineerExperience: 4-8 yearsLocation: Mumbai/Pune/Bangalore/Trivandrum/RemoteAs a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams increating transformational solutions involving cloud migration and advanced data engineeringworkloads.Required Skills:● Experience: 4+ years of relevant experience in...

  • Data engineer

    4 weeks ago

    Bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve...

  • Quantiphi | Presales Solution lead- Doc AI

    1 week ago

    bangalore, India Quantiphi Full time

    Senior Client Solutions PartnerCompany ProfileQuantiphi is an award winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are...

  • Quantiphi | Principal Architect

    5 days ago

    bangalore, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will...

  • Quantiphi | Business Analyst

    1 month ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of the business. Quantiphi solves the toughest and most complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to...

  • Quantiphi | Senior Sales Engineer | bangalore

    1 month ago

    bangalore, India Quantiphi Full time

    Job Description Role: Senior Sales Engineer Experience Level: 4 to 7 Years Work location: Mumbai/Bangalore/TrivandrumRole & Responsibilities:As part of the core sales team of Quantiphi, the Sales Engineer will be responsible for the execution of end-to-end sales process in a B2B environment. Your responsibilities will include:Take ownership for enhancing the...

  • Quantiphi | Principal Architect

    4 days ago

    bangalore, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will...

  • Quantiphi | Presales Solution lead- Doc AI

    1 week ago

    bangalore, India Quantiphi Full time

    Senior Client Solutions Partner Company Profile Quantiphi is an award winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are...

  • Quantiphi | Presales Solution lead- Doc AI

    7 days ago

    bangalore, India Quantiphi Full time

    Senior Client Solutions PartnerCompany ProfileQuantiphi is an award winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are...

  • Senior research engineer

    2 months ago

    Bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...

  • Quantiphi | Senior Data Engineer

    5 days ago

    bangalore, India Quantiphi Full time

    Role: Senior Data Engineer (AWS Cloud)Experience: 4+ YearsWork location: Bangalore/Mumbai/Trivandrum (Hybrid)Required Skills:- Experience in working with Oracle, Snowflake, AWS,Hive/S3- Strong software development skills in Python & Pyspark on EMR- Strong SQL experience- Experience in translating current Excel VBA to Python and set up scheduling via...

  • Quantiphi | Senior Data Engineer

    2 days ago

    bangalore, India Quantiphi Full time

    Role: Senior Data Engineer (AWS Cloud)Experience: 4+ YearsWork location: Bangalore/Mumbai/Trivandrum (Hybrid)Required Skills:Experience in working with Oracle, Snowflake, AWS,Hive/S3Strong software development skills in Python & Pyspark on EMRStrong SQL experienceExperience in translating current Excel VBA to Python and set up scheduling via ...

  • Senior Research Engineer

    2 months ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...

  • Senior Research Engineer

    4 months ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...

  • Senior Research Engineer

    4 months ago

    bangalore, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...

  • Quantiphi | Senior Data Engineer

    4 weeks ago

    bangalore, India Quantiphi Full time

    Role: Senior Data Engineer (AWS Cloud)Experience: 4+ YearsWork location: Bangalore/Mumbai/Trivandrum (Hybrid)Required Skills: Experience in working with Oracle, Snowflake, AWS,Hive/S3 Strong software development skills in Python & Pyspark on EMRStrong SQL experienceExperience in translating current Excel VBA to Python and set up scheduling via Astronomer...

  • Quantiphi | Research Engineer

    1 month ago

    bangalore, India Quantiphi Full time

    About Company:Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented...