Quantiphi | Senior Data Engineer
2 weeks ago
Experience: 4-8 years
Location: Mumbai/Pune/Bangalore/Trivandrum/Remote
As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in
creating transformational solutions involving cloud migration and advanced data engineering
workloads.
Required Skills:
● Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.
● In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.
● Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.
● Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.
● Ability to design and implement complex data processing pipelines in PySpark.
● Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.
● Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.
● Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.
● Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)
● Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.
● Experience building and supporting large-scale systems in a production environment.
● Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.
Good to have skills:
● Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.
● Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.
● Prior experience of working on AWS Migration Acceleration Programs for customers.
● Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.
● Experience using Github/codecommit for developmental activities
● Experience in leading enterprise grade ML model migration workloads from on-premise/GCP to AWS.
● Experience in designing relational, multidimensional , and Master data management
systems.
● Prior experience of planning migration roadmaps for production workloads deployed on-prem or on IAAS provider infrastructure to AWS.
● Ability to collaborate with cross-functional teams such as Developers, QA, Project
Managers, and other stakeholders to understand their requirements and implement solutions.
● Ability to clearly communicate technical roadmap, challenges and mitigation.
● Established data governance policies, procedures, and standards.
-
Quantiphi | Data Scientist
2 weeks ago
bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve...
-
Quantiphi | Research Engineer | bangalore
1 month ago
bangalore, India Quantiphi Full timeAbout The Company: Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines ground breaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed....
-
Quantiphi | Research Engineer | bangalore
1 month ago
bangalore, India Quantiphi Full timeAbout The Company: Quantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines ground breaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed....
-
Quantiphi | Senior Data Engineer
2 weeks ago
bangalore, India Quantiphi Full timeJob Role: Senior Data Engineer Experience: 4-8 years Location: Mumbai/Pune/Bangalore/Trivandrum/Remote As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in creating transformational solutions involving cloud migration and advanced data engineering workloads. Required Skills: ● Experience: 4+ years of relevant...
-
Quantiphi | Senior Data Engineer
2 weeks ago
bangalore, India Quantiphi Full timeJob Role: Senior Data EngineerExperience: 4-8 yearsLocation: Mumbai/Pune/Bangalore/Trivandrum/RemoteAs a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams increating transformational solutions involving cloud migration and advanced data engineeringworkloads.Required Skills:● Experience: 4+ years of relevant experience in...
-
Quantiphi | Business Analyst
2 weeks ago
bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of the business. Quantiphi solves the toughest and most complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to...
-
Data engineer
2 weeks ago
Bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve...
-
Quantiphi | Senior Sales Engineer | bangalore
3 weeks ago
bangalore, India Quantiphi Full timeJob DescriptionRole: Senior Sales EngineerExperience Level: 4 to 7 YearsWork location: Mumbai/Bangalore/TrivandrumRole & Responsibilities:As part of the core sales team of Quantiphi, the Sales Engineer will be responsible for the execution of end-to-end sales process in a B2B environment. Your responsibilities will include:Take ownership for enhancing the...
-
Quantiphi | Senior Sales Engineer | bangalore
4 weeks ago
bangalore, India Quantiphi Full timeJob Description Role: Senior Sales Engineer Experience Level: 4 to 7 Years Work location: Mumbai/Bangalore/Trivandrum Role & Responsibilitie s:As part of the core sales team of Quantiphi, the Sales Engineer will be responsible for the execution of end-to-end sales process in a B2B environment. Your responsibilities will includ e:Take ownership for...
-
Quantiphi | Senior Sales Engineer | bangalore
4 weeks ago
bangalore, India Quantiphi Full timeJob Description Role: Senior Sales Engineer Experience Level: 4 to 7 Years Work location: Mumbai/Bangalore/TrivandrumRole & Responsibilities:As part of the core sales team of Quantiphi, the Sales Engineer will be responsible for the execution of end-to-end sales process in a B2B environment. Your responsibilities will include:Take ownership for enhancing the...
-
Quantiphi | Research Engineer
3 weeks ago
bangalore, India Quantiphi Full timeAbout Company:Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented...
-
Quantiphi | Scrum Master | bangalore
3 weeks ago
bangalore, India Quantiphi Full timeCompany Profile :Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at...
-
Quantiphi | Research Engineer
3 weeks ago
bangalore, India Quantiphi Full timeAbout Company: Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at...
-
Quantiphi | Research Engineer
3 weeks ago
bangalore, India Quantiphi Full timeAbout Company:Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented...
-
Senior research engineer
2 months ago
Bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...
-
Senior Research Engineer
2 months ago
bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...
-
Senior Research Engineer
4 months ago
bangalore, India Quantiphi Full timeQuantiphi is an award-winning AI-first digital engineering company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Quantiphi has seen 2.5x...
-
Quantiphi | Scrum Master | bangalore
3 weeks ago
bangalore, India Quantiphi Full timeCompany Profile : Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at...
-
Quantiphi | Scrum Master | bangalore
3 weeks ago
bangalore, India Quantiphi Full timeCompany Profile :Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at...
-
Bangalore, India Quantiphi Analytics Full timeCompany Profile Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will...
