Senior Data Engineer

3 weeks ago

Bangalore, India Quantiphi Full time

Job Role: Senior Data Engineer

Experience: 4-8 years

Location: Mumbai/Pune/Bangalore/Trivandrum/Remote

As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in

creating transformational solutions involving cloud migration and advanced data engineering

workloads.

Required Skills:

● Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

● In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.

● Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.

● Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.

● Ability to design and implement complex data processing pipelines in PySpark.

● Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.

● Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.

● Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

● Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

● Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

● Experience building and supporting large-scale systems in a production environment.

● Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.

Good to have skills:

● Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.

● Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.

● Prior experience of working on AWS Migration Acceleration Programs for customers.

● Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.

● Experience using Github/codecommit for developmental activities

● Experience in leading enterprise grade ML model migration workloads from on-premise/GCP to AWS.

● Experience in designing relational, multidimensional , and Master data management

systems.

● Prior experience of planning migration roadmaps for production workloads deployed on-prem or on IAAS provider infrastructure to AWS.

● Ability to collaborate with cross-functional teams such as Developers, QA, Project

Managers, and other stakeholders to understand their requirements and implement solutions.

● Ability to clearly communicate technical roadmap, challenges and mitigation.

● Established data governance policies, procedures, and standards.

  • Hevo Data

    5 days ago

    Bangalore/Bangalore, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Senior data engineer

    3 weeks ago

    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...

  • Data engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Senior Data Engineer

    1 month ago

    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Senior Data Engineer

    1 month ago

    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Data Engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Senior Data Engineer

    1 month ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Data Engineer

    2 months ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF),...

  • Senior Data Engineer

    2 months ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data EngineerExperience: 8-10 YearsLocation: BangaloreEmployment Type: Full-TimeMust have experience in Capital Markets, Investment banking domain.---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration...

  • Senior Data Engineer

    2 months ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...

  • Data Engineer

    3 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Senior Data Engineer

    2 months ago

    Bangalore, India Capco Full time

    Greetings from Capco... We are hiring for Senior Data Engineer for Bangalore Location. Qualifications: Proven 5-8 years of experience as a Senior Data Engineer or similar role. • Experience with big data tools: Hadoop, Spark, Scala, Hive, etc. • Expert level SQL skills for data manipulation (DML) and validation (DB2). • Experience with...

  • Senior Data Engineer

    2 months ago

    bangalore, India Capco Full time

    Greetings from Capco...We are hiring for Senior Data Engineer for Bangalore Location.Qualifications:Proven 5-8 years of experience as a Senior Data Engineer or similar role.• Experience with big data tools: Hadoop, Spark, Scala, Hive, etc.• Expert level SQL skills for data manipulation (DML) and validation (DB2).• Experience with data pipeline and...

  • Senior data engineer

    4 weeks ago

    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...

  • Senior Data Engineer

    1 month ago

    Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL,...

  • Senior Data Engineer

    1 month ago

    Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing...

  • Senior Data Engineer

    1 month ago

    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing...