Senior Data Engineer

2 days ago

Bengaluru, India Quantiphi Full time

Job Role: Senior Data Engineer

Experience: 4-8 years

Location: Mumbai/Pune/Bangalore/Trivandrum/Remote


As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in

creating transformational solutions involving cloud migration and advanced data engineering

workloads.


Required Skills:

● Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

● In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.

● Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.

● Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.

● Ability to design and implement complex data processing pipelines in PySpark.

● Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.

● Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.

● Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

● Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

● Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

● Experience building and supporting large-scale systems in a production environment.

● Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.


Good to have skills:

● Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.

● Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.

● Prior experience of working on AWS Migration Acceleration Programs for customers.

● Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.

● Experience using Github/codecommit for developmental activities

● Experience in leading enterprise grade ML model migration workloads from on-premise/GCP to AWS.

● Experience in designing relational, multidimensional , and Master data management

systems.

● Prior experience of planning migration roadmaps for production workloads deployed on-prem or on IAAS provider infrastructure to AWS.

● Ability to collaborate with cross-functional teams such as Developers, QA, Project

Managers, and other stakeholders to understand their requirements and implement solutions.

● Ability to clearly communicate technical roadmap, challenges and mitigation.

● Established data governance policies, procedures, and standards.

  • Senior Data Engineering Manager

    1 week ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...

  • Senior Data Engineer for AI and Machine Learning

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data Engineer for AI and Machine LearningWe are seeking an experienced Data Scientist & AIML, GenAI Lead/Engineer to join our team in Bangalore, India.About the Role:Develop and implement traditional machine learning algorithms.Deploy at least one model in a production environment.Write and maintain Python code for data science and machine...

  • Senior Time Series Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...

  • Senior AI Data Engineer and Solutions Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking an experienced Senior Data Architect - Cloud Engineer to join our team in Remote India. The successful candidate will play a critical role in supporting and enhancing our Azure Data Lakehouse environment.About the RoleThis is an exciting opportunity to leverage your expertise in designing and implementing efficient data models,...

  • Senior Cloud Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...

  • Senior Power BI Data Engineer Professional

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Power BI Data Engineer to join our team in Bangalore, India. This role will involve developing and implementing data engineering solutions using Power BI reporting tools.About the RoleThis is an exciting opportunity for an experienced data engineer to work with our team and contribute to the development of...

  • Snowflake Data Engineer and Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Senior Engineering Manager

    1 month ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Job Description:This is an excellent opportunity to lead the development of scalable and fault-tolerant platform services at Hevo Data.As a Senior Engineering Manager, you will be responsible for building and managing a team of passionate software engineers who share a sense of ownership and impact.The successful candidate will drive on-time, high-quality...

  • Hevo Data

    1 month ago

    Bengaluru, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • Senior Voice Systems Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a seasoned Senior Voice Systems Engineer to join our team in Bangalore, India.About the RoleThis is a critical position that requires expertise in design, deployment, and support of voice platforms. As a Senior Voice Systems Engineer, you will be responsible for managing business-driven programs and projects across voice products...

  • Senior Cloud Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...

  • Senior data engineer

    3 weeks ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Data Engineering Expert

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience inSQL, Python, Pyspark...

  • Senior data engineer

    3 weeks ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior Analytics Engineer

    3 days ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title:Senior Analytics EngineerAbout the Role:We are seeking a highly skilled Senior Analytics Engineer to join our team at Data Labs - LANDMARK GROUP. As a key member of our engineering team, you will play a crucial role in designing, building, and deploying cutting-edge analytics products for consumption by different stakeholders.The ideal candidate...