(15h Left) Senior Data Engineer

4 weeks ago

Bengaluru, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You'll Bring · Bachelor's degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server) · Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • ▷ (15h Left) Data Engineer

    3 weeks ago

    Bengaluru, India Sourcebae Full time

    🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀 Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Avathon Full time

    Who We Are & Why Join Us Avathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • [15h Left] Senior Data Engineer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS! Job Title: Senior Data Engineer in a BIGDATA environment Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda) Location: Kolkata Experience Range: 8+ years Job Description CONTEXT B2C Data Platform is the ENGIE B2C data platform that enables all data-producing domains to make raw or reworked data...

  • Senior leader – data architecture

    2 days ago

    Bengaluru, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...

  • Senior Leader – Data Architecture

    3 days ago

    Bengaluru, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization. *Key Requirements* 1. Deep Technical Expertise in Large-Scale...

  • Senior Leader – Data Architecture

    3 days ago

    Bengaluru, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...

  • ▷ [15h Left] Senior Lead Data Engineer

    2 weeks ago

    Bengaluru, India GSK Full time

    Job Description Site Name: Bengaluru Luxor North Tower Posted Date: Nov 3 2025 Role Overview: The Senior Lead Data Engineer will operate within a matrixed product team design, holding responsibility for the technical solution design, implementation, and ongoing enhancement of products and systems developed by Medical Digital and Tech. In alignment with Agile...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • ▷ [15h Left] Cloud Engineer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before the interview. To create an EP...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Mastek Full time

    Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...