Senior Data Engineer

16 hours ago

Bangalore, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You’ll Bring · Bachelor’s degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server) · Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Data Engineer

    2 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Senior Data Engineer

    2 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India HireAlpha Full time

    Senior Data Engineer (Informatica Platform Engineer / Administrator) – Bangalore We’re looking for a Senior Data Engineer with strong expertise in Informatica platform administration to join our Group IT Data Engineering team.This role is ideal for professionals who enjoy building and maintaining enterprise-grade data platforms that power large-scale...

  • Senior Data Scientist

    2 weeks ago

    Bangalore, Karnataka, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team In this role you will be responsible for driving data science initiatives developing predictive models and providing insights that guide key business decisions The ideal candidate has a strong background in statistical analysis machine...

  • Senior Data Engineer

    6 days ago

    bangalore, India 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    18 hours ago

    bangalore, India PASO Co Full time

    Job description We’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-Time About the Role One of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India PASO Co Full time

    Job descriptionWe’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-TimeAbout the RoleOne of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Sonata Software Full time

    The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...