Senior Data Engineer

3 weeks ago

Bangalore Division, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You’ll Bring · Bachelor’s degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server)· Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Leader – Data Architecture

    6 days ago

    bangalore, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...

  • Senior Data Engineer

    2 weeks ago

    Bangalore Division, India Elements HR Services Pvt Ltd Full time

    Senior Data Engineer Title Senior Data Engineer Department ISS Location Bengaluru Reports To Data Engineers – Lead Level 4,5,6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business...

  • Senior Data Engineer

    1 week ago

    Bangalore Division, India Veraxion Full time

    We’re Hiring: Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...

  • Senior Data Engineer

    3 days ago

    Bangalore Division, India Themesoft Inc. Full time

    Greetings from Themesoft! We are looking for a highly skilled Senior Data Engineer with strong experience in building scalable, high-performance data pipelines and modern data architectures. Position: Senior Data Engineer Experience: 10–12 Years (Less than 10 years will not be approved by client) Position Type: Contract Location: PAN India, Work Mode:...

  • Senior Data Engineer

    2 weeks ago

    Bangalore Division, India Cloudwick Full time

    About the role We are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to...

  • Senior Data Engineer

    6 days ago

    Bangalore Division, India Quantiphi Full time

    Job Title: Senior Data Engineer (Power BI) Experience: 4 to 6 Years Location: Bangalore/ Mumbai / Hybrid Job Summary: We are seeking a skilled and proactive Power BI Developer to join our team. The ideal candidate will be responsible for designing, developing, and publishing interactive dashboards and reports using Power BI Cloud , while leading the...

  • Senior Data Engineer(Big Data)

    2 weeks ago

    Bangalore Division, India Andor Tech Full time

    Andor Tech is looking for a highly skilled Senior Big Data Engineer with 8–15 years of experience to join our dynamic team. If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you! 📍 Location : Deployment to a Product-Based Retail MNC 📅 Immediate Joiners Preferred 🔧 Key Skills Required :...

  • Senior DevOps Engineer

    3 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    6 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    4 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...