Senior Data Engineer

6 hours ago

bangalore district, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You’ll Bring · Bachelor’s degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server)· Experience with NoSQL databases (DynamoDb)Experience with API calls Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India Sonata Software Full time

    The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India USEReady Full time

    Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Senior Data Engineer

    11 hours ago

    bangalore district, India Nityo Infotech Full time

    Senior Data Engineer Position Overview We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site. This role requires a self-starter who can architect and implement robust data foundation layers while providing technical leadership and guidance to the engineering team. The ideal candidate will have deep...

  • Senior Data Engineer

    1 week ago

    bangalore district, India Avathon Full time

    Who We Are & Why Join Us Avathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • Senior DevOps Engineer

    24 hours ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    2 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    4 hours ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    2 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Engineer

    1 week ago

    bangalore district, India Societe Generale Global Solution Centre Full time

    Responsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India ValueLabs Full time

    ValueLabs is a global technology consulting and services company, driven by innovation and excellence. With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries. Our teams are empowered to solve complex challenges, build secure systems, and drive transformation at scale. Join us and be part...