Senior data engineer

3 weeks ago

Bengaluru, India Sonata Software Full time

Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, Dynamo DB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and No SQL databases. * Experience with CI/CD pipeline to release the code in different environmentNice to have* AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms* Snowpipe - to move data from S3 bucket to SnowflakeJob Description A Typical DayThe Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will:· Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc.· Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data· Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers.· Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues.· Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You’ll Bring· Bachelor’s degree or equivalent work experience· 5+ years of relevant work experience· Knowledge of Agile Methodologies, such as Scrum is helpful· Experience with relational databases (Snowflake, SQL Server)· Experience with No SQL databases (Dynamo Db). Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake.· Knowledge of design patterns, refactoring and unit testing· Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • Senior Data Engineer cum Data Scientist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Senior Data Scientist

    1 week ago

    Bengaluru, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    4 days ago

    Bengaluru, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    1 week ago

    Bengaluru, India IC Data Full time

    Senior Data Scientist (Remote Sensing) About the job Sagri Inc. is a pioneering social impact startup founded in 2018 with the vision of "realizing the coexistence of humanity and the earth." We utilize satellite data and AI technology to address global food crises and climate change challenges. Our core products - Actaba, Detaba, and Sagri - offer...

  • Senior Data Scientist

    3 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    2 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior AI Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,20,000 - US$ 1,80,000 per year

    Req ID: 345129NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior AI Engineer - Senior Specialist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior AI...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Senior Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Anicca Data Science Solutions Full time ₹ 1,20,000 - ₹ 3,60,000 per year

    Job Description – Senior Data ScientistLocation:Bengaluru (Full-time, Onsite)About Anicca DataAnicca Data is a leading team of Data Science and Technology experts specializing in:Personalization, Recommendation Engines, and Product Search RankingLoyalty Programs and Customer AnalyticsSupply Chain Optimization (Demand Forecasting, Inventory, Replenishment &...