Data Engineer

4 days ago

Bangalore, Karnataka, India Taggd Full time

Job Description title : Data Engineer


Role Type : Individual contributor

Purpose of role :

Design, build, and maintain the data infrastructure and systems that support SKF VA data needs. By leveraging their skills in data modeling, data integration, data processing, data storage, data retrieval, and performance optimization, this role can help VA manage and utilize their data more effectively.

Candidate Profile :

1. Bachelor's Degree in computer science, Information technology or a related field.

2. Experience - 5 to 8 Years

3. Azure & Snowflake is mandatory

Responsibilities :

- Build an VA data warehouse which is scalable, secured, and compliant using snowflake technologies. This would include designing and developing Snowflake data models

- Work with Central data warehouse like SDW, MDW, OIDW to extract data and enrich with VA specific customer grouping, program details etc.

- Data integration: Responsible for integrating data from ERP's, BPC and other systems into Snowflake, SKF standard DW's ensuring that data is accurate, complete, and consistent.

- Performance optimization : Responsible for optimizing the performance of Snowflake queries and data loading processes. Involves optimizing SQL queries, creating indexes, and tuning data loading processes.

- Security and access management : Responsible for managing the security and access controls of the Snowflake environment. This includes configuring user roles and permissions, managing encryption keys, and monitoring access logs.

- Maintain existing databases, warehouse solutions addressing support needs, enhancements Troubleshooting etc.

Metrics :

1. Technical metrics : Data quality for whole of VA BU, data processing time, data storage capacity and systems availability

2. Business metrics : data driven decision making, data security and compliance, cross functional collaboration.

Competencies :

1. Should have a good understanding of data modeling concepts and should be familiar with Snowflake's data modeling tools and techniques.

2. Specialized in native data applications development, with a proven track record of expertise in Snowflake, Snowpark Packages, Streamlit and more.

3. Experienced in creating streamlined and efficient data applications, leveraging the capabilities of modern, open-source packages for user interface development and Snowflake for seamless data integration.

4. SQL: Should be expert in SQL. Should be able to write complex SQL queries and understand how to optimize SQL performance in Snowflake.

5. ETL/ELT: Should be familiar with Snowflake's ETL/ELT tools and techniques.

6. Should have a good understanding of cloud computing concepts and be familiar with the cloud infrastructure on which Snowflake operates.

7. Good understanding of data warehousing concepts and be familiar with Snowflake's data warehousing tools and techniques

8. Familiar with data governance and security concepts

9. Able to identify and troubleshoot issues with Snowflake and SKF's data infrastructure

10. Experience with Agile solution development

Good to have :


Knowledge on SKF ERP systems (XA, SAP, PIM etc.), data related sales, supply chain data, (ref:hirist.tech)

  • Aptus Data Labs

    1 month ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    9 hours ago

    Bangalore, Karnataka, India Addwiser Full time

    Job Title : Data EngineerLocation : Bangalore, Digital Transformation - R&DJob Description :We are seeking experienced, motivated, and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of ongoing and new initiatives for our company and contribute to our mission of delivering...

  • Data Engineer

    3 days ago

    Bangalore, Karnataka, India Huquo Full time

    Data Engineer will be responsible for designing, developing, and maintaining data pipelines . This role requires expertise in data engineering best practices, big data technologies. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure the availability, reliability, and efficiency of data systems, enabling...

  • Staff Engineer

    4 weeks ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Staff Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Kafka Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Smartgig Technologies Private Limited Full time

    Data Engineer (6+ Years Experience)Location : Bangalore, HybridAvailability : Immediate to 15 DaysAbout the Role :We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    3 days ago

    Bangalore, Karnataka, India Talpro Full time

    Job Description :Experience : 5 -7 years ( experience in either Java or Python or Both)Big Data exp : 2-5 Years - (Hadoop, snowflake, or Kafka)Education Background : Degree in Computer ScienceDomain : Financial Service or Pharma backgroundBudget : Maximum up to 28 LPAJob Description :This is an exciting opportunity for an experienced Data Engineer. You will...

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...