Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Spigot Software Full time

Data Engineering Role Overview

The Spigot Software data engineering role requires designing, developing, and maintaining technical solutions on the modern data stack (Snowflake, dbt, Fivetran, Azure). This involves architecting, building, and managing data flows/pipelines and constructing data models within Snowflake for downstream processes or analysis purposes.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and analytics solutions using DBT, Snowflake, and related technologies.
  • Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
  • Develop efficient code with unit testing and code documentation.
  • Ensure accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem-solving.
  • Optimize and fine-tune data models, SQL queries, and transformations for performance and scalability.
  • Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake.
  • Ensure the effective transformation and load of data from diverse sources into a data warehouse or data lake.
  • Integrate Fivetran connectors to streamline data ingestion from various sources into Snowflake.
  • Develop custom Python scripts and functions to automate data workflows and enhance system capabilities.
  • Provide technical expertise and support to resolve data-related issues and troubleshoot system failures.
  • Collaborate with the API development team to integrate data pipelines with external systems and applications.
  • Contribute to the development of web-based data visualization solutions and dashboards.
  • Communicate with all project stakeholders on project status.
  • Manage, monitor, and ensure the security and privacy of data to satisfy business needs.
  • Contribute to the automation of modules, wherever required.
  • Stay updated on emerging trends and technologies in data engineering, cloud computing, and analytics domains.

Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience of at least 5 years as a data engineer, ETL developer, or similar role, with a focus on DBT and Snowflake.
  • Strong proficiency in SQL and database concepts, with hands-on experience in Snowflake data warehouse.
  • Subject matter expert of Data warehouse and Data Lake concepts (Dimensional Modeling, change data capture, slowly changing dimensions, etc.).
  • Proficiency in programming languages such as Python for data manipulation, automation, and scripting.
  • Knowledgeable in relational databases, non-relational databases, data pipelines (ELT/ETL), and file stores.
  • Knowledgeable in performance tuning and optimization.
  • Experience with cloud platforms like Azure and tools like Azure OCR for data extraction and processing.
  • Familiarity with data integration tools like Fivetran.
  • Knowledge of API development principles and experience integrating data pipelines with external systems.
  • Proficient in written, verbal, and presentation communication (English).
  • Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities.
  • Excellent analytical, problem-solving, and communication skills.

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Visualization Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...

  • Data Engineering Expert

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 301470NTT DATA is seeking a skilled Data Engineer to partner with stakeholders across business units to develop analyses and documentation in a collaborative way.The ideal candidate will have three or more years of experience with Python, SQL, and data visualization/exploration tools, as well as familiarity with the AWS ecosystem.About...

  • Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Data Systems Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionKey Skills and Qualifications:Cloud Platforms: Proficient in AWS.Programming Languages: Expert in SQL and Python.ETL Tools: Experience with ETL tools and frameworks.Requirements:Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Skills:Proven experience in using Snowflake for data...

  • Senior Data Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Data Engineering Cloud Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Data Engineer Lead

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Power BI Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Data Engineer for Power BI Development to join our team in India.The ideal candidate will have extensive experience with Power BI reporting development, a solid understanding of relational and distributed database systems, and strong analytical skills.Key Responsibilities:Develop and implement Power BI...

  • Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the JobThis position requires a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using Databricks on AWS. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Key ResponsibilitiesDesign, build, and maintain...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services.About the Role:The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing automated data pipelines, analyzing complex datasets, and providing actionable insights.Key Responsibilities:Develop and maintain...

  • Data Engineering Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Data Engineering Specialist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...

  • Cloud Data Engineer for Big Data Solutions

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Data Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:As a Data Engineer at NTT DATA, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure data factory and Azure databricks. You will work closely with cross-functional teams to ensure data quality, integrity, and security.Key Responsibilities:Design and implement data...

  • Senior Data Engineering Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...