Data Engineer: Cloud Data Architect

2 weeks ago

Bengaluru, Karnataka, India Spigot Software Full time

Role Overview:

The data engineering role at Spigot Software requires designing and developing scalable technical solutions on the modern data stack (Snowflake, dbt, fivetran, Azure). As a key member of our team, you will be responsible for architecting, building, and managing data flows/pipelines and constructing data models within Snowflake to support downstream processes or analysis purposes.

Key Responsibilities:

  • Design, develop, and maintain efficient data pipelines and analytics solutions using DBT, Snowflake, and related technologies
  • Collaborate with stakeholders to gather requirements and translate business needs into technical solutions
  • Develop high-quality code with unit testing and code documentation
  • Evaluate and ensure accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem-solving
  • Optimize and fine-tune data models, SQL queries, and transformations for performance and scalability
  • Ensure effective transformation and load data from diverse sources into a data warehouse or data lake
  • Integrate FiveTran connectors to streamline data ingestion from various sources into Snowflake
  • Develop custom Python scripts and functions to automate data workflows and enhance system capabilities
  • Provide technical expertise and support to resolve data-related issues and troubleshoot system failures
  • Collaborate with the API development team to integrate data pipelines with external systems and applications
  • Contribute to the development of web-based data visualization solutions and dashboards

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Proven experience of at least 5 years as a data engineer, ETL developer, or similar role, with a focus on DBT and Snowflake
  • Strong proficiency in SQL and database concepts, with hands-on experience in Snowflake data warehouse Subject Matter expert of Data warehouse and Data Lake concepts (Dimensional Modelling, change data capture, slowly changing dimensions etc.)
  • Proficiency in programming languages such as Python for data manipulation, automation, and scripting
  • Knowledgeable in relational databases, nonrelational databases, data pipelines (ELT/ETL), and file stores
  • Knowledgeable in performance tuning and optimization
  • Experience with cloud platforms like Azure and tools like Azure OCR for data extraction and processing
  • Familiarity with data integration tools like FiveTran
  • Knowledge of API development principles and experience integrating data pipelines with external systems
  • Proficient in written, verbal, and presentation communication (English)
  • Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities

Estimated Salary Range:$140,000 - $180,000 per year

  • Senior Cloud Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...

  • Senior Cloud Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...

  • Snowflake Data Engineer and Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Senior Data Architect

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking an experienced Senior Data Architect - Cloud Engineer to join our team in Remote India. The successful candidate will play a critical role in supporting and enhancing our Azure Data Lakehouse environment.About the RoleThis is an exciting opportunity to leverage your expertise in designing and implementing efficient data models,...

  • Data Engineering Cloud Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Strategic Data Architect Leader

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly experienced and dynamic Strategic Data Architect Leader to join our Data, Analytics and AI team.Job SummaryThe ideal candidate will have a strong background in Data, Big Data and related technology and management, with a proven track record of leading innovation and architecture initiatives.Key ResponsibilitiesLead the...

  • Cloud Data Engineer for Big Data Solutions

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...

  • Senior AI Data Engineer and Solutions Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...

  • Data Solutions Architect

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    We are currently seeking a highly skilled Data Solutions Architect to join our team in Bangalore, India.About the Role:As a Data Solutions Architect, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Main...

  • Data Engineer for Cloud Migration and Data Pipelining Expert

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....

  • Senior Cloud Architect

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a Senior Cloud Architect to join our team in Bangalore, India. As a key member of our cloud infrastructure team, you will be responsible for designing and implementing secure, scalable, and efficient cloud solutions using Azure.With a strong background in Python development and experience in designing, building, deploying, and...

  • Cloud Data Engineer for Big Data Processing

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...

  • Senior Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleNTT DATA Services is seeking a highly skilled Senior Data Architect to join our team in Bangalore, India.The Ideal CandidateThis is an exceptional opportunity for an experienced data professional to work with cutting-edge technologies and contribute to the design and development of innovative solutions. To be successful in this role, you will...

  • Cloud Data Engineer Advisor Position

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role We are seeking a skilled Cloud Data Engineer Advisor to join our team in Bangalore, India. This is an excellent opportunity for someone who wants to work with cutting-edge technology and contribute to the success of our clients. Responsibilities Collaborate with technical development teams to understand application capabilities and design...

  • ML Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: ML Engineer - Cloud Native ArchitectAbout NTT DATA:We are a leading IT services provider with a strong presence in India. Our expertise spans across various domains, including cloud computing, data analytics, and artificial intelligence.Estimated Salary Range: ₹1,200,000 - ₹2,400,000 per annumJob Description:In this role, you will be...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. As a key member of our team, you will play a crucial role in designing and implementing data pipelines, ensuring high-quality data for business insights.About the RoleThis is an exciting opportunity to work with cutting-edge technology and contribute to the growth...

  • Data Architect Lead for AI and Analytics Solutions

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    OverviewNTT DATA is a global leader in digital and AI infrastructure, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success.SalaryThe estimated annual salary for this position is $150,000 - $200,000 based on industry standards and location.Job DescriptionWe are seeking an...

  • Data Engineer Cloud Migration Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...

  • Lead Data Architect

    2 days ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data ArchitectLocation: Yemalur, BangaloreAt Data Labs - LANDMARK GROUP, we are seeking a skilled Lead Data Architect to spearhead our engineering team in successfully designing and deploying cutting-edge analytics products.Main Responsibilities:Lead the architecture, design, and delivery of enterprise-grade microservices.Partner with Product...