Data Pipeline Architect

2 weeks ago

Nagpur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

Big Data Specialist

As a Snowflake Big Data Specialist, you will be designing and developing data pipelines, models, and transformations using Snowflake's scalable cloud-based platform. You will work on building ETL/ELT pipelines, optimizing micro-partitioning, implementing real-time ingestion, and integrating data lakes.

  • Develop complex SQL queries with window functions, CTEs, and pivots to analyze large datasets.
  • Implement Snowpipe for real-time data ingestion and external tables for data lake integration.
  • Design data models with clustering keys and optimize warehouse sizing for cost control.
  • Manage multi-cluster warehouses and implement resource monitors for efficient query optimization.
  • Develop JavaScript/SQL stored procedures and UDFs for complex transformations.

Key Requirements:

  • Hands-on experience in Snowflake development.
  • Strong knowledge of Snowflake SQL, JavaScript stored procedures, and dbt core concepts.
  • Experience with Tasks, Streams, Stages, File Formats, Time Travel, RBAC, data types, and semi-structured data.
  • Familiarity with SnowSQL CLI and Snowflake web interface.

  • Chief Data Pipeline Architect

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Role Overview:We are seeking a highly skilled Data Engineer with expertise in designing, developing, and maintaining large-scale data pipelines and infrastructure.Your key responsibilities will include architecting and implementing data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation, and movement of data.You will...

  • Senior Data Architect Role

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Architect Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Architecture PositionWe are seeking a skilled data architect to design and implement data architectures that support business growth. This individual will work with cross-functional teams to build reliable datasets.

  • Senior Data Pipeline Architect

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Pipeline ArchitectWe are seeking an experienced data professional to lead the design and development of our scalable data pipelines using GCP tools.10+ years of experience in designing, developing, and maintaining complex data pipelines for both batch and real-time processing.Strong understanding of GCP services including Big Query, Cloud...

  • Data Pipeline Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    AWS Data Architect PositionWe are seeking a highly skilled Senior AWS Data Engineer to join our team. The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:Data Engineering Pipeline DevelopmentOptimizing...

  • Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 14,00,000

    Key Data Engineering PositionWe are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience working with large datasets and be proficient in designing and implementing data pipelines.Responsibilities:Design and implement scalable data pipelines using AWS services such as S3, Glue, and Redshift.Develop and maintain data...

  • Big Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerJob Description:We are seeking a highly skilled Senior Data Engineer to develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data.The ideal candidate will have experience in building large and complex datasets based on business requirements, as well as constructing 'big data'...

  • Chief Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeDataEngineering Full time US$ 1,00,000 - US$ 1,50,000

    Job Title: Data EngineerThe role of a Data Engineer involves the design, development, and maintenance of large-scale data processing systems.As a Data Engineer, you will be responsible for migrating ETL pipelines from legacy systems to modern platforms like Snowflake and Nexla. This includes designing and implementing efficient ETL pipelines using Python,...

  • Data Pipeline Architect

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDatastage Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL Developer OpportunityWe are seeking an experienced senior DataStage developer with expertise in ETL development, data warehousing concepts, and Teradata SQL skills to design, build, and optimize data pipelines using IBM DataStage. This is a great opportunity for a skilled professional to join our team and contribute to the success of our...

  • Cloud Data Pipeline Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineer OpportunityWe are seeking an experienced Data Engineer to join our team. About the Role The successful candidate will be responsible for designing, developing, and maintaining data pipelines and ETL processes using AWS services. They will work with SQL databases for data modeling, queries, and performance optimization, as well as implement and...

  • Chief Data Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Unlocking Data ExcellenceCoforge is seeking a highly skilled Data Architect to spearhead the development and refinement of intricate ETL pipelines for processing high data volumes.The ideal candidate will possess expertise in crafting robust data pipelines, ensuring data precision, coherence, and system performance. They will collaborate with...