Data Engineering Specialist

4 days ago

Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Data Engineering Specialist

Job Description:

In this role, you will be responsible for designing, developing, and maintaining large-scale data pipelines using the Google Cloud Platform. You will work closely with stakeholders to understand business requirements and develop solutions that meet their needs.

Key Responsibilities:

  • Develop data acquisition pipelines for structured and unstructured data
  • Create complex datasets based on business requirements
  • Construct big data pipeline architecture
  • Identify opportunities for data acquisition and translation of business needs to technical requirements
  • Leverage tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage
  • Use logs and alerts to effectively monitor pipelines
  • Replicate SAP tables to Google Cloud using SLT
  • Develop JSON messaging structure for integrating with various applications
  • Implement DevOps practices and CI/CD processes to ensure reliability and scalability of data pipelines
  • Safeguard data using IAM roles and Policy Tags
  • Ensure secure access to datasets and authorized views to share data between projects
  • Design ingestion pipelines using Rest API and improve data quality, reliability, and efficiency

Requirements:

This role requires 5-7 years of experience in a data engineering role with core GCP experience of 3-4 years.

Bonus Points:

  • Familiarity with cloud-based systems and technologies
  • Experience with data warehousing and business intelligence
  • Strong understanding of data structures, algorithms, and software design patterns
  • Ability to work independently and collaboratively as part of a team

  • Data Engineering Specialist

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Software Engineer - Data Engineering SpecialistJob Description:We are seeking a highly skilled and innovative Software Engineer to join our team as a Data Engineering Specialist. In this role, you will be responsible for designing and developing new features and enhancements for our core platforms and services.The ideal candidate will have strong hands-on...

  • Data Engineering Specialist

    4 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineering SpecialistDesign, build and maintain robust data pipelines for processing channel activity data from multiple sources.As a key player in our digital solutions team, you will focus on integrating and processing data from various channels, including Hadoop and Terradata environments. Your expertise in cloud technologies,...

  • Data Engineer

    6 days ago

    Alleppey, Kerala, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Migration SpecialistWe are seeking a skilled professional with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Lead large-scale...

  • Data Engineering Specialist

    1 week ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,81,20,000 - ₹ 2,01,60,000

    Are you looking for a challenging role in data engineering?We are seeking a skilled data engineer to join our team.About the Role:Create data pipelines to collect, process and analyze data from various sources.Develop expertise in AWS Cloud services including Lambda, DMS and Glue.Familiarity with data warehousing concepts using Snowflake.Implement complex...

  • Cloud Data Specialist

    1 week ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe are seeking a highly skilled and experienced Cloud Data Specialist to design and develop scalable data processing workflows using Azure Cloud technologies, Python, Scala, Spark (PySpark & Scala Spark), and data management principles.Key Responsibilities:Design and Develop Efficient ETL Pipelines: Create optimized ETL...

  • Senior Data Foundation Specialist

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Title: Senior Data Foundation SpecialistWe are seeking an experienced Data Engineer to lead the design and development of our data foundations and end-to-end solutions. This role will be instrumental in driving business value from data, fostering a data-driven culture across the organization, and developing strategic partnerships with key...

  • Data Engineering Specialist

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Position OverviewThis role focuses on designing and implementing large-scale data processing systems to drive business growth through data-driven insights.

  • Data Engineering Specialist

    9 hours ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadJob Description:We're looking for an experienced professional to develop, refine and maintain intricate data processing pipelines.To succeed in this role, you will need to ensure the accuracy, consistency and efficiency of our data systems.As a collaborative team player, you will work closely with architects, analysts and...

  • Data Architect Specialist

    2 days ago

    Alleppey, Kerala, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect Specialist Overview: We are seeking an experienced Data Architect Specialist to lead the design and implementation of our data architecture. The ideal candidate will have a strong background in PostgreSQL, with expertise in advanced query writing, CTEs, window functions, indexing, and optimization. They will also possess...

  • Data Innovations Specialist

    2 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data EngineerWe are seeking an experienced and innovative data specialist with a strong background in Generative AI GenAI and complementary expertise in Computer Vision and Predictive Modeling.About the Role:Lead and contribute to applied research in Generative AI including LLMs VisionLanguage Models VLMs Multimodal AI and Prompt...