Data Pipeline Specialist

2 weeks ago

Guntur, Andhra Pradesh, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Description

As a skilled and motivated Database Professional, you will play a vital role in designing, implementing, and optimizing data pipelines and storage solutions using SQL and NoSQL databases. You will be responsible for managing relational databases and NoSQL platforms, building scalable, distributed, and highly available database systems for real-time and batch workloads.

Key responsibilities include:

  • Design, implement, and optimize data pipelines and storage solutions.
  • Manage relational databases (PostgreSQL, MySQL) and NoSQL platforms (Cassandra, ScyllaDB, MongoDB, BigQuery).
  • Build scalable, distributed, and highly available database systems.

You will work with Continuous Integration/Continuous Deployment (CI/CD) pipelines to automate database deployments, migrations, and monitoring. Additionally, you will collaborate with data scientists, analysts, and engineers to ensure efficient access to data.

The ideal candidate will have a strong understanding of query optimization, schema modeling, and indexing strategies. You will also be responsible for ensuring data quality, consistency, backup, recovery, and security across platforms.

Hands-on experience with cloud providers (AWS, GCP, Azure) is required. Proficiency in programming languages such as Python, Bash, or similar for automation is also necessary.

Required Skills & Qualifications
  • Strong expertise in PostgreSQL and MySQL database design and optimization.
  • Hands-on experience with NoSQL databases: ScyllaDB, Cassandra, MongoDB, BigQuery.
  • Solid understanding of distributed systems, replication, sharding, and partitioning.
  • Familiarity with CI/CD pipelines.
  • Hands-on experience with cloud providers: AWS, GCP, Azure.
  • Strong knowledge of query optimization, schema modeling, and indexing.
  • Good scripting skills in Python, Bash, or similar for automation.
Benefits
  • Work on innovative projects with a team of professionals.
  • Continuous learning opportunities and professional growth.
  • Flexible work environment with a supportive culture.
  • Comprehensive benefits package.
  • Free healthcare coverage.

  • Data Pipeline Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeCloudDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to design and implement scalable, reliable, and secure data pipelines on Google Cloud Platform (GCP). The ideal candidate will have in-depth experience with GCS, BigQuery, IAM, and Cloud Functions.The successful candidate will develop robust ETL/ELT processes using Python and...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 13,08,000 - ₹ 26,12,000

    Job SummaryWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain large-scale data pipelines using various tools in the Google Cloud Ecosystem.Key ResponsibilitiesDevelop complex datasets based on business requirements.Construct big data pipeline architecture.Identify opportunities for data...

  • Scalable Data Pipeline Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Position OverviewThis role is centered around designing, developing, and implementing scalable data pipelines to drive business growth. The ideal candidate will be responsible for spearheading data engineering efforts, ensuring seamless integration with analytics and business teams.

  • Data Pipeline Operations Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeElasticsearch Full time ₹ 1,48,27,100 - ₹ 2,54,45,400

    Job Summary:About this role:Evaluate the performance of our Elasticsearch and Splunk clusters to identify developing problems, plan changes for upcoming high-load events, apply security fixes, test and perform incremental upgrades, and extend and improve our monitoring and alert infrastructure.Responsibilities Include:Maintaining other parts of the data...

  • AI Pipelines Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeExpertise Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job Title: AI ExpertMatrimony.com is seeking an experienced Artificial Intelligence Specialist to design and implement NLP pipelines, fine-tune open-source LLMs, and integrate LLMs into real-time products.Key Responsibilities:Design NLP pipelines for classification, named entity recognition, summarization, sentiment analysis, and question-answering...

  • Chief Data Pipeline Architect

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior AWS Data EngineerWe seek experts in building scalable data pipelines using Spark, PySpark, SQL, and Python.Design and develop robust ETL/ELT pipelines on AWS utilizing Spark and PySparkOngoing optimization of large-scale data processing workflows for performance and reliabilityCollaboration with AWS services such as Glue, EMR, S3, Lambda, and...

  • Data Integration Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Integration SpecialistWe are seeking an experienced Data Integration Specialist to join our team.The ideal candidate will have a strong background in designing, developing, and maintaining ETL processes to integrate data from various sources.This role requires hands-on experience with ETL tools, data modeling, and ensuring data quality. The...

  • ETL Test Engineer

    1 week ago

    Guntur, Andhra Pradesh, India beBeeETL Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a skilled ETL Test Engineer to join our project in Bangalore. The ideal candidate will have 6-15 years of experience working with complex data pipelines and enterprise-grade data systems.Key Responsibilities:Perform ETL testing across multiple data pipelines.Develop and execute advanced SQL queries for data validation and reconciliation.Create...

  • Data Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data SpecialistTransform your career by joining a dynamic team at the forefront of Generative AI, Machine Learning, and personal finance. As a Data Specialist, you will collaborate with cross-functional teams to drive business growth through data-driven decision-making. Key responsibilities include designing, building, and deploying machine learning and...

  • Data Integration Specialist

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Integration SpecialistAbout This RoleThis is a unique opportunity to join our organization as a Data Integration Specialist, where you will play a key role in ensuring data integrity, model correctness, performance and usability across pipelines, semantic models and reports spanning multiple platforms.We are seeking an experienced...