Data Infrastructure Specialist

2 days ago

Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking a skilled Data Infrastructure Specialist to join our team. The successful candidate will be responsible for designing and implementing scalable data pipelines to ingest data from diverse sources, developing data transformation and enrichment processes, troubleshooting and resolving issues related to data quality, latency, or performance, providing technical support and guidance on data-related issues or projects, leveraging cloud-based solutions and frameworks to streamline processes and enhance automation, maintaining and optimizing existing workflows, documenting pipeline architecture, data workflows, and processes, following industry best practices for version control, security, and data governance, staying current with industry trends, tools, and technologies in data engineering and marketing analytics, and recommending and implementing innovative solutions to improve the scalability and efficiency of data systems.

Key Responsibilities
  • Design and implement scalable ETL/ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
  • Develop data transformation and enrichment processes to support analytics and reporting needs.
  • Troubleshoot and resolve issues related to data quality, latency, or performance.
  • Provide technical support and guidance on data-related issues or projects.
  • Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
  • Maintain and optimize existing workflows while continuously identifying opportunities for improvement.
  • Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
Requirements
  • Bachelor of Science degree in Computer Science or equivalent.
  • At least 3+ years of experience as a data engineer developing and maintaining data pipelines.
  • Strong experience with databases and data platforms (AWS preferred).
  • Proficiency in Python, SQL, PySpark.
  • Experience in Data Quality, Data Modeling, Data Analytics/BI, Data Enrichment.
  • Understanding of concepts such as normalization, SCD (Slowly changing dimensions), and CDC (Change data capture).
  • Experience in working on streaming event platforms such as Kafka/Kinesis.
  • Knowledge of non-relational databases.
  • Preferable experience in DBT for data transformation and modeling.
  • Good understanding of data warehouses, ETL/ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.).
  • Understanding of orchestration tools such as Airflow.
  • Ability to create clean, well-designed code and systems.
  • Strong attention to detail and a commitment to data accuracy.
  • Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
  • Ability to work collaboratively in a team environment.
What We Offer
  • Opportunity to work with a global team and contribute to the development of innovative solutions.
  • Chance to learn new technologies and skills and stay current with industry trends.
  • Collaborative and dynamic work environment.

  • Data Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 5,00,000 - ₹ 8,00,000

    Job Title: Data Infrastructure Specialist">As a Data Infrastructure Specialist, you will play a critical role in ensuring the reliability and scalability of our data systems. Your responsibilities will include:Technical Support: Provide expert-level technical support for data-related issues, including troubleshooting, performance optimization, and hardware...

  • Data Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Profile:A Data Infrastructure Specialist plays a pivotal role in ensuring seamless database operations.Responsibilities encompass database administration, maintenance, and optimization of databases.

  • Data Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled professional to fill the role of Data Infrastructure Specialist.Job DescriptionThe ideal candidate will have expertise in designing and developing scalable data pipelines, leveraging Hadoop ecosystem tools to build, maintain, and optimize large-scale data pipelines. They will work closely with cross-functional teams to deliver...

  • Data Infrastructure Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeStorage Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Title: Data Infrastructure SpecialistWe specialize in delivering enterprise-grade technology solutions with over a decade of experience.The ideal candidate will provide exceptional technical support for data storage, ensuring optimal performance and client satisfaction.Key Responsibilities:Deliver hands-on support and troubleshooting for data storage...

  • Lead Data Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Infrastructure SpecialistWe are seeking an experienced Lead Data Infrastructure Specialist to spearhead the design and implementation of our PostgreSQL-based data warehouse and data lake on AWS infrastructure.The ideal candidate possesses expertise in SQL engineering, cloud data architectures, and modern data pipelines with hands-on experience in...

  • Data Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 16,00,000 - ₹ 20,00,000

    Job Title: Data Infrastructure SpecialistAs a seasoned data infrastructure specialist, you will play a pivotal role in developing and implementing robust ETL/ELT processes that ingests, transform and integrate data from multiple sources into our enterprise data platform.Key Responsibilities:Design and build scalable and secure data pipelines utilizing AWS...

  • Data Infrastructure Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a highly skilled Data Infrastructure Specialist to help us scale and enhance our internal data observability and analytics platform. This platform integrates with data annotation tools and machine learning pipelines to provide visibility, insights, and automation across large-scale data operations.This role involves designing and building...

  • Data Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeMachineLearning Full time ₹ 1,80,00,000 - ₹ 2,30,00,000

    Job DescriptionWe are seeking a seasoned Data Infrastructure Specialist to join our team.This role is pivotal in building and maintaining scalable machine learning infrastructure for enterprise-grade applications. The ideal candidate will have a strong background in MLOps practices, distributed data systems, and big data workflows.Distributed Data Processing...

  • Data Infrastructure Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time US$ 90,000 - US$ 1,20,000

    Job OverviewWe are seeking a highly skilled Data Infrastructure Specialist to administer and troubleshoot enterprise backup systems and SAN storage arrays. This role requires strong technical expertise and excellent problem-solving skills.Key ResponsibilitiesEnterprise Backup Systems Administration: Manage and maintain enterprise backup systems, ensuring...

  • Data Infrastructure Specialist

    21 hours ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 4,50,000 - ₹ 6,50,000

    Key Role: Data Infrastructure Specialist">We are looking for a skilled professional to design, develop and manage scalable data pipelines and infrastructure. This individual will work with a talented team in a product-based environment, solving real-world data challenges and enabling data-driven decision-making across the organization.Key...