Data Infrastructure Expert

5 days ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Description

We are seeking a seasoned Senior Data Architect to spearhead the design, development, and optimization of our modern data infrastructure. This role will be pivotal in evolving our data platform, encompassing database migrations, scalable data pipelines, and governance-ready architectures for both analytical and operational use cases.

The ideal candidate will have a deep understanding of trade-offs between managed services and open-source data stack tools, including cost, scalability, operational overhead, flexibility, and vendor lock-in. Strong hands-on experience with PySpark for writing data pipelines and distributed data processing is also required.

This is an exciting opportunity for a technical leader who can guide the development of complex ETL/ELT pipelines using PySpark and Apache Airflow. The successful candidate will be responsible for designing and implementing scalable and reliable data architectures for real-time and batch processing systems.

Required Skills and Qualifications
  • 10+ years of experience in data architecture, data engineering, data security, data governance, and big data platforms
  • Deep expertise in big data platforms, data lakes, lakehouse architectures, and hands-on experience with modern tools such as Spark clusters, PySpark, Apache Iceberg, the Nessie catalog, and Apache Airflow
  • Strong proficiency in SQL, data modeling, and performance tuning
  • Ability to perform deep data analysis and compare datasets between systems
  • Experience handling 100s of terabytes of data or more
Benefits

The ideal candidate will have a proven track record of success in leading database migration projects across multiple cloud providers. They will be able to perform deep data analysis and compare datasets between systems, and have experience handling large datasets.

This role offers a unique opportunity for a technical expert to lead the development of our data infrastructure and play a key part in shaping the future of our organization.

Others

The successful candidate will be able to communicate effectively with cross-functional teams and present complex technical concepts in a clear and concise manner. They will also be able to stay up-to-date with industry trends and emerging technologies, and make recommendations for future improvements to our data infrastructure.

  • Data Infrastructure Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeCloudera Full time

    About the RoleWe are seeking a seasoned Big Data Expert to join our team. As a Cloudera Cluster Manager, you will be responsible for building, maintaining and optimizing our big data infrastructure.

  • Infrastructure Expert

    3 days ago

    Bengaluru, Karnataka, India beBeeSystem Full time ₹ 15,00,000 - ₹ 22,50,000

    Infrastructure Expert RoleAs a project-based subject matter expert in IT infrastructure, you will analyze complex technical issues, develop effective solutions, and test systems to ensure optimal performance.Key Responsibilities:Conduct thorough analysis of technical problems and provide timely solutions.Contribute to ongoing projects and participate in...

  • Cloud Infrastructure Expert

    2 weeks ago

    Bengaluru, Karnataka, India beBeeReliability Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Infrastructure ExpertWe are seeking a highly skilled Cloud Infrastructure Expert to improve the reliability and operational efficiency of our systems.Key Responsibilities:Cloud Engineering:Design, build, and manage secure, scalable, and cost-efficient cloud infrastructure.Automate infrastructure provisioning using Terraform / CloudFormation...

  • IT Infrastructure Expert

    1 week ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time US$ 60,000 - US$ 80,000

    Job Title: IT Infrastructure ExpertAbout the Role:We are seeking an experienced professional to manage and maintain our company's IT infrastructure. The ideal candidate will have a strong background in operating systems, server hardware, and automation.Responsibilities:Design, implement, and maintain a stable and secure IT infrastructure.Plan, configure, and...

  • Data Consultant

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 50,000 - US$ 1,00,000 per year

    Req ID: 337043NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Consultant to join our team in bangalore, Karnātaka (IN-KA), India (IN). 3+ Years of hands-on Data Analysis...

  • Data Infrastructure Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About This RoleWe're looking for an expert in large-scale data processing to join our research team. Data engineering is a crucial component of successful model training and evaluation. You'll work closely with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data...

  • Data Infrastructure Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 5,00,000 - ₹ 8,00,000

    Job Title: Data Infrastructure Specialist">As a Data Infrastructure Specialist, you will play a critical role in ensuring the reliability and scalability of our data systems. Your responsibilities will include:Technical Support: Provide expert-level technical support for data-related issues, including troubleshooting, performance optimization, and hardware...

  • Linux Infrastructure Expert

    1 week ago

    Bengaluru, Karnataka, India beBeeLinuxSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Linux expert to lead our team.The ideal candidate will have extensive experience in Linux infrastructure setup, Shell Scripting, and containerization.Responsibilities:Infrastructure Setup: Design and implement efficient Linux infrastructure solutions.Shell Scripting: Develop robust Shell scripts for automation and data...

  • Data Platform Operations Expert

    7 days ago

    Bengaluru, Karnataka, India beBeeDatabase Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Platform Operations ExpertWe are seeking a skilled data platform operations expert to deliver high-performance data infrastructure solutions.

  • Cloud Infrastructure Expert

    2 days ago

    Bengaluru, Karnataka, India beBeeExpert Full time

    Job Title: Cloud Infrastructure ExpertWe are seeking a highly skilled Cloud Infrastructure Expert to join our team.Job Description:Develop and implement automation strategies for cloud infrastructure deployment and management.Design, develop, troubleshoot, and debug Linux servers for environment stability.Collaborate with cross-functional teams to identify...