Large-Scale Data Infrastructure Specialist

2 days ago


Pune, Maharashtra, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title:

Lead Data Infrastructure Specialist

About the Role:

We are seeking a highly skilled and experienced Lead Data Infrastructure Specialist to join our team. As a key member of our data architecture team, you will play a pivotal role in designing and implementing large-scale data infrastructure solutions.

Key Responsibilities:
  • Design and implement robust data pipelines using ETL processes, ensuring high performance and advising necessary infrastructure changes.
  • Translate complex technical and functional requirements into detailed designs, considering scalability, reliability, and maintainability.
  • Serve as a mentor to junior staff, conducting technical training sessions and reviewing project outputs to ensure quality and consistency.
Requirements:
  • Strong understanding of data warehousing and data modeling techniques, including distributed computing principles.
  • Proficient understanding of cloud platforms, including GCP, Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, and Big Query.
  • Experience with building stream-processing systems using solutions like Storm or Spark-Streaming.
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
  • Experience with Spark, SQL, and Linux.
  • Knowledge of various ETL techniques and frameworks, including Flume, Apache NiFi, or DBT.
  • Experience with messaging systems, such as Kafka or RabbitMQ.
  • Good understanding of Lambda Architecture and its advantages and drawbacks.


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking a highly skilled Data Engineer to design, develop and optimize large-scale data pipelines and analytics solutions using Azure Data Platform.


  • Pune, Maharashtra, India beBeeDataInfrastructure Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Key Data Infrastructure RoleLarge-scale data infrastructure is critical to business success, and we are seeking a skilled professional to design, implement, and maintain complex systems.Design and implement scalable data pipelines for ingestion and delivery using distributed processing frameworks such as Apache Spark.Develop and curate a centralized data...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer PositionWe are seeking a highly skilled professional with expertise in Big Data, Cloud, and Data Pipeline development.The ideal candidate will have hands-on experience in designing, building, and optimizing large-scale data solutions.They should be comfortable working in a collaborative environment and possess strong communication...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:">We are seeking an experienced data engineer to design, implement, and maintain large-scale data processing systems using Azure technologies. As a key member of our team, you will leverage your expertise in data engineering to drive business value and innovation.">About the Role:">">Design, develop, and deploy large-scale data processing systems...


  • Pune, Maharashtra, India beBeeDataProcessing Full time ₹ 20,00,000 - ₹ 25,15,000

    Data Processing EngineerWe are seeking an experienced Data Processing Engineer to design, develop, and implement large-scale data processing systems using Hadoop technologies.Key Responsibilities:Data Modeling and APIs: Develop robust data models, metadata, and APIs utilizing Hadoop components.Programming Experience: Possess hands-on experience in Python,...


  • Pune, Maharashtra, India beBeeEngineer Full time US$ 1,60,000 - US$ 2,00,000

    Job Summary:Seeking a Senior Site Reliability Engineer with expertise in ELK stack to design, manage and scale large-scale observability infrastructure.In this role, you will optimize cloud infrastructure: architect scalable, fault-tolerant systems on Microsoft Azure.Automate everything: use Terraform, Ansible, and GitHub Actions to streamline deployment and...


  • Pune, Maharashtra, India beBeeDatabase Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity: Data Infrastructure SpecialistAbout the RoleWe are seeking a seasoned SQL Server Data Engineer to lead our database development and maintenance efforts. This senior-level position requires a deep understanding of large-scale database design, implementation, and optimization.Main ResponsibilitiesDesign, implement, and maintain large-scale...


  • Pune, Maharashtra, India beBeeFirewall Full time ₹ 1,00,00,000 - ₹ 1,40,00,000

    Job Description:We are seeking a skilled professional to fill the position of Firewall Specialist. As a key member of our team, you will be responsible for delivering high-quality solutions that meet the needs of our clients.Your primary duties will include designing, delivering, and operating telecommunications business services that are efficient,...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Azure Data Engineer Position OverviewThis is an exciting opportunity to join a dynamic team as an Azure Data Engineer and play a key role in shaping the future of data engineering.Data Engineering Expertise RequirementsFabric/ADF & SQLAzure Data FabricPySparkData BricksCandidates with 5-8 years of experience will design, develop, and maintain large-scale...

  • Chief Data Architect

    2 weeks ago


    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About UsOur organization focuses on developing innovative solutions in data engineering. We aim to deliver scalable data pipelines that enable high-performance analytics and AI-ready data platforms.Job DetailsLarge-Scale Data Pipeline Development: Develop, manage, and optimize large-scale data pipelines using AWS Glue, Spark, and S3.Redshift Query...