Leading Large-Scale Data Pipelines Specialist

6 days ago

Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000
Senior Data Engineer Role

As a senior data engineer, you will play a pivotal role in designing and developing our data pipelines and infrastructure. This will involve working closely with cross-functional teams to ensure data accuracy, timeliness, and accessibility.

Key Responsibilities:

  • Designing and implementing large-scale data pipelines using Azure Data Factory and Databricks.
  • Developing and optimizing ETL processes to ensure efficient data flow and transformation.
  • Managing and maintaining Azure Data Lake solutions for efficient storage and retrieval of large datasets.
  • Collaborating with data scientists and analysts to deliver actionable insights and drive business growth.
  • Ensuring data quality and consistency through thorough checks and monitoring.
  • Providing technical support and troubleshooting services for data-related issues.

Required Skills and Qualifications

  • Experience: 2-4 years of experience in data engineering or a related field.
  • Strong understanding of cloud platforms (AWS, Azure, Google Cloud) and associated data services (S3, Redshift, BigQuery).
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Knowledge of big data technologies (Hadoop, Spark) and data modeling concepts.
  • Excellent problem-solving skills and attention to detail.

Benefits

  • Opportunity to work on high-impact projects that drive business growth.
  • Chance to collaborate with a talented team of data professionals.
  • Professional development opportunities to enhance your skills and career.

Other Requirements

  • Bachelor's degree in computer science, engineering, mathematics, or a related field.
  • Ability to communicate complex technical concepts to non-technical stakeholders.

  • Building Large-Scale Data Architectures

    2 weeks ago

    Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Azure Data EngineerIn this pivotal role, you will lead the design and development of large-scale data processing systems using Azure technologies such as Data Factory (ADF) and Databricks (ADB). Your expertise in PySpark and SQL will drive business growth through data-driven insights.You will work on multiple projects simultaneously, ensuring...

  • Large Scale Data Processing Professional

    4 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer is a pivotal role that involves designing, building and maintaining large-scale data processing systems.Proficiency in SQL and Python is essential with SQL being significantly more crucial.Understanding of Delta files and Lakehouse architecture is necessary for effective data processing.Hands-on skills are required to effectively use...

  • Leading Large-Scale Data Systems Engineer

    4 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Senior Data Engineer to design, develop and maintain large-scale data systems. This role involves designing, developing and maintaining complex data systems that drive business growth.The ideal candidate will have a strong background in data engineering, excellent problem-solving skills and the ability to work...

  • Large Scale Landscape Developer

    4 days ago

    Mount Abu, Rajasthan, India beBeeLandscape Full time ₹ 36,00,000 - ₹ 48,00,000

    Land Planning SpecialistWe are seeking a passionate and detail-oriented Land Planning Specialist to contribute to exciting, large-scale projects.Key Responsibilities:Work on large-scale developments including townships, apartment complexes, plotted developments (20+ acres), and lake/riverfront projects.Prepare and review landscape construction drawings,...

  • Large-Scale AI Systems Engineer

    6 days ago

    Mount Abu, Rajasthan, India beBeeReliabilityEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Incidents can be devastating to modern enterprises.About Enterprise ReliabilityWe are developing intelligent systems that detect, diagnose, and resolve complex production incidents across massive streams of data.Our vision is autonomous reliability for enterprise infrastructure. Think AI meets DevOps, but designed from day one for scalability and production...

  • Data Pipeline Architect

    2 days ago

    Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Pipeline ArchitectWe are seeking a skilled data pipeline architect to join our team and lead the development of scalable, efficient data pipelines that process large datasets.

  • Data Pipeline Engineer

    2 weeks ago

    Mount Abu, Rajasthan, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Integration SpecialistAbout the Role:We are seeking an experienced data integration specialist to join our team. The successful candidate will be responsible for designing, developing, and maintaining complex data pipelines using Informatica PowerCenter.Key Responsibilities:Develop, enhance, and maintain Informatica mappings, workflows, and...

  • High-Performance Data Pipeline Specialist

    2 weeks ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Our Big Data Engineer role involves creating high-performance data pipelines that process massive amounts of data. You will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.Key ResponsibilitiesDesign and implement scalable batch...

  • Large Language Model Operations Specialist

    4 days ago

    Mount Abu, Rajasthan, India beBeeLlmmops Full time ₹ 15,00,000 - ₹ 24,25,000

    We're seeking a skilled Professional to lead the deployment and management of Large Language Models.About the Role:This position involves designing and implementing robust infrastructure for training, fine-tuning, and large-scale inference, as well as establishing best practices for LLM operations.Responsibilities:Lead the design and implementation of LLM...

  • Data Specialist

    2 days ago

    Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are seeking a seasoned Data Specialist to contribute to our organization. The ideal candidate will possess a strong background in data engineering and a passion for designing efficient data pipelines.Key Responsibilities:Develop and implement large-scale data processing systems using Python, SQL, PySpark, and bash scripts.Create robust data pipelines for...