High-Performance Data Solutions Engineer

13 hours ago

Gurgaon, Haryana, India beBeeData Full time

We are seeking a skilled Data Engineer with strong hands-on experience in ClickHouse, Kubernetes, SQL, and Python. You will be responsible for building and maintaining efficient data pipelines, optimizing query performance, and developing APIs to support scalable data services. This role requires expertise in data modeling, container orchestration, and collaboration with data scientists and analysts to ensure data quality and meet business needs.

Roles & Responsibilities:

  • Data Engineering Key Responsibilities
  • Design, build, and maintain scalable and efficient data pipelines and ETL processes.
  • Develop and optimize ClickHouse databases for high-performance analytics, including data modeling, query optimization, and performance tuning.
  • Create RESTful APIs using FastAPI to expose data services.
  • Work with Kubernetes for container orchestration and deployment of data services.
  • Write complex SQL queries to extract, transform, and analyze data from PostgreSQL and ClickHouse.
  • Collaborate with data scientists, analysts, and backend teams to support data needs and ensure data quality.
  • Monitor, troubleshoot, and improve the performance of data infrastructure.

Skill Requirements:

  • ClickHouse Expertise
  • Strong experience in ClickHouse (data modeling, query optimization, performance tuning).
  • SQL Skills
  • Expertise in SQL, including complex joins, window functions, and optimization.
  • Python Proficiency
  • Proficient in Python, especially for data processing (Pandas, NumPy) and scripting.
  • FastAPI Experience
  • Experience with FastAPI for creating lightweight APIs and microservices.
  • PostgreSQL Knowledge
  • Hands-on experience with PostgreSQL (schema design, indexing, and performance).
  • Kubernetes Understanding
  • Solid knowledge of Kubernetes (managing containers, deployments, and scaling).
  • Software Engineering Best Practices
  • Understanding of software engineering best practices (CI/CD, version control, testing).
  • Cloud Platforms Familiarity
  • Experience with cloud platforms like AWS, GCP, or Azure is a plus.
  • Data Warehousing Knowledge
  • Knowledge of data warehousing and distributed data systems is a plus.
  • Docker and Monitoring Tools
  • Familiarity with Docker, Helm, and monitoring tools like Prometheus/Grafana is a plus.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.

  • High-Performance Data Engineer

    6 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Summary**We are seeking an experienced Data Engineer to design, develop, and manage scalable data pipelines using AWS services.Key Responsibilities:Design, develop, and maintain ETL pipelines using AWS Glue, Databricks, Apache Spark, and Python to process structured and unstructured data from diverse sources.Build and orchestrate data workflows...

  • High-Performance Engineer

    6 days ago

    Gurgaon, Haryana, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:">High-Performance Engineer for Large-Scale Client Solutions">As a high-performance engineer, you will work in a product squad and drive solutions for a large-scale client. You are expected to be a skilled engineer who can understand client business domains and drive digital business transformation opportunities.">The key responsibilities of this...

  • High-Performance Data Solutions Architect

    6 days ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAs a senior data engineer, you will play a crucial role in designing and implementing cutting-edge data solutions using Hadoop-based technologies along with AWS.Responsibilities:Design and implement various big data platform components like batch processing, live stream processing, in-memory cache, query layer (SQL), rule...

  • High-Performance Data Expert

    1 week ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    High-Performance Data EngineerWe are seeking a highly skilled and experienced data expert to join our dynamic team. The ideal candidate will have a minimum of 5 years of experience in data science, with a strong background in machine learning, statistical analysis, and data visualization.Key Responsibilities:Design, develop, and implement machine learning...

  • Principal Software/Data Engineering

    6 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About CoPoint DataCoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Cloud Data Solutions Engineer

    6 days ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Solutions EngineerAbout the Role:We are seeking a seasoned Cloud Data Solutions Engineer to design, develop, and maintain scalable data solutions on Azure.The ideal candidate has extensive experience in Python, Azure data services, ETL processes, and cloud data infrastructure.Develop and implement ETL pipelines using Azure Data Factory and Azure...

  • Unlock Scalable Data Solutions

    6 days ago

    Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Solutions EngineerWe are seeking a skilled Data Solutions Engineer with strong expertise in Python, AWS Cloud, and Redshift to design, build, and maintain scalable data pipelines and solutions.The ideal candidate will have hands-on experience with large-scale data systems, cloud platforms, and database technologies, and will be able to...

  • Data Engineer

    6 days ago

    Gurgaon, Haryana, India Obrimo Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Responsibilities:Develop, implement, and maintain efficient and scalable data engineeringsolutions to support the company's data initiatives.Collaborate with cross-functional teams to understand businessrequirements and translate them into technical data engineeringsolutions.Build and maintain data pipelines to ingest, transform, and store datafrom...

  • High-Performance Developer Wanted

    5 days ago

    Gurgaon, Haryana, India beBeeSoftwareEngineer Full time ₹ 10,00,000 - ₹ 12,00,000

    Senior Software Engineer PositionAs a senior software engineer, you will be responsible for developing and maintaining high-performance data processing backend applications using .NET Core. The ideal candidate will have experience working with established processes, ensuring adherence to best coding practices, and identifying opportunities to fine-tune and...

  • Building High-Performance Data Systems

    2 weeks ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer PositionThis role involves establishing and optimizing data flow throughout the organization, ensuring its security.Data pipeline development, technical architecture design, application development, testing, and solution implementation.The ideal candidate will drive database architecture and design for large-scale applications, research...