Highly Skilled Data Architect

1 week ago

Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 4,00,000 - ₹ 8,00,000
Data Engineer Position

As a Data Engineer, you will be responsible for building and maintaining efficient data pipelines, optimizing query performance, and developing APIs to support scalable data services. This role requires expertise in data modeling, container orchestration, and collaboration with data scientists and analysts to ensure data quality and meet business needs.

Key Responsibilities:
  1. Design and Build Scalable Data Pipelines: Develop and maintain high-performance data pipelines using ClickHouse and Kubernetes.
  2. Optimize Query Performance: Utilize advanced SQL techniques, including complex joins and window functions, to optimize query performance.
  3. Develop RESTful APIs: Create lightweight APIs using FastAPI to expose data services and enable seamless integration with other systems.
  4. Work with Kubernetes: Leverage container orchestration and deployment capabilities of Kubernetes to ensure efficient and scalable data infrastructure.
  5. Write Complex SQL Queries: Extract, transform, and analyze data from PostgreSQL and ClickHouse using advanced SQL queries.
  6. Collaborate with Cross-Functional Teams: Work closely with data scientists, analysts, and backend teams to support data needs and ensure data quality.
  7. Monitor and Improve Performance: Continuously monitor and improve the performance of data infrastructure to meet evolving business needs.
Required Skills and Qualifications:
  • Strong Experience in ClickHouse: Expertise in data modeling, query optimization, and performance tuning.
  • Advanced SQL Skills: Proficiency in complex SQL concepts, including joins, window functions, and optimization techniques.
  • Proficient in Python: Strong understanding of Python programming, especially for data processing and scripting.
  • FastAPI Development: Experience in creating lightweight APIs and microservices using FastAPI.
  • PostgreSQL Expertise: Hands-on experience with PostgreSQL, including schema design, indexing, and performance optimization.
  • Kubernetes Knowledge: Solid understanding of Kubernetes, including container orchestration, deployment, and scaling.
  • Software Engineering Best Practices: Familiarity with CI/CD pipelines, version control, testing, and other software engineering best practices.
  • Cloud Platform Experience: Experience with cloud platforms like AWS, GCP, or Azure is a plus.
  • Distributed Data Systems: Knowledge of data warehousing and distributed data systems is a plus.
Qualification:
  • Bachelor's Degree: Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.

  • Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled data professional to join our team. The successful candidate will be responsible for designing, developing, and implementing data solutions that meet the needs of our business.Key Responsibilities:End-to-end support of data project lifecycle (acquire, organize, analyze, and deliver)

  • Highly Skilled Data Professional

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionOur organization is looking for a highly skilled data professional with expertise in designing, implementing and managing data pipelines. The ideal candidate should have hands-on experience in working with modern DevOps/configuration management tools.Key Responsibilities:Design, Implement and Manage Data PipelinesConfigure and manage CI/CD...

  • Highly Skilled Data Engineer Required

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job TitleA highly skilled Data Engineer with a strong background in designing and developing efficient ETL pipelines is required to drive our data engineering team forward.Main Responsibilities:Create scalable data pipelines to handle increasing data volumes and complexitiesCollaborate with cross-functional teams to enhance data models and increase data...

  • Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Architect to design and develop robust data pipelines using Python, SQL, PySpark, and bash scripts.Key Responsibilities:Design and develop data architectures for both structured and unstructured data.Work with Cloud Data Warehousing platforms such as Redshift, Snowflake, Databricks SQL, or equivalent.Develop and maintain...

  • Expert Data Solutions Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataSolutions Full time ₹ 15,12,000 - ₹ 2,01,60,000

    Expert Data Solutions ArchitectWe are seeking a highly skilled data solutions architect to design and implement scalable data pipelines using advanced technology frameworks.Key Responsibilities:Azure Synapse (At least 4+ years relevant experience)Microsoft Fabric (Hands-on experience with at least one project executed using Microsoft Fabric)Azure Data...

  • Highly Skilled Data Engineer Wanted

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 2,00,000

    Senior Data Engineer Job Description:The ideal candidate for this position will have a strong background in data warehousing, data engineering, and data integration.Key Responsibilities:Work with business stakeholders to understand business processesDesign and implement dimensional and fact tablesIdentify and implement data transformation/cleansing...

  • Highly Skilled Frontend Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeFrontendDeveloper Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Frontend Developer to drive the development of end-to-end frontend architecture and contribute to high-quality user interfaces.Main Responsibilities:Create complex frontend applications with strong technical expertise and problem-solving skills.Collaborate with product managers, backend engineers, and designers to...

  • Big Data Architect Specialist

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunitySr. Data Architect - Big Data SpecialistWe are seeking a highly skilled and experienced Senior Data Architect to join our team as a Big Data Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.You will lead...

  • Senior Data Architect

    1 week ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly experienced Data Architect with expertise in data warehousing, data modeling and data engineering.Lead and manage data warehousing projects, ensuring timely delivery and execution of scalable and efficient data solutions.Collaborate with clients to gather requirements, analyze needs and provide technical guidance on data engineering...

  • Big Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Big Data Architect to lead the design and implementation of our data engineering systems. As a key member of our team, you will be responsible for architecting and building scalable systems using lakehouse architectures (Apache Iceberg, Delta Lake) to unify data lakes and warehouses.Key Responsibilities:Develop and...