Chief Big Data Solutions Architect

3 days ago

Belgaum, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000

Big Data Engineer

">

Transform online content into tangible business results by processing massive amounts of data to provide actionable insights to clients.

Design, build and maintain high-performance data pipelines that process terabytes of data. Work on optimizing existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve overall efficiency of the platform.

Key Responsibilities include:

  • Designing scalable batch processing systems using Python and big data technologies.
  • Optimizing database performance, focusing on slow-running queries and latency improvements.
  • Using Python profilers and performance monitoring tools to identify bottlenecks.
  • Reducing P95 and P99 latency metrics across the data platform.
  • Building efficient ETL pipelines that can handle large-scale data processing.
  • Collaborating with data scientists and product teams to understand data requirements.
  • Monitoring and troubleshooting data pipeline issues in production.
  • Implementing data quality checks and validation mechanisms.
  • Documenting data architecture and engineering processes.
  • Staying current with emerging big data technologies and best practices.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.
  • Ability to work in UK timezone (12 PM IST to 9:30 PM IST).

Preferred Qualifications:

  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).
  • Experience with real-time data processing.
  • Contributions to open-source projects.

Skills and Abilities:

  • Strong analytical thinking and problem-solving skills.
  • Excellent attention to detail and commitment to data quality.
  • Ability to work effectively in a collaborative team environment.
  • Good communication skills to explain complex technical concepts.
  • Self-motivated with the ability to work independently.
  • Passion for performance optimization and efficiency.

  • Chief Data Architect

    3 days ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 15,62,500 - ₹ 26,13,500

    We are looking for a skilled Chief Data Architect to join our team. As a key member, you will be responsible for designing and developing data warehouses that meet the needs of our business.This is an exciting opportunity for someone who is passionate about leveraging data structures and algorithms to drive business value. If you have 8+ years of experience...

  • Big Data Architect

    10 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: GCP Data EngineerTransforming raw data into actionable insights is crucial for our business. As a key member of our dynamic team, you will design, develop, and maintain robust data pipelines and analytics platforms that serve as the backbone of our product development.You will collaborate with cross-functional teams including data scientists,...

  • Senior Big Data Solutions Architect

    3 days ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to design, develop, and maintain data pipelines and ETL processes on Databricks. The ideal candidate will lead the architecture and implementation of scalable, secure, and high-performance data solutions.The Data Engineer will collaborate with business stakeholders, data scientists, and analysts to gather...

  • Chief Data Architect

    14 hours ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Overview:Data engineers design, build, and maintain large-scale data systems. This role involves working with big data environments, developing ETL applications, and collaborating with cross-functional teams to deliver high-quality solutions.Key Responsibilities:Design and Development: Design, develop, and maintain large-scale data systems using Azure...

  • Chief Data Strategist

    14 minutes ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a visionary Data Architect to spearhead the development of our data engineering solutions. As a key member of our team, you will be responsible for designing and implementing robust, scalable, and secure data architectures that meet business requirements.Key Responsibilities:Design and develop data architecture solutions on...

  • Leading Edge GenAI Solutions Architect

    3 days ago

    Belgaum, Karnataka, India beBeeGenai Full time ₹ 1,51,20,000 - ₹ 2,01,60,000

    As we strive to push the boundaries of innovation, we seek a highly skilled GenAI Engineer to join our Big Data – Data & AI team.The ideal candidate should have 6–8 years of total experience with strong expertise in AWS, GenAI, and leading-edge technologies.Key responsibilities include building and deploying GenAI solutions leveraging AWS Bedrock &...

  • Big Data Engineering Expert

    2 days ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewA Senior Data Engineer leads a team of big data engineers, working closely with stakeholders and team members to understand their requirements and develop architectures that meet their needs.This role involves developing data pipelines for new sources, data transformations within the data lake, implementing GraphQL, working with NoSQL databases,...

  • Senior Cloud Data Architect

    3 days ago

    Belgaum, Karnataka, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,52,00,000

    Cloud Data Engineer LeaderWe are seeking an experienced Cloud Data Engineer Leader to design and deliver scalable data pipelines and analytics platforms.The ideal candidate will lead a team of talented data engineers, overseeing the development of end-to-end data solutions using Azure Data Services and Databricks. They will collaborate with cross-functional...

  • Chief Architect

    12 hours ago

    Belgaum, Karnataka, India beBeeEnterprise Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Technical Architect with 12–15 years of experience in F&O and Power Platform. This role demands deep technical expertise in architecting end-to-end ERP solutions with strong domain understanding in finance, supply chain, manufacturing, HR, and payroll systems.Key Responsibilities:Architect and implement...

  • Senior Big Data Engineer

    3 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerSkillful and experienced big data engineer sought after to design, build, deploy, and maintain large-scale data processing systems using cloud-based technologies. Key responsibilities include development of high-performance data pipelines, optimization of existing codebases, and implementation of data warehousing concepts.Required...