High-Performance Data Architect

3 days ago

Anand, Gujarat, India beBeeData Full time ₹ 14,12,450 - ₹ 25,48,245
Big Data Engineer Opportunity

We are looking for a skilled Big Data Engineer to join our team. As a key member of our data infrastructure group, you will be responsible for designing and building high-performance data pipelines that process massive amounts of data.

Key Responsibilities:
  1. Design and implement scalable batch processing systems using Python and big data technologies.
  2. Optimize database performance, focusing on slow-running queries and latency improvements.
  3. Use Python profilers and performance monitoring tools to identify bottlenecks.
  4. Reduce P95 and P99 latency metrics across our data platform.
  5. Build efficient ETL pipelines that can handle large-scale data processing.
  6. Collaborate with data scientists and product teams to understand data requirements.
  7. Monitor and troubleshoot data pipeline issues in production.
  8. Implement data quality checks and validation mechanisms.
  9. Document data architecture and engineering processes.
  10. Stay current with emerging big data technologies and best practices.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.
  • Ability to work effectively in a collaborative team environment.
Preferred Qualifications:
  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).
  • Experience with real-time data processing.
  • Contributions to open-source projects.
Skills and Abilities:
  • Strong analytical thinking and problem-solving skills.
  • Excellent attention to detail and commitment to data quality.
  • Good communication skills to explain complex technical concepts.
  • Self-motivated with the ability to work independently.
  • Passion for performance optimization and efficiency.

  • Data Architect

    2 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 8,00,000 - ₹ 14,00,000

    Job Title: Data ArchitectWe are seeking an experienced Data Architect to play a key role in designing and implementing scalable data processing solutions within Azure Synapse Analytics.Main Responsibilities:Data Warehousing and Azure Synapse AnalyticsDesign and implement efficient data models and ETL processes to drive business growth.Collaborate with...

  • Master Data Architect Specialist

    3 days ago

    Anand, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned data expert to take on the role of Data Architect at our organization.The successful candidate will have a strong background in data engineering, including data warehousing, ETL, and data governance. Proficiency in languages such as Python, Scala, or Java, and experience with Databricks APIs, Spark, and Delta Lake is required.This...

  • Cloud Native Data Architect

    3 days ago

    Anand, Gujarat, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ManagerOverview:We are seeking a highly experienced and strategic data engineering manager with deep expertise in cloud-native data platforms, Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance,...

  • High-Performance Cloud Architect

    3 days ago

    Anand, Gujarat, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Principal Backend Engineer to join our team. As a key member of our Platform Engineering team, you will be responsible for designing, building, and operating large-scale, high-performance, cloud-native infrastructure systems.Main Responsibilities:Design and build large-scale, high-performance, cloud-native...

  • Senior Data Systems Architect

    19 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleData ArchitectA highly skilled data architect will play a crucial role in the success of our organization.Main Responsibilities:Design and Develop: Design, develop, and maintain large-scale data systems to meet business needs.Optimize Performance: Use expertise in SQL performance tuning and query optimization to ensure efficient data...

  • Data Architect Specialist

    7 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.

  • High-Performance Data Solutions Expert

    19 hours ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 17,06,431 - ₹ 24,58,244

    Job Title: Data Engineer - Oil & Gas DomainWe are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services.The ideal candidate will have expertise in ingesting, processing, and storing structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling...

  • Salesforce Data Architect: Contract Role

    2 weeks ago

    Anand, Gujarat, India SarikaInteriors Full time

    Responsibilities:●Design and implement Salesforce Data Cloud architecture for enterprise-scale projects.●Build and optimize Unified Data Model (UDM), identity resolution, and segmentation.●Integrate Data Cloud with CRM, ERP , marketing tools, and analytics platforms via APIs/ETL.●Configure and tune Data Cloud features for performance and credit...

  • Backend Systems Architect

    2 days ago

    Anand, Gujarat, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    Our company is seeking an experienced Backend Systems Architect to lead the design and development of high-performance backend systems.The ideal candidate will have expertise in Python and Django, with a strong focus on security, authentication, and data protection.

  • High-Performance Data Management Expert

    2 days ago

    Anand, Gujarat, India beBeeDatabaseAdministrator Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    Job Title: Senior Database AdministratorDuration: 8+ yearsLocation: BangaloreShift Timings: Rotational shifts, Multiple shiftsWorking Hours per Day: 9 hoursAbout the Role:We are seeking a seasoned Senior Database Administrator with extensive experience in SQL Server DBA for 2019 and later versions. The ideal candidate will have hands-on experience with Azure...