High-Performance Data Engineering Expertise Sought

1 day ago

Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,70,000
Job Title: Data Engineering Professional

We are seeking a skilled Data Engineer to join our team and contribute to the development of high-performance data pipelines.

Job Description:

The ideal candidate will have expertise in designing, building, and maintaining scalable batch processing systems using Python and big data technologies. They will also be responsible for optimizing database performance, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.

Key Responsibilities:

  • Design and implement efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.

Qualifications Required:

  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).

Preferred Qualifications:

  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).

Skills and Abilities:

  • Strong analytical thinking and problem-solving skills.
  • Excellent attention to detail and commitment to data quality.
  • Ability to work effectively in a collaborative team environment.
  • Good communication skills to explain complex technical concepts.
  • Self-motivated with the ability to work independently.

  • High-Performance Data Pipeline Specialist

    9 hours ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Databricks Data Engineer Job DescriptionWe are seeking a highly skilled Senior Databricks Data Engineer to design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.The ideal candidate will have strong hands-on experience in Databricks and AWS, with a solid understanding of PySpark, CI/CD pipelines, and...

  • High-Profile Data Analysis Leadership Role

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataAnalysis Full time ₹ 1,09,40,000 - ₹ 2,01,90,000

    Lead Data Analyst sought for high-profile role.Analyze portfolio data from multiple sources and integrate it into a robust system.Collaborate with cross-functional teams to deliver exceptional data solutions.Develop tailored data aggregation tools to meet user workflow needs.Analyze and implement efficiency improvements in data operations.We are looking for...

  • Web Data Extraction Expert

    5 days ago

    Bareilly, Uttar Pradesh, India beBeeSpecialist Full time ₹ 10,00,000 - ₹ 15,00,000

    Expert Web Scraping Specialist WantedA high-level web scraping and data extraction specialist is sought for a long-term freelance partnership. The ideal candidate will develop a smart, evolving system with advanced technical skills and reliability.About the ProjectThe project involves building a strategic data system that incorporates dynamic content, custom...

  • High-Performance Technology Lead

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Job RoleWe are looking for a seasoned Engineering Manager to oversee the development of AI infrastructure and acceleration solutions that drive productivity, innovation, and customer impact.Lead the development of AI infrastructure and acceleration solutions.Work with state-of-the-art AI models, frameworks, and tools.Responsibilities:Hands-on architecture...

  • High-Tech Data Solutions Specialist

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity:Senior Data EngineerWe are seeking an experienced data engineer to join our team and contribute to the development of high-quality data solutions.Develop, maintain, and optimize ETL pipelines using FiveTran, DBT Cloud, and custom frameworks for seamless data flow.Implement client-specific data transformations for HighTouch integration,...

  • Chief Data Engineering Specialist

    24 minutes ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team in building scalable real-time and batch processing workflows. This is an opportunity to leverage your expertise in cloud-based data architectures, deployment of optimized data solutions, and development of ETL/ELT pipelines for structured and unstructured data.Main ResponsibilitiesCreate...

  • Data Engineer

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineering SpecialistWe are seeking a highly skilled data engineer to assume the role of Senior Data Engineering Specialist. This position involves working on high-level marketing platforms and performing in-depth data analysis.This role requires expertise in API extraction, automation, and orchestration using advanced Python programming...

  • High-Performance Electronics Design Lead

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeElectronics Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleElectronics Engineer for Advanced Mixed Signal Chip DevelopmentJob DescriptionWe seek an experienced electronics engineer to lead the development of an advanced mixed signal chip.As a key member of our team, you will be responsible for driving the synthesis and static timing analysis efforts from concept through production.The ideal candidate will...

  • High Performance Backend Developer

    5 days ago

    Bareilly, Uttar Pradesh, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Backend EngineerWe're seeking a skilled backend developer to help scale our infrastructure and data services.Design and deploy containerized microservices using KubernetesOptimize graph database queries and models in Neo4jThe ideal candidate will have experience with Go and Python, as well as strong hands-on experience with databases such as Neo4j,...

  • High-Performance Web Application Lead

    4 hours ago

    Bareilly, Uttar Pradesh, India beBeeSoftware Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Web Application Developer PositionRole OverviewWe are seeking an experienced software engineer to lead the development of high-performance web applications.The ideal candidate will have a strong background in software engineering, with a focus on ReactJS, OpenLayers, DeckGL, and other libraries.They will be responsible for owning feature deliveries...