Expert in Large Scale Data Management

1 day ago

Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,40,000
Senior Data Engineer

Overview:

As a seasoned data engineer, you will play a pivotal role in designing and implementing large-scale data pipelines using Python and Pandas.

  • Develop scalable ETL workflows to process and transform massive datasets.
  • Collaborate with cross-functional teams to architect and implement data warehousing solutions using Hive SQL.
  • Optimize Elasticsearch clusters for indexing, searching, and analytics performance.
  • Design and maintain RESTful APIs using Flask to facilitate secure data exchange.

What You Will Do:

Key Responsibilities:

  1. Design, develop, and automate scalable ETL workflows using Python and Pandas.
  2. Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing.
  3. Configure, monitor, and optimize Elasticsearch clusters for indexing, searching, and analytics performance.
  4. Build and maintain RESTful APIs using Flask to facilitate secure data exchange.
  5. Collaborate with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting tools.

Requirements:

  • 5-16 years of experience in software development and data engineering.
  • Proficient in Python, with hands-on experience using Pandas for large dataset processing.
  • Solid knowledge of ETL frameworks and pipeline automation strategies.
  • Experience with Elasticsearch: indexing, querying, and optimizing for performance.
  • Strong command of Hive SQL and working with distributed data systems.
  • Experience building APIs using Flask or similar Python frameworks.
  • Understanding of data modeling, schema design, and workflow orchestration.

  • Data Architect – Large Scale Distributed Systems

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Data EngineerAbout the Role:We are seeking an experienced data engineer with expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native...

  • Data Engineering Expert

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems that enable advanced analytics and business intelligence.Key Responsibilities:

  • Senior Big Data Delivery Expert

    21 hours ago

    Coimbatore, Tamil Nadu, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data Delivery ExpertRole Overview:We are seeking a seasoned expert in managing large-scale projects within big data and analytics environments, particularly on Databricks.The ideal candidate will have a proven track record of delivering complex technical projects on time, while ensuring client satisfaction and seamless execution.Key...

  • Leadership Role for Large-Scale Application Management

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeproduction Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Production Management LeaderJob Description:We are seeking an experienced and skilled professional to lead our Production Management function. This role requires a strong technical expertise, strategic thinking, and collaboration with cross-functional teams.The ideal candidate should have a deep understanding of ITIL framework, DevOps principles,...

  • Data Center Cooling Expert

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeCooling Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Center Cooling Solutions ExpertWe are seeking an experienced Data Center Cooling Solutions Expert with over 6 years of expertise in the design and implementation of cooling systems for hyperscale data centers.Cooling System Design Leadership:Design innovative cooling solutions for hyperscale data centers, including chilled water systems, direct...

  • Data Migration Expert

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataMigration Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OverviewWe're seeking a highly skilled professional to join our team as a Data Migration Expert. As a key player in our organization, you'll play a pivotal role in streamlining client data from legacy platforms to our modern platform.Key ResponsibilitiesLead complex data migrations from outdated systems to our cutting-edge architecture at scale.Design...

  • Digital Marketing Specialist

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeExpertise Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title:PPC & Paid Social Strategist Description:We are seeking an experienced PPC & Paid Social Strategist with proven expertise in managing large-scale campaigns across multiple platforms. Lead strategy, planning, and execution of campaigns to deliver measurable ROI.Manage significant advertising budgets across multiple platforms.Conduct in-depth data...

  • Expert Data Scientist

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data Science ExpertWe are seeking a highly skilled and motivated Data Science professional to leverage their advanced analytical and technical expertise in solving complex business problems and driving impactful data-driven decisions.This role will involve designing, developing, and deploying sophisticated machine learning models, conducting...

  • Risk Management Expert

    18 hours ago

    Coimbatore, Tamil Nadu, India beBeeFraud Full time US$ 8,00,000 - US$ 15,00,000

    Senior Fraud Risk ModelerWe are seeking a seasoned Senior Fraud Risk Modeler to drive the development and maintenance of models to detect and prevent fraud across various financial products and channels.The ideal candidate will have a strong background in statistical and machine learning techniques, with experience in building and validating fraud detection...

  • Advanced Large Language Model Expert

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeLanguage Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Large Language Model SpecialistWe are seeking a highly skilled professional to lead the development and implementation of cutting-edge Large Language Models (LLMs).Design, configure, and deploy LLM-based solutions utilizing open-source models and APIs.Develop and fine-tune Small Language Models (SLMs) for specific enterprise verticals.Collaborate...