Data Pipeline Optimization Specialist

1 day ago

Thoothukudi, Tamil Nadu, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
System Administrator of Elasticsearch ClustersAbout the Role:

In this pivotal position, you will be responsible for continually evaluating and optimizing the performance of our Elasticsearch clusters. Your proactive approach will enable us to identify potential issues before they impact our services.

Key Responsibilities:
  1. Maintain and enhance data pipelines, including serverless and server-based systems feeding into the Elasticsearch pipeline.
  2. Optimize cost-effectiveness by testing new hosting configurations.
  3. Develop automation processes using tools like Puppet and scripting mechanisms.
Required Expertise:
  1. Elasticsearch cluster administration
  2. Splunk cluster management
  3. Provisioning and configuration management tools
  4. Infrastructure as code and automation
  5. Monitoring and logging tools, scripting languages, and CI/CD tools
  6. Troubleshooting complex issues and creative problem-solving
  7. Docker and Kubernetes experience
Benefits:
  1. Competitive compensation package
  2. Professional growth opportunities with quarterly promotions and company-sponsored education
  3. Access to cutting-edge technologies and employee engagement initiatives
  4. Annual health check-ups and comprehensive insurance coverage
Work Environment:

Our organization is committed to fostering diversity and inclusion. We welcome applications from qualified individuals and support flexible work arrangements.

  • Senior Data Pipeline Engineer

    1 day ago

    Thoothukudi, Tamil Nadu, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Integration SpecialistAs a skilled professional, you will play a vital role in building scalable and efficient data pipelines using industry-leading technologies.Key Responsibilities:Design, develop, and maintain ETL pipelines for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.Build and optimize data flows for loading...

  • AI Pipeline Developer

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeArtificialIntelligence Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior AI Specialist PositionExcelgig is hiring an AI Specialist with expertise in custom model development and end-to-end pipeline creation.Key Responsibilities:Design and develop custom machine learning and deep learning models for business-specific problems (NLP, computer vision, predictive modeling, recommendation systems, etc.).Build and maintain...

  • ETL Data Pipelines Specialist

    4 days ago

    Thoothukudi, Tamil Nadu, India beBeeInformatica Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:">A seasoned professional is required to lead the design, development, and maintenance of data pipelines using Informatica IICS.The ideal candidate will have experience integrating IICS solutions with cloud-based data platforms such as Google Cloud Platform (GCP) and Google BigQuery (GBQ).Pipeline optimization for scalability and performance is...

  • Data Pipeline Specialist

    1 day ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 15,00,000

    About the Role:Drive digital transformation and enhance operational efficiency by designing and implementing scalable data pipelines using Azure Databricks (PySpark/Scala).Key Responsibilities:

  • Chief Data Pipeline Architect

    4 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking an experienced professional to lead our data engineering team. As a key member, you will be responsible for designing, developing, and optimizing large-scale data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Key Responsibilities:Design, develop, and optimize ETL/ELT data pipelines using Apache...

  • Data Architect Specialist

    4 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Architect SpecialistAbout the RoleThe ideal candidate will be responsible for designing, building and optimizing scalable data pipelines and architectures. You will work closely with cross-functional teams to deliver robust, secure and high-performance data solutions that empower analytics and data science initiatives.

  • Highly Skilled Python Data Pipeline Specialist

    5 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Description:We are seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines.The role requires proficiency in pytest for testing, Git/GitHub for version control, and clear technical documentation.

  • Data Solutions Specialist

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Data Solutions SpecialistWe are seeking a skilled Data Engineer to design, build and maintain scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.Design, build and maintain ETL/ELT pipelines using AWS Glue, Lambda, and DBT.Develop and optimize data models in Snowflake for scalability and performance.Write efficient and...

  • Cloud Data Specialist

    4 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Remote Work Freelance Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Cloud Data SpecialistWe are seeking a skilled Cloud Data Specialist with expertise in designing and implementing cloud-based solutions using Azure and Google Cloud platforms.The ideal candidate will have a good understanding of data integration, data cleanup, and related products. They should be able to design and implement efficient data pipelines and...

  • High-Performance Data Pipeline Architect

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Big Data Engineer PositionWe are seeking a skilled Big Data Engineer to design, build, and maintain high-performance data pipelines that process massive amounts of data. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.Key Responsibilities:Design and implement...