Data Pipeline Specialist

1 week ago

Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 14,10,000 - ₹ 20,30,000

Data Engineer Role Summary:

">

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines that provide real-time insights for our maritime operations.

">

Key Responsibilities:

">
  • Build & Optimize Data Systems:
    • Create and maintain data highways that fuel AI/ML engines.
    • Ensure data systems are secure by implementing data quality checks, encryption, and compliance standards (GDPR, SOC2).
    • Automate workflows using tools like Airflow to reduce manual intervention in pipeline maintenance.
  • Support Analytics & Troubleshoot Issues:
    • Solve data mysteries and troubleshoot issues related to data systems.
    • Fuel AI/ML engines with high-quality data.
    • Map the data terrain to identify areas for improvement.
  • Collaborate & Learn:
    • Communicate clearly with cross-functional teams to ensure seamless data flow.
    • Learn by doing and stay curious about new technologies and methodologies.
    • Grow with the team and contribute to its success.

Requirements:

">
  • 3+ years' experience in a Data Engineering role using SQL, PySpark, and Airflow.
  • Strong understanding of data lake and data warehouse design best practices and principles.
  • Practical hands-on experience in cloud-based data services for ETL/ELT covering AWS EC2, S3 Storage, and EMR.
  • Ability to manage and enhance infrastructure related to environments covering Spark, Hive, Presto.
  • Experience with databases such as Postgres, MySQL, Oracle.
  • Strong work ethic and ability to work independently on agreed goals.
  • Clear communication skills in English – both in speaking and writing.

What We Offer:

">
  • Opportunity to work on challenging projects and develop your skills.
  • Collaborative and dynamic work environment.
  • Competitive salary and benefits package.

  • Senior Data Pipeline Specialist

    6 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryAs a seasoned Data Engineer, you will be responsible for designing and building scalable data pipelines to support business intelligence initiatives. Your expertise in Spark, PySpark, and SQL will enable the efficient processing of large datasets.Key ResponsibilitiesDesign and Build Scalable Pipelines: Develop and maintain data pipelines using...

  • Data Pipeline Architect

    5 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Data Engineer">">Our company is seeking an experienced Senior Data Engineer to join our team. This role will play a critical part in building scalable data pipelines and integrating healthcare data.">

  • Data Ingestion Specialist

    1 week ago

    Mangalore, Karnataka, India beBeeDataIngestion Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Ingestion SpecialistWe are seeking a skilled data ingestion professional to join our organization. As a data ingestion specialist, you will play a critical role in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into cloud-based platforms.Key Responsibilities:

  • Cloud Data Pipeline Architect

    2 days ago

    Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data Engineer">We are seeking a skilled professional to lead our data engineering efforts.Our team requires someone who can design, develop and maintain robust data pipelines using cloud services such as GCP, AWS or Azure.">Main Responsibilities:Develop scalable data pipelines for real-time data processing.Implement data ingestion,...

  • Data Pipeline Architect

    3 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our engineering group, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable ETL workflows using Python and Pandas.Implement and manage...

  • Senior Data Integration Specialist

    3 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Integration SpecialistWe are seeking a highly skilled Senior Data Integration Specialist to lead the design, build, and maintenance of data pipelines across multiple sources and destinations.The ideal candidate will have strong hands-on expertise in data orchestration, transformations, and ETL/ELT processes to ensure smooth, scalable, and secure...

  • Senior Data Integration Specialist

    3 days ago

    Mangalore, Karnataka, India beBeedataintegration Full time ₹ 18,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a skilled Data Integration Specialist to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.

  • High-Performance Data Pipeline Engineer

    3 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Overview">This role is focused on designing, building, and maintaining high-performance data pipelines to process large volumes of data.

  • Senior Data Pipeline Architect

    2 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key ResponsibilitiesWe're looking for a skilled professional to lead the development of scalable data pipelines.Design and Implement Efficient ETL ProcessesCollaborate with Data TeamsImplement Data Governance and Security StandardsOptimize Data Workflows for Scalability and PerformanceRequired Skills & QualificationsTo succeed in this role, you'll...

  • Data Architect

    6 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Integration SpecialistThe role of a Data Integration Specialist involves enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives. This position requires designing, building, and maintaining ETL/ELT pipelines using AWS Glue, Lambda, and DBT.Responsibilities include developing...