Data Pipeline Engineer

6 days ago

mount, India beBeeDataEngineer Full time

Unlock the power of robust data pipelines to drive nationwide analytics and fuel machine learning systems.Pipeline Development: Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow.Data Lake Development: Develop and maintain the Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability, and accessibility.Job Optimization: Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Ingestion Frameworks: Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Responsibilities include participating in an on-call rotation to support pipeline health and resolve incidents promptly.Key responsibilities will also include developing and maintaining the SAIVA Data Lake/Lakehouse on AWS, implementing batch and streaming ingestion frameworks, running and optimizing distributed data processing jobs, and designing, building, and maintaining scalable ETL pipelines.

  • Cloud Data Pipeline Architect

    1 week ago

    mount, India beBeeDataEngineer Full time

    Cloud Data Engineer PositionAbout Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology...

  • Data Pipeline Architect

    1 week ago

    mount, India beBeeAutomation Full time

    Job Title: Automation SpecialistWe are seeking a skilled Automation Specialist to join our team. As an expert in web automation, you will design and implement scalable data pipelines to extract, transform, and load data from dynamic and protected websites.The ideal candidate will have hands-on experience with Python-based web scraping and automation tools...

  • Data Pipeline Specialist

    1 week ago

    mount, India beBeeData Full time

    Reliable Data Solutions EngineerWe are shaping the future of healthcare analytics. Our objective is to build pipelines that operate efficiently, effectively, and continuously improve in production.This is a fully remote role open to candidates based in Europe or India, with occasional team gatherings in Mountain View, California.Design and implement scalable...

  • ML Pipeline Developer

    2 weeks ago

    mount, India beBeeMlOps Full time

    As an MLOps professional, you will be responsible for designing, deploying and maintaining robust ML pipelines using cloud services.Your key responsibilities include:Building, deploying and maintaining ML models using AWS SageMakerDeveloping automated CI/CD workflows using CodePipeline, CodeBuild or GitHub ActionsImplementing model monitoring, logging and...

  • Senior python data engineer – etl

    3 weeks ago

    Mount Abu, India AIMLEAP Full time

    Senior Python Data Engineer – ETL & Pipeline Development Experience: 5 to 12 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B. E / B. Tech / M. Tech / MCA / Computer Science / IT Industry: IT / Data / AI / Legal Tech / Enterprise Solutions Notice Period: Immediate Joiners...

  • Data Engineering Specialist

    5 days ago

    mount, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistAbout the Role:We are seeking a highly skilled data engineering specialist to lead our team in developing innovative data analytic solutions on Azure. This is an exceptional opportunity for a talented professional with experience in end-to-end development of data solutions using Databricks and Snowflake.Key...

  • Mastering Data Engineering

    1 week ago

    mount, India beBeeDataEngineer Full time

    Data Engineer RoleAs a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems to support business intelligence and data analytics.Key Responsibilities:Create and implement ETL processes using Azure Data Factory and Databricks.Design and deploy data warehouses on Azure Synapse Analytics.Implement...

  • Experienced Cloud Data Engineer

    2 weeks ago

    mount, India beBeeData Full time

    Job DescriptionWe are seeking a seasoned data professional with hands-on expertise in building scalable data pipelines, designing data warehousing solutions, and working with modern cloud-based data engineering frameworks.The ideal candidate will have strong proficiency in SQL, Python, and distributed data processing, as well as experience with ETL tools and...

  • Data Engineering Leader

    2 weeks ago

    mount, India beBeeData Full time

    About the RoleWe're seeking an experienced Senior Data Engineer – Data Acquisition to join our team. This key position involves end-to-end development of data acquisition solutions for operational and analytical systems.Key Responsibilities:Develop and optimize large-scale data pipelines using Azure, Databricks, Snowflake, and Kafka.Implement data...

  • Seeking Seasoned Data Engineers

    2 weeks ago

    mount, India beBeeDataEngineer Full time

    Cloud Native Data EngineerWe are seeking a seasoned Cloud Native Data Engineer to spearhead the development of scalable data pipelines and platform services using Python, Apache Spark, and Databricks.The ideal candidate will have hands-on experience with Kubernetes for container orchestration, workload deployments, and scaling.