Data Pipeline Architect

21 hours ago


mangalore, India beBeePlatformEngineer Full time

Job TitleWe are seeking a highly skilled Platform Engineer to join our team.Key ResponsibilitiesData Pipeline Development: Develop scalable data pipelines using Python, Apache Spark, and Databricks.Notebook-Based Workflows: Create and manage notebook-based workflows for data processing, analysis, and automation.Cloud-Native Solutions: Implement and maintain cloud-native solutions on AWS, GCP, or Azure.Platform Management: Deploy and manage workloads on Kubernetes, ensuring scalability and reliability.Required Skills and QualificationsMust-Have Skills:Python: Strong experience in Python for data engineering, scripting, and automation.Apache Spark: Solid understanding of Apache Spark and distributed data processing.Notebooks: Experience working with notebooks (Jupyter, Zeppelin, or Databricks).Kubernetes: Hands-on experience with Kubernetes for container orchestration, workload deployments, and scaling.Nice to Have Skills:DevOps Practices: Familiarity with DevOps practices, CI/CD pipelines, and cloud environments (AWS, GCP, Azure).Real-Time Streaming: Experience with Kafka, real-time streaming, Java/Spring Boot.Databases: Knowledge of RDBMS (PostgreSQL) and NoSQL databases.BigData Services: Knowledge of BigData services like BigQuery, BigTable, Hive.



  • mangalore, India beBeeDataEngineer Full time

    Job OverviewAs a Data Engineer, you will be responsible for designing and developing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills and expertise in ETL/ELT processes.The ideal candidate will have hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB....


  • mangalore, India beBeeSolution Full time

    Data Architect RoleOverview of Data Architect PositionWe are seeking a senior data architect to lead the design and implementation of enterprise data analytics solutions. This individual will be responsible for defining end-to-end data architectures, roadmaps, and technical strategies for large-scale education data platforms.Responsibilities of Senior Data...


  • mangalore, India beBeeDataPipelineValidator Full time

    Seeking a skilled Data Pipeline Validator to ensure the accuracy and reliability of data pipelines, business intelligence reports, dashboards, and analytics solutions.Key ResponsibilitiesValidate and analyze data pipelines to ensure accuracy and performance.Test Business Intelligence (BI) reports and dashboards to ensure reliable results.Collaborate with...


  • mangalore, India beBeeQuality Full time

    Job Title: QA Consultant – ETLDescription:We are seeking an experienced professional to play a crucial role in ensuring the quality and reliability of our data pipelines. As a QA Consultant – ETL, you will work closely with our integration teams to test upstream/downstream interfaces, validate JSON/XML schema structure, status codes, and pagination...


  • mangalore, India beBeeCloud Full time

    Job Opportunity:We are seeking a skilled Data Support Engineer to join our application development team.The ideal candidate will have a strong foundation in Unix system administration, a solid understanding of cloud-based data services (especially AWS), and hands-on experience with ETL pipelines and production support.This role plays a key part in ensuring...


  • mangalore, India beBeeDataEngineering Full time

    Job Opportunity:We are seeking an experienced Data Engineering Specialist to join our team.About the Role:This position involves designing and developing scalable data pipelines using cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.The successful candidate will be responsible for architecting and implementing data...


  • mangalore, India beBeeDataEngineer Full time

    Data Engineer Role SummaryPerform data extraction tasks using various web scraping techniques and process the extracted data for analysis.Design, implement, and maintain efficient data pipelines to ingest and schedule large datasets.About this Data Engineer PositionCollaborate with cross-functional teams to understand business requirements and develop...


  • Mangalore, India AIMLEAP Full time

    Senior Python Data Engineer – ETL & Pipeline Development Experience: 5 to 12 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred...

  • Cloud Architect

    21 hours ago


    mangalore, India beBeeData Full time

    Job OpportunityWe are seeking a seasoned expert in cloud-based architecture to lead our data and solution initiatives.Develop comprehensive architectures for Azure applications, prioritizing security, scalability, and performance.Design and implement data modeling strategies that ensure high-quality, well-documented, and easily maintainable data...


  • mangalore, India beBeeDataArchitect Full time

    Job OverviewWe are seeking a seasoned Data Architect to join our team. This pivotal role involves designing, building, and deploying data-centered solutions that drive business outcomes. You will engage with cross-functional teams to deliver end-to-end data delivery solutions from acquisition through analysis and presentation.The ideal candidate will have a...