Senior Data Pipeline Developer

3 days ago


mangalore, India beBeeDataEngineer Full time

Data Engineer Role SummaryPerform data extraction tasks using various web scraping techniques and process the extracted data for analysis.Design, implement, and maintain efficient data pipelines to ingest and schedule large datasets.About this Data Engineer PositionCollaborate with cross-functional teams to understand business requirements and develop tailored solutions.Develop and maintain high-quality data products by utilizing Python libraries such as Pandas for data manipulation and transformation.Implement robust data cleaning and validation processes to ensure data accuracy and integrity.Collaborate with analysts to design and implement data visualization tools to support business decision-making.Key Requirements and QualificationsBachelor's or master's degree in computer science or a related field.3-5 years of experience in software development with strong proficiency in Python and SQL/Database skills.Excellent problem-solving skills with an aptitude for designing scalable infrastructure and data systems.Aptitude for working collaboratively with data scientists and stakeholders to deliver high-quality results.Benefits and OpportunitiesOpportunity to work on cutting-edge technology projects.Chance to collaborate with experienced professionals in the field.Competitive compensation and benefits package.Professional growth and development opportunities.



  • mangalore, India beBeeData Full time

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design, build, and own data pipelines that fuel large language model (LLM) development.Create robust, scalable, automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Implement rigorous data cleaning, deduplication, filtering, and normalization...


  • mangalore, India beBeeDataPipelineValidator Full time

    Seeking a skilled Data Pipeline Validator to ensure the accuracy and reliability of data pipelines, business intelligence reports, dashboards, and analytics solutions.Key ResponsibilitiesValidate and analyze data pipelines to ensure accuracy and performance.Test Business Intelligence (BI) reports and dashboards to ensure reliable results.Collaborate with...


  • mangalore, India beBeePlatformEngineer Full time

    Job TitleWe are seeking a highly skilled Platform Engineer to join our team.Key ResponsibilitiesData Pipeline Development: Develop scalable data pipelines using Python, Apache Spark, and Databricks.Notebook-Based Workflows: Create and manage notebook-based workflows for data processing, analysis, and automation.Cloud-Native Solutions: Implement and maintain...


  • Mangalore, India AIMLEAP Full time

    Senior Python Data Engineer – ETL & Pipeline Development Experience: 5 to 12 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred...


  • mangalore, India beBeeDataEngineer Full time

    Job OverviewAs a Data Engineer, you will be responsible for designing and developing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills and expertise in ETL/ELT processes.The ideal candidate will have hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB....


  • mangalore, India beBeeCloud Full time

    Job Opportunity:We are seeking a skilled Data Support Engineer to join our application development team.The ideal candidate will have a strong foundation in Unix system administration, a solid understanding of cloud-based data services (especially AWS), and hands-on experience with ETL pipelines and production support.This role plays a key part in ensuring...


  • mangalore, India beBeeQuality Full time

    Job Title: QA Consultant – ETLDescription:We are seeking an experienced professional to play a crucial role in ensuring the quality and reliability of our data pipelines. As a QA Consultant – ETL, you will work closely with our integration teams to test upstream/downstream interfaces, validate JSON/XML schema structure, status codes, and pagination...


  • mangalore, India beBeeData Full time

    Solutions Architect – Data Pipeline SpecialistAt the core of our Mobility DataOps ecosystem lies a complex network of data flows, tools, and processes. As a Solutions Architect – Data Pipeline Specialist, you will play a crucial role in designing and implementing the technical architecture of our projects.Your expertise will be essential in ensuring...


  • mangalore, India beBeeData Full time

    Role SummaryWe are seeking a highly skilled Data Engineer to design and build robust data pipelines for our nationwide healthcare analytics.The ideal candidate will have expertise in creating scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA). They will also maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring...


  • mangalore, India beBeeData Full time

    Enterprise Data Architect PositionWe are seeking a senior, hands-on Enterprise Data Architect to lead the design and delivery of large-scale data solutions. This individual will be responsible for owning the architecture for data pipelines, data warehousing, analytics, and integrations with various systems.Data Architecture Roadmap: Define end-to-end data...