Expert Data Pipeline Developer

2 days ago

erode, India beBeeData Full time

Job Title: Data Engineering SpecialistOur organization is seeking a highly skilled data engineering professional to join our team. This is an exciting opportunity for an experienced professional in data engineering to design, develop, and optimize large-scale data pipelines.The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata, and Google Cloud Platform (GCP). Key responsibilities include:Implementing data solutions using SQL, Ab-Initio, Teradata, and GCP to ensure scalability, reliability, and performance.Mentoring and guiding colleagues in the development and execution of ETL processes and data integration solutions.Taking ownership of end-to-end data workflows, from data ingestion to transformation, storage, and accessibility.Leading performance tuning and optimization efforts for complex SQL queries and Teradata database systems.Designing and implementing data governance, quality, and security best practices to ensure data integrity and compliance.Managing the migration of legacy data systems to cloud-based solutions on Google Cloud Platform (GCP).Ensuring continuous improvement and automation of data pipelines and workflows.Troubleshooting and resolving issues related to data quality, pipeline performance, and system integration.RequirementsWe are looking for professionals with 4-6 years of experience in data engineering or related roles.Strong expertise in SQL, Teradata, and Ab-Initio.Proficient and good hands-on experience in using the Ab-Initio development products - GDE, Conduct, Control Center, Continuous Flows, EME, M-HUB, etc.Hands-on experience over Unix/Shell scripting.Proficient in scheduling and analyzing jobs using Autosys (or any similar) Scheduler.In-depth experience with Google Cloud Platform (GCP), including tools like BigQuery, Cloud Storage, Dataflow, etc.Proven track record of leading teams and projects related to data engineering and ETL pipeline development.Experience with data warehousing and cloud-native storage solutions.Strong analytical and problem-solving skills.Experience in setting up and enforcing data governance, security, and compliance standards.Preferred QualificationsFamiliarity with other cloud platforms/services (AWS, Azure).Familiarity with any other ETL tools like Informatica, Datastage, Alteryx, etc.Knowledge of Big Data technologies like Hadoop, Spark, Hive, Scala, etc.Strong communication skills and the ability to collaborate effectively with both technical and non-technical teams.

  • Lead Data Pipeline Architect

    6 days ago

    erode, India beBeeDataEngineer Full time

    Job OverviewWe seek a Senior Data Engineer to lead our team in designing, building, and maintaining the data pipelines that power large language model development.The ideal candidate will have 8+ years of professional experience in data engineering, data processing, or backend software engineering, and expert-level proficiency in Python and its data...

  • Data Scientist

    6 days ago

    erode, India beBeeMachineLearning Full time

    Expert Data Scientist OpportunityWe're seeking a seasoned data scientist to own and build end-to-end machine learning pipelines from scratch.Responsibilities:Design and implement scalable data architectures, integrating with various platforms including Shopify, GA4, ESP, and CRM systems.Develop advanced features for predictive modeling, clustering, and...

  • Data Pipeline Specialist

    5 days ago

    erode, India beBeeDataEngineer Full time

    About this RoleWe are seeking a skilled Data Engineer to design, develop, and maintain robust ETL/ELT pipelines for various data sources. The ideal candidate will have strong expertise in SQL (PostgreSQL preferred) and Python, with hands-on experience building ETL pipelines and working in Lakehouse architecture.Key ResponsibilitiesData Engineering &...

  • Data Pipeline Specialist

    6 days ago

    erode, India beBeeData Full time

    Job SummaryWe are seeking a talented Data Pipeline Engineer to join our team. The ideal candidate will have experience in designing, building, and maintaining scalable data pipelines, transformations, and applications within a cloud-based ecosystem.Main Responsibilities:Develop and operationalize AI-powered workflows, copilots, and decision-support agents...

  • Sales Pipeline Developer

    2 days ago

    erode, India beBeeDemandGenerator Full time

    About this roleWe are seeking a creative and data-driven professional to drive qualified leads and build a strong sales pipeline through targeted marketing campaigns, events, and digital initiatives. Key Responsibilities: Develop and execute multi-channel demand generation campaigns (email, social media, webinars, events, paid ads) to generate measurable...

  • Cloud Data Solutions Expert

    4 days ago

    erode, India beBeeData Full time

    Job OpportunityWe are seeking a skilled Freelance Data Engineer to join our team in delivering innovative data solutions for businesses.The ideal candidate will have expertise in designing, implementing, and optimizing real-time data pipelines using Apache NiFi, SQL, and API integrations.The role involves creating ingestion pipelines for structured and...

  • Cloud Data Engineering Expert

    7 days ago

    erode, India beBeeData Full time

    About the RoleAs a Cloud Data Engineer, you will play a crucial part in designing, developing, and maintaining scalable ETL pipelines using cloud-native tools. Your expertise will be invaluable in architecting and implementing data lakes and data warehouses on cloud platforms.You will develop and optimize data ingestion, transformation, and loading processes...

  • Automation Expert

    6 days ago

    erode, India beBeeQuality Full time

    Quality Engineering ManagerThe ideal candidate will be responsible for leading the development of innovative quality engineering solutions and cutting-edge technology to optimize enterprise processes.This role involves collaborating with cross-functional teams to create scalable, high-performance testing solutions, applying modern testing techniques to...

  • Senior Python Data Engineer – ETL

    2 weeks ago

    Erode, India AIMLEAP Full time

    Senior Python Data Engineer – ETL & Pipeline DevelopmentExperience: 5 to 12 YearsLocation: Remote (WFH) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 5Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners Preferred What We...

  • AWS Machine Learning Engineer

    4 days ago

    erode, India beBeeMLOps Full time

    Job OverviewDesign and deploy robust machine learning pipelines using AWS SageMaker and associated cloud services within a global data & analytics team.The role requires strong experience in production-grade MLOps, automation, and cloud engineering. Key responsibilities include building, deploying, and maintaining machine learning models using AWS SageMaker,...